2024-05-09T09:38:50.749 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T09:38:50.750 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} --name kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi --verbose --archive /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640 --owner scheduled_kkeithle@teuthology -- /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/orig.config.yaml 2024-05-09T09:38:50.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T09:38:50.877 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640 branch: wip-kkeithley-zipper-ec description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} email: null first_in_suite: false job_id: '7699640' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-kkeithley-zipper-ec ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-kkeithley-zipper-ec sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc owner: scheduled_kkeithle@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 3428 sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc sleep_before_teardown: 0 subset: 1/2 suite: rgw suite_branch: wip-kkeithley-zipper-ec suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_2d4f3997312aba36846da54fe4ed144c644dd8fc/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFmuJYDqafWk8KQflldBOHFg3FTPSTlMYiNFWQGH39rw1KetGfP6XpdBKdK4uxIvgZjZhgSz7DDTLJgF9hoBIDw= smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKlZLZyn+tWxJeoEj3I4v9aPxXtZ7ZA1QY/mjkFI0TxwcoI5j71V4pJCnCDyVTJyhtJxZhZVko3A4gRh1+A6Ilo= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_multipart_upload.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-09_09:15:11 tube: smithi user: kkeithle verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T09:38:50.877 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_2d4f3997312aba36846da54fe4ed144c644dd8fc/qa; will attempt to use it 2024-05-09T09:38:50.878 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_2d4f3997312aba36846da54fe4ed144c644dd8fc/qa/tasks 2024-05-09T09:38:50.878 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T09:38:50.880 INFO:teuthology.task.internal:Checking packages... 2024-05-09T09:38:50.906 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2d4f3997312aba36846da54fe4ed144c644dd8fc' 2024-05-09T09:38:50.906 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T09:38:50.906 INFO:teuthology.packaging:ref: None 2024-05-09T09:38:50.906 INFO:teuthology.packaging:tag: None 2024-05-09T09:38:50.907 INFO:teuthology.packaging:branch: wip-kkeithley-zipper-ec 2024-05-09T09:38:50.907 INFO:teuthology.packaging:sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:38:50.907 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-kkeithley-zipper-ec 2024-05-09T09:38:51.206 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:38:51.208 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T09:38:51.213 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T09:38:51.213 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T09:38:51.226 INFO:teuthology.task.internal:Saving configuration 2024-05-09T09:38:51.240 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T09:38:51.246 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T09:38:51.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 09:33:20.409665', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICF5yzQKYBMTVC7+bra809ctMplO4SCQKNF9R4dVFulX'} 2024-05-09T09:38:51.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 09:33:20.411204', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICNhQfnL3qQyqLJlB1aT09bH3UwxE8SV4YgoWgZv75/n'} 2024-05-09T09:38:51.294 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T09:38:51.300 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-05-09T09:38:51.300 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-09T09:38:51.300 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T09:38:51.469 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fab9709a3a0>, signals=[15]) 2024-05-09T09:38:51.469 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T09:38:51.475 INFO:teuthology.task.internal:Opening connections... 2024-05-09T09:38:51.476 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:38:51.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:38:51.559 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:38:51.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:38:51.637 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T09:38:51.643 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-05-09T09:38:51.649 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-05-09T09:38:51.649 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-09T09:38:51.696 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-09T09:38:51.697 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-09T09:38:51.697 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-09T09:38:51.697 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2024-05-09T09:38:51.697 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-05-09T09:38:51.717 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-05-09T09:38:51.722 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-05-09T09:38:51.723 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-05-09T09:38:51.769 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-09T09:38:51.769 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Ubuntu" 2024-05-09T09:38:51.769 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="22.04" 2024-05-09T09:38:51.769 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-09T09:38:51.769 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_CODENAME=jammy 2024-05-09T09:38:51.770 INFO:teuthology.orchestra.run.smithi080.stdout:ID=ubuntu 2024-05-09T09:38:51.770 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE=debian 2024-05-09T09:38:51.770 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-09T09:38:51.770 INFO:teuthology.orchestra.run.smithi080.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-09T09:38:51.770 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-09T09:38:51.770 INFO:teuthology.orchestra.run.smithi080.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-09T09:38:51.770 INFO:teuthology.orchestra.run.smithi080.stdout:UBUNTU_CODENAME=jammy 2024-05-09T09:38:51.770 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-05-09T09:38:51.792 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T09:38:51.801 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T09:38:51.806 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T09:38:51.807 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-05-09T09:38:51.809 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-05-09T09:38:51.816 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T09:38:51.822 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T09:38:51.822 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-05-09T09:38:51.858 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-05-09T09:38:51.881 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T09:38:51.934 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T09:38:51.951 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-09T09:38:51.951 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-09T09:38:51.951 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T09:38:51.952 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T09:38:51.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:38:51.957 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-05-09T09:38:51.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:38:51.958 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-09T09:38:52.004 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-56-generic 2024-05-09T09:38:52.005 INFO:teuthology.task.kernel:Running kernel on smithi032: 5.15.0-56-generic 2024-05-09T09:38:52.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2024-05-09T09:38:52.006 INFO:teuthology.orchestra.run.smithi080.stdout:5.15.0-56-generic 2024-05-09T09:38:52.006 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.15.0-56-generic 2024-05-09T09:38:52.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-05-09T09:38:52.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-05-09T09:38:52.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-05-09T09:38:52.316 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:38:52.316 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-09T09:38:52.316 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-09T09:38:52.391 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:38:52.393 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-09T09:38:52.416 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-09T09:38:52.452 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-09T09:38:52.600 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-09T09:38:52.672 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-09T09:38:52.813 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-09T09:38:52.823 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-09T09:38:52.848 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-09T09:38:52.850 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-09T09:38:52.866 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-09T09:38:52.873 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-09T09:38:52.878 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-09T09:38:52.879 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-09T09:38:52.880 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-09T09:38:52.884 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-09T09:38:52.884 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-09T09:38:52.886 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-09T09:38:52.979 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-09T09:38:53.069 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-09T09:38:53.110 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-09T09:38:53.133 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-09T09:38:53.133 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T09:38:53.133 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-09T09:38:53.138 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T09:38:53.138 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-09T09:38:53.148 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-09T09:38:53.153 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-09T09:38:53.164 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-09T09:38:53.167 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-09T09:38:53.168 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-09T09:38:53.168 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-09T09:38:53.168 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-09T09:38:53.168 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-09T09:38:53.169 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-09T09:38:53.205 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-09T09:38:53.206 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-09T09:38:53.207 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-09T09:38:53.208 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-09T09:38:53.209 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-09T09:38:53.209 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-09T09:38:53.210 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-09T09:38:53.212 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-09T09:38:53.212 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-09T09:38:53.228 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-09T09:38:53.249 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-09T09:38:53.249 INFO:teuthology.orchestra.run.smithi080.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-09T09:38:53.250 INFO:teuthology.orchestra.run.smithi080.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-09T09:38:53.280 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-09T09:38:53.291 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-09T09:38:53.292 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-09T09:38:53.343 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-09T09:38:53.375 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-09T09:38:53.376 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-09T09:38:53.384 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T09:38:53.384 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-09T09:38:53.399 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-09T09:38:53.582 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-09T09:38:53.696 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-09T09:38:53.727 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-09T09:38:53.728 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-09T09:38:53.872 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-09T09:38:53.876 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-09T09:38:53.899 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T09:38:53.997 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-09T09:38:54.002 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-09T09:38:54.017 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-09T09:38:54.017 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-09T09:38:54.021 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-09T09:38:54.066 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-09T09:38:54.794 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-09T09:38:54.869 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-09T09:38:54.889 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-09T09:38:54.892 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-09T09:38:54.892 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-09T09:38:54.895 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-09T09:38:54.897 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-09T09:38:54.897 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-09T09:38:54.902 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-09T09:38:54.910 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-09T09:38:55.078 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-09T09:38:55.160 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-09T09:38:55.241 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-09T09:38:55.295 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-09T09:38:55.346 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-09T09:38:58.637 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 13.4 MB in 2s (6,357 kB/s) 2024-05-09T09:39:00.069 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 13.4 MB in 3s (4,241 kB/s) 2024-05-09T09:39:00.126 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-09T09:39:00.144 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T09:39:00.195 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-09T09:39:00.381 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-05-09T09:39:00.381 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-05-09T09:39:00.546 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:39:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:39:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:39:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:39:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-09T09:39:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: python2.7-minimal 2024-05-09T09:39:00.547 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:39:00.548 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-05-09T09:39:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T09:39:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-09T09:39:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-09T09:39:00.550 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-05-09T09:39:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-09T09:39:00.550 INFO:teuthology.orchestra.run.smithi080.stdout:Recommended packages: 2024-05-09T09:39:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: thermald 2024-05-09T09:39:00.600 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-05-09T09:39:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T09:39:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-09T09:39:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-09T09:39:00.602 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages will be upgraded: 2024-05-09T09:39:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-09T09:39:00.782 INFO:teuthology.orchestra.run.smithi080.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T09:39:00.782 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 113 MB of archives. 2024-05-09T09:39:00.782 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-09T09:39:00.783 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-09T09:39:01.476 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-05-09T09:39:01.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T09:39:01.557 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-05-09T09:39:01.763 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-05-09T09:39:01.764 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-05-09T09:39:01.947 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:39:01.948 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:39:01.948 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:39:01.948 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:39:01.948 INFO:teuthology.orchestra.run.smithi032.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-09T09:39:01.948 INFO:teuthology.orchestra.run.smithi032.stdout: python2.7-minimal 2024-05-09T09:39:01.948 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:39:01.949 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-05-09T09:39:01.950 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T09:39:01.950 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-09T09:39:01.950 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-09T09:39:01.951 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-05-09T09:39:01.951 INFO:teuthology.orchestra.run.smithi032.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-09T09:39:01.952 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-05-09T09:39:01.952 INFO:teuthology.orchestra.run.smithi032.stdout: thermald 2024-05-09T09:39:02.005 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-05-09T09:39:02.005 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T09:39:02.005 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-09T09:39:02.006 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-09T09:39:02.007 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-05-09T09:39:02.007 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-09T09:39:02.188 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-09T09:39:02.265 INFO:teuthology.orchestra.run.smithi032.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T09:39:02.265 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 113 MB of archives. 2024-05-09T09:39:02.266 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-09T09:39:02.266 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-09T09:39:02.539 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-09T09:39:04.621 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-09T09:39:04.715 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-09T09:39:04.715 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-09T09:39:04.715 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-09T09:39:05.066 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-09T09:39:05.145 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-09T09:39:05.149 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-09T09:39:05.544 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 113 MB in 5s (25.0 MB/s) 2024-05-09T09:39:05.717 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-09T09:39:07.814 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-09T09:39:07.818 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:39:08.090 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:08.435 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-09T09:39:08.435 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-09T09:39:08.436 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-09T09:39:08.956 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-09T09:39:09.076 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-09T09:39:09.495 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 113 MB in 7s (16.1 MB/s) 2024-05-09T09:39:09.647 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-09T09:39:10.257 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-09T09:39:10.279 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:39:10.367 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:10.869 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-09T09:39:10.890 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:39:10.927 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:11.699 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-09T09:39:11.703 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:39:11.862 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:13.881 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-09T09:39:13.902 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:39:13.980 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:14.376 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-09T09:39:14.396 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:39:14.426 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:18.153 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:39:18.286 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:39:18.586 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:39:18.715 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:39:19.018 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-09T09:39:19.040 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-09T09:39:19.109 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T09:39:20.731 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:39:20.858 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:39:21.208 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:39:21.336 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:39:21.606 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-09T09:39:21.617 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-09T09:39:21.648 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T09:39:25.527 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-09T09:39:25.564 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:39:25.602 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:26.903 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-09T09:39:26.941 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:39:26.977 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:29.224 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:39:29.371 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:39:29.721 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T09:39:29.851 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:29.977 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-09T09:39:30.106 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:39:31.055 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:39:31.388 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T09:39:31.436 INFO:teuthology.orchestra.run.smithi080.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:39:31.436 INFO:teuthology.orchestra.run.smithi080.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-09T09:39:31.436 INFO:teuthology.orchestra.run.smithi080.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:39:31.437 INFO:teuthology.orchestra.run.smithi080.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-09T09:39:31.501 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:31.599 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:31.619 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-09T09:39:31.723 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:33.000 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:33.073 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:39:33.073 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-09T09:39:33.074 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:39:33.074 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-09T09:39:33.224 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:34.926 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:35.052 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-09T09:39:35.178 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-09T09:39:35.329 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:35.394 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-09T09:39:35.394 INFO:teuthology.orchestra.run.smithi080.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:39:36.327 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-09T09:39:36.453 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-09T09:39:36.579 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:39:36.644 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-09T09:39:36.644 INFO:teuthology.orchestra.run.smithi032.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:39:49.610 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-09T09:39:49.610 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub' 2024-05-09T09:39:49.642 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T09:39:49.666 INFO:teuthology.orchestra.run.smithi080.stdout:Generating grub configuration file ... 2024-05-09T09:39:50.014 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:39:50.035 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:39:50.370 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:39:50.376 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T09:39:50.451 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T09:39:50.456 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T09:39:50.597 INFO:teuthology.orchestra.run.smithi080.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T09:39:50.597 INFO:teuthology.orchestra.run.smithi080.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T09:39:50.597 INFO:teuthology.orchestra.run.smithi080.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T09:39:50.643 INFO:teuthology.orchestra.run.smithi080.stdout:done 2024-05-09T09:39:50.734 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-09T09:39:50.734 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub' 2024-05-09T09:39:50.759 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T09:39:50.781 INFO:teuthology.orchestra.run.smithi032.stdout:Generating grub configuration file ... 2024-05-09T09:39:51.021 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:39:51.034 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:39:51.096 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 21 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta 2024-05-09T09:39:51.120 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.15.0.106.106 2024-05-09T09:39:51.121 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T09:39:51.121 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T09:39:51.121 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-05-09T09:39:51.121 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-05-09T09:39:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-05-09T09:39:51.121 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-05-09T09:39:51.121 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-09T09:39:51.121 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T09:39:51.121 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T09:39:51.121 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-09T09:39:51.122 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T09:39:51.122 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-05-09T09:39:51.248 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-05-09T09:39:51.325 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:39:51.331 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T09:39:51.403 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T09:39:51.409 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T09:39:51.499 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:39:51.569 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T09:39:51.576 INFO:teuthology.orchestra.run.smithi032.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T09:39:51.576 INFO:teuthology.orchestra.run.smithi032.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T09:39:51.576 INFO:teuthology.orchestra.run.smithi032.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T09:39:51.613 INFO:teuthology.orchestra.run.smithi032.stdout:done 2024-05-09T09:39:51.651 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T09:39:51.861 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T09:39:52.080 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2024-05-09T09:39:52.107 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2024-05-09T09:39:52.107 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2024-05-09T09:39:52.107 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2024-05-09T09:39:52.107 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2024-05-09T09:39:52.107 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 21 2024-05-09T09:39:52.107 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.15.0.106.106 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2024-05-09T09:39:52.108 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2024-05-09T09:39:52.110 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-09T09:39:52.110 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T09:39:52.110 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T09:39:52.110 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-09T09:39:52.110 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T09:39:52.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2024-05-09T09:39:52.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-05-09T09:39:52.429 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T09:39:52.551 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:39:52.622 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T09:39:52.713 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T09:39:53.018 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-09T09:39:53.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T09:39:53.099 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-09T09:39:53.301 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-05-09T09:39:53.302 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-05-09T09:39:53.481 INFO:teuthology.orchestra.run.smithi080.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-09T09:39:53.482 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:39:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:39:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:39:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:39:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T09:39:53.482 INFO:teuthology.orchestra.run.smithi080.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T09:39:53.482 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:39:53.523 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T09:39:53.525 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 21 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.15.0.106.106 2024-05-09T09:39:53.538 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T09:39:53.539 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T09:39:53.539 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-05-09T09:39:53.539 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-05-09T09:39:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-05-09T09:39:53.539 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-05-09T09:39:53.539 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-09T09:39:53.584 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.bzjFbSZyzR 2024-05-09T09:39:53.585 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub/grub.cfg /tmp/tmp.bzjFbSZyzR 2024-05-09T09:39:53.638 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.bzjFbSZyzR 2024-05-09T09:39:53.754 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.bzjFbSZyzR is 10KB 2024-05-09T09:39:53.767 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.bzjFbSZyzR 2024-05-09T09:39:53.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-09T09:39:53.828 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:39:53.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-09T09:39:53.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-09T09:39:53.851 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-05-09T09:39:53.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T09:39:53.895 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-09T09:39:53.896 DEBUG:teuthology.orchestra.run.smithi080:> sudo update-grub 2024-05-09T09:39:53.924 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-05-09T09:39:54.106 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-05-09T09:39:54.107 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-05-09T09:39:54.272 INFO:teuthology.orchestra.run.smithi032.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-09T09:39:54.272 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:39:54.272 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:39:54.272 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:39:54.273 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:39:54.273 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T09:39:54.273 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T09:39:54.273 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:39:54.313 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T09:39:54.314 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 21 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2024-05-09T09:39:54.370 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.15.0.106.106 2024-05-09T09:39:54.371 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T09:39:54.371 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T09:39:54.371 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2024-05-09T09:39:54.371 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2024-05-09T09:39:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2024-05-09T09:39:54.371 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2024-05-09T09:39:54.372 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-05-09T09:39:54.420 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.2D1P3yaMZ2 2024-05-09T09:39:54.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub/grub.cfg /tmp/tmp.2D1P3yaMZ2 2024-05-09T09:39:54.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.2D1P3yaMZ2 2024-05-09T09:39:54.590 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.2D1P3yaMZ2 is 10KB 2024-05-09T09:39:54.603 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.2D1P3yaMZ2 2024-05-09T09:39:54.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-09T09:39:54.663 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:39:54.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-09T09:39:54.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-09T09:39:54.737 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-09T09:39:54.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo update-grub 2024-05-09T09:39:55.225 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub' 2024-05-09T09:39:55.226 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T09:39:55.229 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-05-09T09:39:55.442 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:39:55.449 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:39:55.673 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:39:55.678 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T09:39:55.720 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T09:39:55.725 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T09:39:55.847 INFO:teuthology.orchestra.run.smithi080.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T09:39:55.848 INFO:teuthology.orchestra.run.smithi080.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T09:39:55.848 INFO:teuthology.orchestra.run.smithi080.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T09:39:55.859 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-05-09T09:39:55.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-05-09T09:39:55.882 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-05-09T09:39:55.884 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T09:39:55.886 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-05-09T09:39:56.078 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:39:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:39:56.315 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:39:56.320 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T09:39:56.362 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T09:39:56.368 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T09:39:56.493 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T09:39:56.494 INFO:teuthology.orchestra.run.smithi032.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T09:39:56.494 INFO:teuthology.orchestra.run.smithi032.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T09:39:56.505 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-05-09T09:39:56.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2024-05-09T09:40:25.894 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-09T09:40:25.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-09T09:40:25.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:40:26.520 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-09T09:40:26.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-09T09:40:26.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:41:25.955 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T09:41:26.524 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T09:41:34.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-09T09:41:34.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:41:35.275 ERROR:teuthology.orchestra.connection:Error authenticating with smithi080.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-05-09T09:41:35.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-09T09:41:35.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:41:35.738 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-05-09T09:41:36.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-09T09:41:36.225 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-09T09:41:36.225 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-05-09T09:41:36.273 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-106-generic 2024-05-09T09:41:36.273 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-09T09:41:36.274 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T09:41:36.274 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-09T09:41:37.275 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-09T09:41:37.275 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T09:41:37.347 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2024-05-09T09:41:37.367 DEBUG:teuthology.parallel:result is None 2024-05-09T09:41:39.355 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-09T09:41:40.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-09T09:41:40.314 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-09T09:41:40.314 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-09T09:41:40.359 INFO:teuthology.orchestra.run.smithi080.stdout:5.15.0-106-generic 2024-05-09T09:41:40.360 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-09T09:41:40.360 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T09:41:40.360 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-09T09:41:41.360 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-09T09:41:41.361 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T09:41:41.449 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-05-09T09:41:41.468 DEBUG:teuthology.parallel:result is None 2024-05-09T09:41:41.468 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T09:41:41.475 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T09:41:41.476 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T09:41:41.478 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T09:41:41.484 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T09:41:41.490 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T09:41:41.497 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T09:41:41.498 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T09:41:41.527 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T09:41:41.553 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T09:41:41.560 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T09:41:41.560 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T09:41:41.587 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T09:41:41.608 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T09:41:41.618 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T09:41:41.630 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T09:41:41.638 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T09:41:41.640 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T09:41:41.647 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T09:41:41.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T09:41:41.666 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T09:41:41.694 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T09:41:41.703 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T09:41:41.703 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T09:41:41.726 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T09:41:41.742 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T09:41:41.778 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T09:41:41.826 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:41:41.826 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T09:41:41.886 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T09:41:41.892 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T09:41:41.939 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:41:41.939 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T09:41:42.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-05-09T09:41:42.003 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-05-09T09:41:42.079 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T09:41:42.086 INFO:teuthology.task.internal:Starting timer... 2024-05-09T09:41:42.087 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T09:41:42.097 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T09:41:42.106 DEBUG:teuthology.task.selinux:Excluding smithi032: OS 'ubuntu' does not support SELinux 2024-05-09T09:41:42.106 DEBUG:teuthology.task.selinux:Excluding smithi080: OS 'ubuntu' does not support SELinux 2024-05-09T09:41:42.107 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T09:41:42.107 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-09T09:41:42.107 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T09:41:42.107 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T09:41:42.116 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T09:41:42.133 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T09:41:42.135 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi080.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T09:48:49.161 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi080.front.sepia.ceph.com')] 2024-05-09T09:48:49.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-09T09:48:49.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:48:49.290 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-05-09T09:48:49.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-05-09T09:48:49.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-09T09:48:49.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:48:49.449 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-09T09:48:49.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-09T09:48:49.522 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T09:48:49.536 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T09:48:49.536 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T09:48:49.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T09:48:49.539 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T09:48:49.539 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T09:48:49.564 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-09T09:48:49.565 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Command line: ntpd -gq 2024-05-09T09:48:49.565 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: ---------------------------------------------------- 2024-05-09T09:48:49.565 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: ntp-4 is maintained by Network Time Foundation, 2024-05-09T09:48:49.565 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-09T09:48:49.565 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: corporation. Support and training for ntp-4 are 2024-05-09T09:48:49.565 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: available at https://www.nwtime.org/support 2024-05-09T09:48:49.565 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: ---------------------------------------------------- 2024-05-09T09:48:49.565 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: proto: precision = 0.046 usec (-24) 2024-05-09T09:48:49.566 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: basedate set to 2022-02-04 2024-05-09T09:48:49.566 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: gps base set to 2022-02-06 (week 2196) 2024-05-09T09:48:49.566 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T09:48:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T09:48:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-09T09:48:49.567 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: restrict ::: KOD does nothing without LIMITED. 2024-05-09T09:48:49.567 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Listen and drop on 0 v6wildcard [::]:123 2024-05-09T09:48:49.567 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-09T09:48:49.567 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Listen normally on 2 lo 127.0.0.1:123 2024-05-09T09:48:49.568 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Listen normally on 3 ens1f0 172.21.15.32:123 2024-05-09T09:48:49.568 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Listen normally on 4 lo [::1]:123 2024-05-09T09:48:49.568 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2602%4]:123 2024-05-09T09:48:49.568 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:49 ntpd[17149]: Listening on routing socket on fd #22 for interface updates 2024-05-09T09:48:49.596 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-09T09:48:49.597 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Command line: ntpd -gq 2024-05-09T09:48:49.597 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: ---------------------------------------------------- 2024-05-09T09:48:49.597 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: ntp-4 is maintained by Network Time Foundation, 2024-05-09T09:48:49.597 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-09T09:48:49.597 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: corporation. Support and training for ntp-4 are 2024-05-09T09:48:49.597 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: available at https://www.nwtime.org/support 2024-05-09T09:48:49.597 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: ---------------------------------------------------- 2024-05-09T09:48:49.598 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: proto: precision = 0.045 usec (-24) 2024-05-09T09:48:49.598 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: basedate set to 2022-02-04 2024-05-09T09:48:49.598 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: gps base set to 2022-02-06 (week 2196) 2024-05-09T09:48:49.598 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T09:48:49.599 INFO:teuthology.orchestra.run.smithi080.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T09:48:49.599 INFO:teuthology.orchestra.run.smithi080.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-09T09:48:49.600 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: restrict ::: KOD does nothing without LIMITED. 2024-05-09T09:48:49.600 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Listen and drop on 0 v6wildcard [::]:123 2024-05-09T09:48:49.600 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-09T09:48:49.600 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Listen normally on 2 lo 127.0.0.1:123 2024-05-09T09:48:49.600 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Listen normally on 3 enp3s0f1 172.21.15.80:123 2024-05-09T09:48:49.600 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Listen normally on 4 lo [::1]:123 2024-05-09T09:48:49.600 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba9%5]:123 2024-05-09T09:48:49.600 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:49 ntpd[17269]: Listening on routing socket on fd #22 for interface updates 2024-05-09T09:48:50.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:50 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:50.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:50 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:50.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:50 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:50.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:50 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:50.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:50 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:50.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:50 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:51.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:51 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:51.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:51 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:51.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:51 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:51.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:51 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:51.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:51 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:51.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:51 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:51.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:51 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:51.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:51 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:51.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:51 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:51.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:51 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:51.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:51 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:51.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:51 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:51.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:51 ntpd[17269]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:51.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:51 ntpd[17269]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:52.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:52.567 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:52 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:52.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:52 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:52.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:52 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:53.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:53 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:53.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:53 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:53.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:53 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:53.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:53 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:53.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:53 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:53.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:53 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:53.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:53.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:53 ntpd[17269]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:54.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:54.567 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:54 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:54.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:54 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:54.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:54 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:54.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:54 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:54.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:54 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:54.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:54 ntpd[17269]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:54.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:54 ntpd[17269]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:55.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:55 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:55.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:55 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:55.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:55 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:55.565 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:55 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:55.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:55 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:55.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:55 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:55.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:55.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:55.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:55 ntpd[17269]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:56.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:56.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:56.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:56.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:56.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:56.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:56.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:56.566 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:56.567 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:56.567 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:56.567 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:56.567 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:56.567 INFO:teuthology.orchestra.run.smithi032.stdout: 9 May 09:48:56 ntpd[17149]: ntpd: time slew -0.002120 s 2024-05-09T09:48:56.567 INFO:teuthology.orchestra.run.smithi032.stdout:ntpd: time slew -0.002120s 2024-05-09T09:48:56.568 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-09T09:48:56.568 INFO:teuthology.orchestra.run.smithi032.stderr: 9 May 09:48:56 ntpd[17149]: can't open /var/log/ntpstats/loopstats.20240509: Permission denied 2024-05-09T09:48:56.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:56 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:56.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:56 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:56.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:56 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:56.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:56 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:56.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:56 ntpd[17269]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:56.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:56 ntpd[17269]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:56.611 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T09:48:56.612 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-05-09T09:48:56.612 INFO:teuthology.orchestra.run.smithi032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:48:56.612 INFO:teuthology.orchestra.run.smithi032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:48:56.612 INFO:teuthology.orchestra.run.smithi032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:48:56.612 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:48:57.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:57.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:57.597 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:57.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:57.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:48:57.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:48:57.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:48:57.598 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:48:57.598 INFO:teuthology.orchestra.run.smithi080.stdout: 9 May 09:48:57 ntpd[17269]: ntpd: time slew -0.001305 s 2024-05-09T09:48:57.598 INFO:teuthology.orchestra.run.smithi080.stdout:ntpd: time slew -0.001305s 2024-05-09T09:48:57.599 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-09T09:48:57.599 INFO:teuthology.orchestra.run.smithi080.stderr: 9 May 09:48:57 ntpd[17269]: can't open /var/log/ntpstats/loopstats.20240509: Permission denied 2024-05-09T09:48:57.658 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T09:48:57.658 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-05-09T09:48:57.658 INFO:teuthology.orchestra.run.smithi080.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:48:57.658 INFO:teuthology.orchestra.run.smithi080.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:48:57.658 INFO:teuthology.orchestra.run.smithi080.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:48:57.658 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:48:57.659 INFO:teuthology.run_tasks:Running task install... 2024-05-09T09:48:57.668 DEBUG:teuthology.task.install:project ceph 2024-05-09T09:48:57.668 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}} 2024-05-09T09:48:57.668 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'} 2024-05-09T09:48:57.668 INFO:teuthology.task.install:Using flavor: default 2024-05-09T09:48:57.674 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T09:48:57.674 INFO:teuthology.task.install:extra packages: [] 2024-05-09T09:48:57.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-key list | grep Ceph 2024-05-09T09:48:57.675 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-key list | grep Ceph 2024-05-09T09:48:57.739 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-09T09:48:57.763 INFO:teuthology.orchestra.run.smithi080.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-09T09:48:57.769 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-09T09:48:57.769 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph.com (release key) 2024-05-09T09:48:57.775 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-09T09:48:57.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:48:57.792 INFO:teuthology.orchestra.run.smithi080.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-09T09:48:57.792 INFO:teuthology.orchestra.run.smithi080.stdout:uid [ unknown] Ceph.com (release key) 2024-05-09T09:48:57.792 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-09T09:48:57.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:48:57.916 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default/ 2024-05-09T09:48:57.916 INFO:teuthology.task.install.deb:Package version is 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:48:57.931 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default/ 2024-05-09T09:48:57.931 INFO:teuthology.task.install.deb:Package version is 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:48:58.094 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:48:58.094 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-09T09:48:58.101 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:48:58.101 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-09T09:48:58.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-05-09T09:48:58.115 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-05-09T09:48:58.292 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:48:58.303 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T09:48:58.324 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T09:48:58.394 INFO:teuthology.orchestra.run.smithi080.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy InRelease 2024-05-09T09:48:58.400 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy InRelease 2024-05-09T09:48:58.405 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T09:48:58.409 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:48:58.410 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T09:48:58.431 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-09T09:48:58.436 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-09T09:48:58.468 INFO:teuthology.orchestra.run.smithi080.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-09T09:48:58.473 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-09T09:48:58.481 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T09:48:58.505 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-05-09T09:48:58.509 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-05-09T09:48:58.548 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.3 kB] 2024-05-09T09:48:58.551 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.3 kB] 2024-05-09T09:48:58.563 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T09:48:58.672 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 28.7 kB in 0s (76.0 kB/s) 2024-05-09T09:48:58.772 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 28.7 kB in 0s (59.6 kB/s) 2024-05-09T09:48:59.666 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-05-09T09:48:59.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3093-g2d4f3997-1jammy cephadm=19.0.0-3093-g2d4f3997-1jammy ceph-mds=19.0.0-3093-g2d4f3997-1jammy ceph-mgr=19.0.0-3093-g2d4f3997-1jammy ceph-common=19.0.0-3093-g2d4f3997-1jammy ceph-fuse=19.0.0-3093-g2d4f3997-1jammy ceph-test=19.0.0-3093-g2d4f3997-1jammy ceph-volume=19.0.0-3093-g2d4f3997-1jammy radosgw=19.0.0-3093-g2d4f3997-1jammy python3-rados=19.0.0-3093-g2d4f3997-1jammy python3-rgw=19.0.0-3093-g2d4f3997-1jammy python3-cephfs=19.0.0-3093-g2d4f3997-1jammy python3-rbd=19.0.0-3093-g2d4f3997-1jammy libcephfs2=19.0.0-3093-g2d4f3997-1jammy libcephfs-dev=19.0.0-3093-g2d4f3997-1jammy librados2=19.0.0-3093-g2d4f3997-1jammy librbd1=19.0.0-3093-g2d4f3997-1jammy rbd-fuse=19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:48:59.721 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-09T09:48:59.735 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-05-09T09:48:59.736 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3093-g2d4f3997-1jammy cephadm=19.0.0-3093-g2d4f3997-1jammy ceph-mds=19.0.0-3093-g2d4f3997-1jammy ceph-mgr=19.0.0-3093-g2d4f3997-1jammy ceph-common=19.0.0-3093-g2d4f3997-1jammy ceph-fuse=19.0.0-3093-g2d4f3997-1jammy ceph-test=19.0.0-3093-g2d4f3997-1jammy ceph-volume=19.0.0-3093-g2d4f3997-1jammy radosgw=19.0.0-3093-g2d4f3997-1jammy python3-rados=19.0.0-3093-g2d4f3997-1jammy python3-rgw=19.0.0-3093-g2d4f3997-1jammy python3-cephfs=19.0.0-3093-g2d4f3997-1jammy python3-rbd=19.0.0-3093-g2d4f3997-1jammy libcephfs2=19.0.0-3093-g2d4f3997-1jammy libcephfs-dev=19.0.0-3093-g2d4f3997-1jammy librados2=19.0.0-3093-g2d4f3997-1jammy librbd1=19.0.0-3093-g2d4f3997-1jammy rbd-fuse=19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:48:59.798 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-05-09T09:48:59.916 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-05-09T09:48:59.917 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-05-09T09:48:59.997 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-05-09T09:48:59.998 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-05-09T09:49:00.101 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:49:00.101 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:49:00.101 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:49:00.101 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:49:00.102 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T09:49:00.102 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T09:49:00.102 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:49:00.103 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-05-09T09:49:00.103 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-09T09:49:00.103 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-09T09:49:00.103 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-09T09:49:00.103 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-09T09:49:00.104 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-09T09:49:00.104 INFO:teuthology.orchestra.run.smithi032.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-09T09:49:00.104 INFO:teuthology.orchestra.run.smithi032.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-09T09:49:00.104 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-09T09:49:00.104 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-09T09:49:00.104 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-09T09:49:00.104 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T09:49:00.104 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-09T09:49:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet zip 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-05-09T09:49:00.106 INFO:teuthology.orchestra.run.smithi032.stdout: btrfs-tools 2024-05-09T09:49:00.198 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:49:00.198 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:49:00.198 INFO:teuthology.orchestra.run.smithi080.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:49:00.198 INFO:teuthology.orchestra.run.smithi080.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:49:00.198 INFO:teuthology.orchestra.run.smithi080.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T09:49:00.199 INFO:teuthology.orchestra.run.smithi080.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T09:49:00.199 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:49:00.199 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-05-09T09:49:00.199 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-09T09:49:00.199 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-09T09:49:00.200 INFO:teuthology.orchestra.run.smithi080.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-09T09:49:00.200 INFO:teuthology.orchestra.run.smithi080.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T09:49:00.201 INFO:teuthology.orchestra.run.smithi080.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet zip 2024-05-09T09:49:00.202 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout:Recommended packages: 2024-05-09T09:49:00.203 INFO:teuthology.orchestra.run.smithi080.stdout: btrfs-tools 2024-05-09T09:49:00.207 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-05-09T09:49:00.207 INFO:teuthology.orchestra.run.smithi032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-09T09:49:00.207 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-09T09:49:00.207 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-09T09:49:00.208 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-09T09:49:00.208 INFO:teuthology.orchestra.run.smithi032.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-09T09:49:00.208 INFO:teuthology.orchestra.run.smithi032.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-09T09:49:00.208 INFO:teuthology.orchestra.run.smithi032.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-09T09:49:00.208 INFO:teuthology.orchestra.run.smithi032.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-09T09:49:00.209 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-09T09:49:00.210 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-09T09:49:00.210 INFO:teuthology.orchestra.run.smithi032.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-09T09:49:00.297 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-09T09:49:00.297 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 199 MB of archives. 2024-05-09T09:49:00.297 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 891 MB of additional disk space will be used. 2024-05-09T09:49:00.297 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-09T09:49:00.303 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-05-09T09:49:00.303 INFO:teuthology.orchestra.run.smithi080.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-09T09:49:00.303 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-09T09:49:00.304 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T09:49:00.305 INFO:teuthology.orchestra.run.smithi080.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-09T09:49:00.306 INFO:teuthology.orchestra.run.smithi080.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-09T09:49:00.374 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-09T09:49:00.375 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 199 MB of archives. 2024-05-09T09:49:00.375 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 891 MB of additional disk space will be used. 2024-05-09T09:49:00.375 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-09T09:49:00.426 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-09T09:49:00.436 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-09T09:49:00.478 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-09T09:49:00.567 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-09T09:49:00.571 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-09T09:49:00.575 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3093-g2d4f3997-1jammy [3,547 kB] 2024-05-09T09:49:00.640 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-09T09:49:00.709 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-09T09:49:00.714 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3093-g2d4f3997-1jammy [3,547 kB] 2024-05-09T09:49:00.715 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-09T09:49:00.756 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-09T09:49:00.771 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-09T09:49:00.772 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-09T09:49:00.773 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-09T09:49:00.793 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-09T09:49:00.808 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-09T09:49:00.820 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-09T09:49:00.823 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-09T09:49:00.823 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-09T09:49:00.838 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-09T09:49:00.843 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-09T09:49:00.846 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-09T09:49:00.848 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-09T09:49:00.848 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-09T09:49:00.866 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-09T09:49:00.867 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-09T09:49:00.868 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-09T09:49:00.868 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-09T09:49:00.869 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-09T09:49:00.881 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-09T09:49:00.908 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-09T09:49:00.909 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-09T09:49:00.910 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-09T09:49:00.915 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-09T09:49:00.916 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-09T09:49:00.917 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-09T09:49:00.927 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-09T09:49:00.933 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-09T09:49:00.934 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-09T09:49:00.935 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-09T09:49:00.942 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-09T09:49:00.944 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-09T09:49:00.945 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-09T09:49:00.946 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-09T09:49:00.948 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-09T09:49:00.952 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-09T09:49:00.956 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-09T09:49:00.960 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-09T09:49:00.962 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-09T09:49:00.962 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-09T09:49:00.963 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-09T09:49:00.963 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-09T09:49:00.973 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-09T09:49:00.974 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-09T09:49:00.975 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-09T09:49:00.977 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-09T09:49:00.981 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-09T09:49:00.983 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-09T09:49:00.984 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-09T09:49:00.984 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-09T09:49:00.985 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-09T09:49:00.989 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-09T09:49:00.991 INFO:teuthology.orchestra.run.smithi032.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-09T09:49:00.993 INFO:teuthology.orchestra.run.smithi032.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-09T09:49:00.998 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-09T09:49:01.000 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-09T09:49:01.000 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-09T09:49:01.001 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-09T09:49:01.001 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-09T09:49:01.002 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-09T09:49:01.003 INFO:teuthology.orchestra.run.smithi032.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-09T09:49:01.007 INFO:teuthology.orchestra.run.smithi032.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-09T09:49:01.008 INFO:teuthology.orchestra.run.smithi032.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-09T09:49:01.010 INFO:teuthology.orchestra.run.smithi032.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-09T09:49:01.014 INFO:teuthology.orchestra.run.smithi032.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-09T09:49:01.020 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-09T09:49:01.020 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-09T09:49:01.024 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-09T09:49:01.025 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-09T09:49:01.044 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-09T09:49:01.045 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-09T09:49:01.047 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-09T09:49:01.048 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-09T09:49:01.048 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-09T09:49:01.056 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-09T09:49:01.067 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-09T09:49:01.068 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-09T09:49:01.078 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-09T09:49:01.079 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-09T09:49:01.086 INFO:teuthology.orchestra.run.smithi032.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-09T09:49:01.087 INFO:teuthology.orchestra.run.smithi032.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-09T09:49:01.089 INFO:teuthology.orchestra.run.smithi032.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-09T09:49:01.089 INFO:teuthology.orchestra.run.smithi032.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-09T09:49:01.090 INFO:teuthology.orchestra.run.smithi032.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-09T09:49:01.091 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-09T09:49:01.092 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-09T09:49:01.095 INFO:teuthology.orchestra.run.smithi080.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-09T09:49:01.099 INFO:teuthology.orchestra.run.smithi080.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-09T09:49:01.100 INFO:teuthology.orchestra.run.smithi080.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-09T09:49:01.103 INFO:teuthology.orchestra.run.smithi080.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-09T09:49:01.108 INFO:teuthology.orchestra.run.smithi032.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-09T09:49:01.110 INFO:teuthology.orchestra.run.smithi032.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-09T09:49:01.110 INFO:teuthology.orchestra.run.smithi032.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-09T09:49:01.120 INFO:teuthology.orchestra.run.smithi080.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-09T09:49:01.125 INFO:teuthology.orchestra.run.smithi080.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-09T09:49:01.126 INFO:teuthology.orchestra.run.smithi080.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-09T09:49:01.127 INFO:teuthology.orchestra.run.smithi080.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-09T09:49:01.129 INFO:teuthology.orchestra.run.smithi032.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-09T09:49:01.129 INFO:teuthology.orchestra.run.smithi032.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-09T09:49:01.136 INFO:teuthology.orchestra.run.smithi032.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-09T09:49:01.137 INFO:teuthology.orchestra.run.smithi032.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-09T09:49:01.137 INFO:teuthology.orchestra.run.smithi032.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-09T09:49:01.137 INFO:teuthology.orchestra.run.smithi032.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-09T09:49:01.138 INFO:teuthology.orchestra.run.smithi032.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-09T09:49:01.138 INFO:teuthology.orchestra.run.smithi032.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-09T09:49:01.141 INFO:teuthology.orchestra.run.smithi080.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-09T09:49:01.142 INFO:teuthology.orchestra.run.smithi032.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-09T09:49:01.157 INFO:teuthology.orchestra.run.smithi032.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-09T09:49:01.160 INFO:teuthology.orchestra.run.smithi032.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-09T09:49:01.161 INFO:teuthology.orchestra.run.smithi032.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-09T09:49:01.183 INFO:teuthology.orchestra.run.smithi032.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-09T09:49:01.188 INFO:teuthology.orchestra.run.smithi032.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-09T09:49:01.189 INFO:teuthology.orchestra.run.smithi032.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-09T09:49:01.190 INFO:teuthology.orchestra.run.smithi032.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-09T09:49:01.199 INFO:teuthology.orchestra.run.smithi032.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-09T09:49:01.200 INFO:teuthology.orchestra.run.smithi032.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-09T09:49:01.206 INFO:teuthology.orchestra.run.smithi032.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-09T09:49:01.217 INFO:teuthology.orchestra.run.smithi080.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-09T09:49:01.218 INFO:teuthology.orchestra.run.smithi080.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-09T09:49:01.219 INFO:teuthology.orchestra.run.smithi080.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-09T09:49:01.220 INFO:teuthology.orchestra.run.smithi080.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-09T09:49:01.221 INFO:teuthology.orchestra.run.smithi032.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-09T09:49:01.221 INFO:teuthology.orchestra.run.smithi080.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-09T09:49:01.222 INFO:teuthology.orchestra.run.smithi032.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-09T09:49:01.222 INFO:teuthology.orchestra.run.smithi032.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-09T09:49:01.245 INFO:teuthology.orchestra.run.smithi080.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-09T09:49:01.248 INFO:teuthology.orchestra.run.smithi080.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-09T09:49:01.249 INFO:teuthology.orchestra.run.smithi080.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-09T09:49:01.261 INFO:teuthology.orchestra.run.smithi032.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-09T09:49:01.263 INFO:teuthology.orchestra.run.smithi032.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-09T09:49:01.278 INFO:teuthology.orchestra.run.smithi032.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-09T09:49:01.279 INFO:teuthology.orchestra.run.smithi032.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-09T09:49:01.279 INFO:teuthology.orchestra.run.smithi032.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-09T09:49:01.284 INFO:teuthology.orchestra.run.smithi032.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-09T09:49:01.285 INFO:teuthology.orchestra.run.smithi032.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-09T09:49:01.288 INFO:teuthology.orchestra.run.smithi080.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-09T09:49:01.288 INFO:teuthology.orchestra.run.smithi080.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-09T09:49:01.315 INFO:teuthology.orchestra.run.smithi080.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-09T09:49:01.315 INFO:teuthology.orchestra.run.smithi080.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-09T09:49:01.316 INFO:teuthology.orchestra.run.smithi080.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-09T09:49:01.317 INFO:teuthology.orchestra.run.smithi080.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-09T09:49:01.317 INFO:teuthology.orchestra.run.smithi080.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-09T09:49:01.318 INFO:teuthology.orchestra.run.smithi080.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-09T09:49:01.323 INFO:teuthology.orchestra.run.smithi080.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-09T09:49:01.335 INFO:teuthology.orchestra.run.smithi080.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-09T09:49:01.337 INFO:teuthology.orchestra.run.smithi080.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-09T09:49:01.338 INFO:teuthology.orchestra.run.smithi080.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-09T09:49:01.356 INFO:teuthology.orchestra.run.smithi080.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-09T09:49:01.360 INFO:teuthology.orchestra.run.smithi080.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-09T09:49:01.361 INFO:teuthology.orchestra.run.smithi080.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-09T09:49:01.362 INFO:teuthology.orchestra.run.smithi080.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-09T09:49:01.368 INFO:teuthology.orchestra.run.smithi080.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-09T09:49:01.369 INFO:teuthology.orchestra.run.smithi080.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-09T09:49:01.373 INFO:teuthology.orchestra.run.smithi080.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-09T09:49:01.376 INFO:teuthology.orchestra.run.smithi080.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-09T09:49:01.377 INFO:teuthology.orchestra.run.smithi080.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-09T09:49:01.378 INFO:teuthology.orchestra.run.smithi080.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-09T09:49:01.397 INFO:teuthology.orchestra.run.smithi080.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-09T09:49:01.398 INFO:teuthology.orchestra.run.smithi080.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-09T09:49:01.408 INFO:teuthology.orchestra.run.smithi080.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-09T09:49:01.409 INFO:teuthology.orchestra.run.smithi080.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-09T09:49:01.409 INFO:teuthology.orchestra.run.smithi080.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-09T09:49:01.412 INFO:teuthology.orchestra.run.smithi080.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-09T09:49:01.413 INFO:teuthology.orchestra.run.smithi080.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-09T09:49:02.449 INFO:teuthology.orchestra.run.smithi032.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3093-g2d4f3997-1jammy [3,224 kB] 2024-05-09T09:49:03.551 INFO:teuthology.orchestra.run.smithi080.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3093-g2d4f3997-1jammy [3,224 kB] 2024-05-09T09:49:03.769 INFO:teuthology.orchestra.run.smithi032.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3093-g2d4f3997-1jammy [712 kB] 2024-05-09T09:49:04.030 INFO:teuthology.orchestra.run.smithi032.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3093-g2d4f3997-1jammy [357 kB] 2024-05-09T09:49:04.195 INFO:teuthology.orchestra.run.smithi032.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3093-g2d4f3997-1jammy [32.8 kB] 2024-05-09T09:49:04.200 INFO:teuthology.orchestra.run.smithi032.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3093-g2d4f3997-1jammy [180 kB] 2024-05-09T09:49:04.283 INFO:teuthology.orchestra.run.smithi032.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3093-g2d4f3997-1jammy [66.9 kB] 2024-05-09T09:49:04.291 INFO:teuthology.orchestra.run.smithi032.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3093-g2d4f3997-1jammy [330 kB] 2024-05-09T09:49:04.452 INFO:teuthology.orchestra.run.smithi032.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3093-g2d4f3997-1jammy [6,890 kB] 2024-05-09T09:49:05.637 INFO:teuthology.orchestra.run.smithi080.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3093-g2d4f3997-1jammy [712 kB] 2024-05-09T09:49:06.027 INFO:teuthology.orchestra.run.smithi080.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3093-g2d4f3997-1jammy [357 kB] 2024-05-09T09:49:06.263 INFO:teuthology.orchestra.run.smithi080.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3093-g2d4f3997-1jammy [32.8 kB] 2024-05-09T09:49:06.277 INFO:teuthology.orchestra.run.smithi080.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3093-g2d4f3997-1jammy [180 kB] 2024-05-09T09:49:06.403 INFO:teuthology.orchestra.run.smithi080.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3093-g2d4f3997-1jammy [66.9 kB] 2024-05-09T09:49:06.440 INFO:teuthology.orchestra.run.smithi080.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3093-g2d4f3997-1jammy [330 kB] 2024-05-09T09:49:06.621 INFO:teuthology.orchestra.run.smithi080.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3093-g2d4f3997-1jammy [6,890 kB] 2024-05-09T09:49:06.939 INFO:teuthology.orchestra.run.smithi032.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3093-g2d4f3997-1jammy [112 kB] 2024-05-09T09:49:06.977 INFO:teuthology.orchestra.run.smithi032.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3093-g2d4f3997-1jammy [466 kB] 2024-05-09T09:49:07.146 INFO:teuthology.orchestra.run.smithi032.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3093-g2d4f3997-1jammy [25.7 MB] 2024-05-09T09:49:10.637 INFO:teuthology.orchestra.run.smithi080.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3093-g2d4f3997-1jammy [112 kB] 2024-05-09T09:49:10.679 INFO:teuthology.orchestra.run.smithi080.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3093-g2d4f3997-1jammy [466 kB] 2024-05-09T09:49:10.904 INFO:teuthology.orchestra.run.smithi080.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3093-g2d4f3997-1jammy [25.7 MB] 2024-05-09T09:49:17.940 INFO:teuthology.orchestra.run.smithi032.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3093-g2d4f3997-1jammy [23.8 MB] 2024-05-09T09:49:20.259 INFO:teuthology.orchestra.run.smithi080.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3093-g2d4f3997-1jammy [23.8 MB] 2024-05-09T09:49:26.532 INFO:teuthology.orchestra.run.smithi080.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3093-g2d4f3997-1jammy [244 kB] 2024-05-09T09:49:26.537 INFO:teuthology.orchestra.run.smithi080.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3093-g2d4f3997-1jammy [124 kB] 2024-05-09T09:49:26.540 INFO:teuthology.orchestra.run.smithi080.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3093-g2d4f3997-1jammy [1,525 kB] 2024-05-09T09:49:26.854 INFO:teuthology.orchestra.run.smithi080.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3093-g2d4f3997-1jammy [6,258 kB] 2024-05-09T09:49:30.243 INFO:teuthology.orchestra.run.smithi080.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3093-g2d4f3997-1jammy [22.8 MB] 2024-05-09T09:49:31.076 INFO:teuthology.orchestra.run.smithi032.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3093-g2d4f3997-1jammy [244 kB] 2024-05-09T09:49:31.410 INFO:teuthology.orchestra.run.smithi032.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3093-g2d4f3997-1jammy [124 kB] 2024-05-09T09:49:31.592 INFO:teuthology.orchestra.run.smithi032.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3093-g2d4f3997-1jammy [1,525 kB] 2024-05-09T09:49:33.715 INFO:teuthology.orchestra.run.smithi032.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3093-g2d4f3997-1jammy [6,258 kB] 2024-05-09T09:49:40.596 INFO:teuthology.orchestra.run.smithi032.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3093-g2d4f3997-1jammy [22.8 MB] 2024-05-09T09:49:45.360 INFO:teuthology.orchestra.run.smithi080.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3093-g2d4f3997-1jammy [14.0 kB] 2024-05-09T09:49:45.360 INFO:teuthology.orchestra.run.smithi080.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3093-g2d4f3997-1jammy [870 kB] 2024-05-09T09:49:45.688 INFO:teuthology.orchestra.run.smithi080.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3093-g2d4f3997-1jammy [2,437 kB] 2024-05-09T09:49:46.699 INFO:teuthology.orchestra.run.smithi080.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3093-g2d4f3997-1jammy [792 kB] 2024-05-09T09:49:47.055 INFO:teuthology.orchestra.run.smithi080.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3093-g2d4f3997-1jammy [148 kB] 2024-05-09T09:49:47.126 INFO:teuthology.orchestra.run.smithi080.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3093-g2d4f3997-1jammy [2,304 kB] 2024-05-09T09:49:48.129 INFO:teuthology.orchestra.run.smithi080.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3093-g2d4f3997-1jammy [8,625 kB] 2024-05-09T09:49:50.182 INFO:teuthology.orchestra.run.smithi032.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3093-g2d4f3997-1jammy [14.0 kB] 2024-05-09T09:49:50.183 INFO:teuthology.orchestra.run.smithi032.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3093-g2d4f3997-1jammy [870 kB] 2024-05-09T09:49:50.438 INFO:teuthology.orchestra.run.smithi032.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3093-g2d4f3997-1jammy [2,437 kB] 2024-05-09T09:49:51.299 INFO:teuthology.orchestra.run.smithi032.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3093-g2d4f3997-1jammy [792 kB] 2024-05-09T09:49:51.572 INFO:teuthology.orchestra.run.smithi032.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3093-g2d4f3997-1jammy [148 kB] 2024-05-09T09:49:51.601 INFO:teuthology.orchestra.run.smithi032.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3093-g2d4f3997-1jammy [2,304 kB] 2024-05-09T09:49:52.102 INFO:teuthology.orchestra.run.smithi080.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3093-g2d4f3997-1jammy [14.2 kB] 2024-05-09T09:49:52.103 INFO:teuthology.orchestra.run.smithi080.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3093-g2d4f3997-1jammy [51.4 MB] 2024-05-09T09:49:52.403 INFO:teuthology.orchestra.run.smithi032.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3093-g2d4f3997-1jammy [8,625 kB] 2024-05-09T09:49:55.460 INFO:teuthology.orchestra.run.smithi032.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3093-g2d4f3997-1jammy [14.2 kB] 2024-05-09T09:49:55.460 INFO:teuthology.orchestra.run.smithi032.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3093-g2d4f3997-1jammy [51.4 MB] 2024-05-09T09:50:12.178 INFO:teuthology.orchestra.run.smithi080.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3093-g2d4f3997-1jammy [124 kB] 2024-05-09T09:50:12.180 INFO:teuthology.orchestra.run.smithi080.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3093-g2d4f3997-1jammy [38.9 kB] 2024-05-09T09:50:12.181 INFO:teuthology.orchestra.run.smithi080.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3093-g2d4f3997-1jammy [13.6 MB] 2024-05-09T09:50:16.459 INFO:teuthology.orchestra.run.smithi080.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3093-g2d4f3997-1jammy [91.6 kB] 2024-05-09T09:50:17.022 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 199 MB in 1min 16s (2,620 kB/s) 2024-05-09T09:50:17.190 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-09T09:50:17.291 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-09T09:50:17.297 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-09T09:50:17.380 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T09:50:17.709 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-09T09:50:17.735 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-09T09:50:17.775 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T09:50:18.111 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-09T09:50:18.138 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-09T09:50:18.178 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T09:50:18.582 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-09T09:50:18.609 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:50:18.648 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:50:19.060 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-09T09:50:19.086 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:50:19.126 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:50:19.622 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-09T09:50:19.648 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:50:19.713 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:50:20.075 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-09T09:50:20.102 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-09T09:50:20.141 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T09:50:20.469 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librados2. 2024-05-09T09:50:20.496 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../007-librados2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:20.536 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librados2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:20.939 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librbd1. 2024-05-09T09:50:20.954 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../008-librbd1_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:20.989 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librbd1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:21.450 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libcephfs2. 2024-05-09T09:50:21.476 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:21.516 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libcephfs2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:21.928 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rados. 2024-05-09T09:50:21.954 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:22.027 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rados (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:22.347 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-09T09:50:22.374 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:22.405 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-ceph-argparse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:22.641 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cephfs. 2024-05-09T09:50:22.668 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:22.708 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cephfs (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:23.027 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-09T09:50:23.054 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:23.094 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:23.422 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-09T09:50:23.449 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-09T09:50:23.489 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T09:50:23.653 INFO:teuthology.orchestra.run.smithi032.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3093-g2d4f3997-1jammy [124 kB] 2024-05-09T09:50:23.655 INFO:teuthology.orchestra.run.smithi032.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3093-g2d4f3997-1jammy [38.9 kB] 2024-05-09T09:50:23.743 INFO:teuthology.orchestra.run.smithi032.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3093-g2d4f3997-1jammy [13.6 MB] 2024-05-09T09:50:23.800 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-prettytable. 2024-05-09T09:50:23.827 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-09T09:50:23.867 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-09T09:50:24.102 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rbd. 2024-05-09T09:50:24.118 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:24.161 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rbd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:24.523 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-09T09:50:24.549 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-09T09:50:24.589 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T09:50:24.875 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-09T09:50:24.890 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-09T09:50:24.925 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T09:50:25.169 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-09T09:50:25.185 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-09T09:50:25.219 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T09:50:25.556 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua5.1. 2024-05-09T09:50:25.583 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-09T09:50:25.623 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-09T09:50:25.926 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-any. 2024-05-09T09:50:25.952 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-09T09:50:25.992 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-09T09:50:26.212 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package zip. 2024-05-09T09:50:26.227 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-09T09:50:26.262 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking zip (3.0-12build2) ... 2024-05-09T09:50:26.582 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package unzip. 2024-05-09T09:50:26.608 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-09T09:50:26.648 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-09T09:50:27.086 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package luarocks. 2024-05-09T09:50:27.114 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-09T09:50:27.152 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-09T09:50:27.544 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librgw2. 2024-05-09T09:50:27.571 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../025-librgw2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:27.602 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librgw2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:28.155 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rgw. 2024-05-09T09:50:28.170 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:28.213 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:28.549 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-09T09:50:28.576 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-09T09:50:28.616 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T09:50:28.902 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libradosstriper1. 2024-05-09T09:50:28.928 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:28.969 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libradosstriper1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:29.372 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-common. 2024-05-09T09:50:29.399 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:29.439 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:30.844 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-base. 2024-05-09T09:50:30.871 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:30.920 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-base (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:32.274 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-09T09:50:32.300 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-09T09:50:32.340 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-09T09:50:32.610 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cheroot. 2024-05-09T09:50:32.638 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-09T09:50:32.668 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T09:50:32.988 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-09T09:50:33.014 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-09T09:50:33.054 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-09T09:50:33.341 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-09T09:50:33.367 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-09T09:50:33.407 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-09T09:50:33.710 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-09T09:50:33.736 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-09T09:50:33.776 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-09T09:50:33.882 INFO:teuthology.orchestra.run.smithi032.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3093-g2d4f3997-1jammy [91.6 kB] 2024-05-09T09:50:34.030 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-tempora. 2024-05-09T09:50:34.056 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-09T09:50:34.088 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-09T09:50:34.391 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-portend. 2024-05-09T09:50:34.417 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-09T09:50:34.457 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-09T09:50:34.490 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 199 MB in 1min 34s (2,130 kB/s) 2024-05-09T09:50:34.650 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-09T09:50:34.752 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-09T09:50:34.757 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-09T09:50:34.768 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-09T09:50:34.795 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-09T09:50:34.835 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-09T09:50:34.840 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T09:50:35.122 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-09T09:50:35.148 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-09T09:50:35.180 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-09T09:50:35.202 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-09T09:50:35.229 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-09T09:50:35.268 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T09:50:35.501 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-natsort. 2024-05-09T09:50:35.526 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-09T09:50:35.566 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-09T09:50:35.596 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-09T09:50:35.623 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-09T09:50:35.663 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T09:50:35.903 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-logutils. 2024-05-09T09:50:35.929 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-09T09:50:35.970 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-09T09:50:36.183 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-09T09:50:36.209 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:50:36.258 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:50:36.281 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-09T09:50:36.305 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-09T09:50:36.348 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-09T09:50:36.609 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-mako. 2024-05-09T09:50:36.624 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-09T09:50:36.652 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-09T09:50:36.675 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T09:50:36.679 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:50:36.719 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:50:36.945 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-09T09:50:36.961 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-09T09:50:36.995 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-09T09:50:37.055 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-09T09:50:37.082 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:50:37.122 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:50:37.290 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-09T09:50:37.316 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-09T09:50:37.356 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-09T09:50:37.425 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-09T09:50:37.452 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-09T09:50:37.491 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T09:50:37.659 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webob. 2024-05-09T09:50:37.686 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-09T09:50:37.725 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-09T09:50:37.819 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librados2. 2024-05-09T09:50:37.846 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../007-librados2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:37.886 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librados2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:38.045 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-waitress. 2024-05-09T09:50:38.072 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-09T09:50:38.107 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T09:50:38.357 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-tempita. 2024-05-09T09:50:38.372 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-09T09:50:38.415 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T09:50:38.472 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librbd1. 2024-05-09T09:50:38.499 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../008-librbd1_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:38.538 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librbd1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:38.718 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-paste. 2024-05-09T09:50:38.744 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-09T09:50:38.784 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T09:50:38.975 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs2. 2024-05-09T09:50:39.001 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:39.041 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:39.121 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-09T09:50:39.148 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-09T09:50:39.188 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T09:50:39.285 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rados. 2024-05-09T09:50:39.302 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:39.352 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rados (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:39.466 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-09T09:50:39.492 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-09T09:50:39.524 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-09T09:50:39.654 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-09T09:50:39.682 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:39.721 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-argparse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:39.802 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webtest. 2024-05-09T09:50:39.828 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-09T09:50:39.923 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cephfs. 2024-05-09T09:50:39.940 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:39.973 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cephfs (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:40.172 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pecan. 2024-05-09T09:50:40.199 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-09T09:50:40.263 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T09:50:40.267 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-09T09:50:40.295 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:40.334 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:40.627 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-certifi. 2024-05-09T09:50:40.654 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-09T09:50:40.664 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-09T09:50:40.691 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-09T09:50:40.693 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-09T09:50:40.730 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T09:50:41.038 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-idna. 2024-05-09T09:50:41.065 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-09T09:50:41.075 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-prettytable. 2024-05-09T09:50:41.102 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-09T09:50:41.105 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-09T09:50:41.141 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-09T09:50:41.391 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-urllib3. 2024-05-09T09:50:41.394 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rbd. 2024-05-09T09:50:41.418 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-09T09:50:41.421 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:41.449 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T09:50:41.460 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rbd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:41.727 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-requests. 2024-05-09T09:50:41.754 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-09T09:50:41.780 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-09T09:50:41.785 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T09:50:41.807 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-09T09:50:41.838 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T09:50:42.072 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-09T09:50:42.099 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-09T09:50:42.115 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-09T09:50:42.132 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-09T09:50:42.138 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T09:50:42.174 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T09:50:42.433 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-09T09:50:42.449 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:42.483 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:42.493 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-09T09:50:42.520 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-09T09:50:42.560 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T09:50:42.880 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-09T09:50:42.888 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua5.1. 2024-05-09T09:50:42.907 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:42.915 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-09T09:50:42.946 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:42.955 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-09T09:50:43.232 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-any. 2024-05-09T09:50:43.245 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-09T09:50:43.249 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-09T09:50:43.274 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-09T09:50:43.276 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-09T09:50:43.316 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-09T09:50:43.518 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package zip. 2024-05-09T09:50:43.545 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-09T09:50:43.577 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-openssl. 2024-05-09T09:50:43.592 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-09T09:50:43.627 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-09T09:50:43.692 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking zip (3.0-12build2) ... 2024-05-09T09:50:43.955 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr. 2024-05-09T09:50:43.982 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:44.022 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:44.038 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package unzip. 2024-05-09T09:50:44.065 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-09T09:50:44.130 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-09T09:50:44.442 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mon. 2024-05-09T09:50:44.468 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:44.483 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package luarocks. 2024-05-09T09:50:44.508 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mon (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:44.510 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-09T09:50:44.550 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-09T09:50:44.882 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librgw2. 2024-05-09T09:50:44.898 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../025-librgw2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:44.940 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librgw2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:45.062 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-osd. 2024-05-09T09:50:45.088 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:45.128 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-osd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:45.501 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rgw. 2024-05-09T09:50:45.528 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:45.568 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:45.895 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-09T09:50:45.922 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-09T09:50:45.962 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T09:50:46.182 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph. 2024-05-09T09:50:46.197 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../066-ceph_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:46.240 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libradosstriper1. 2024-05-09T09:50:46.240 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:46.255 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:46.289 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libradosstriper1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:46.543 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-fuse. 2024-05-09T09:50:46.569 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:46.609 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:46.668 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-common. 2024-05-09T09:50:46.695 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:46.734 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:46.954 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mds. 2024-05-09T09:50:46.981 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:47.021 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mds (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:47.432 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package cephadm. 2024-05-09T09:50:47.459 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../069-cephadm_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:47.499 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:47.818 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-09T09:50:47.845 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-09T09:50:47.885 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-09T09:50:48.213 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-09T09:50:48.223 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-base. 2024-05-09T09:50:48.239 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T09:50:48.250 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:50:48.279 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T09:50:48.299 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-base (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:49.359 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-babel. 2024-05-09T09:50:49.387 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T09:50:49.426 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T09:50:49.685 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-09T09:50:49.712 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-09T09:50:49.743 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-09T09:50:49.745 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jinja2. 2024-05-09T09:50:49.772 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-09T09:50:49.812 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T09:50:50.021 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cheroot. 2024-05-09T09:50:50.048 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-09T09:50:50.087 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T09:50:50.157 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-09T09:50:50.184 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:50.223 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:50.415 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-09T09:50:50.443 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-09T09:50:50.482 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-09T09:50:50.561 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-09T09:50:50.587 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-09T09:50:50.627 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-09T09:50:50.793 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-09T09:50:50.820 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-09T09:50:50.861 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-09T09:50:50.938 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-routes. 2024-05-09T09:50:50.966 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-09T09:50:51.013 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T09:50:51.120 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-09T09:50:51.133 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-09T09:50:51.162 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-09T09:50:51.350 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-09T09:50:51.376 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:51.416 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:51.473 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempora. 2024-05-09T09:50:51.500 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-09T09:50:51.540 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-09T09:50:51.843 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-portend. 2024-05-09T09:50:51.870 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-09T09:50:51.909 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-09T09:50:52.212 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-09T09:50:52.239 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-09T09:50:52.278 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-09T09:50:52.548 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-09T09:50:52.564 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-09T09:50:52.598 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-09T09:50:52.671 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-09T09:50:52.688 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-09T09:50:52.729 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T09:50:52.934 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-natsort. 2024-05-09T09:50:52.951 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-09T09:50:52.992 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-09T09:50:53.279 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-logutils. 2024-05-09T09:50:53.306 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-09T09:50:53.337 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-09T09:50:53.483 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-joblib. 2024-05-09T09:50:53.498 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-09T09:50:53.541 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T09:50:53.632 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-09T09:50:53.659 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-09T09:50:53.698 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-09T09:50:53.895 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-09T09:50:53.922 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-09T09:50:53.961 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-09T09:50:54.001 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-mako. 2024-05-09T09:50:54.028 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-09T09:50:54.067 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T09:50:54.274 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-sklearn. 2024-05-09T09:50:54.302 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-09T09:50:54.357 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T09:50:54.404 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-09T09:50:54.431 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-09T09:50:54.470 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-09T09:50:54.898 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-09T09:50:54.925 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-09T09:50:54.956 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-09T09:50:55.066 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-09T09:50:55.094 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:55.218 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:55.234 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webob. 2024-05-09T09:50:55.261 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-09T09:50:55.300 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-09T09:50:55.645 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-waitress. 2024-05-09T09:50:55.672 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-09T09:50:55.714 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T09:50:56.014 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempita. 2024-05-09T09:50:56.041 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-09T09:50:56.081 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T09:50:56.181 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cachetools. 2024-05-09T09:50:56.208 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-09T09:50:56.247 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-09T09:50:56.359 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-paste. 2024-05-09T09:50:56.386 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-09T09:50:56.425 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T09:50:56.550 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-09T09:50:56.577 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-09T09:50:56.617 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-09T09:50:56.745 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-09T09:50:56.772 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-09T09:50:56.811 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T09:50:56.953 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-09T09:50:56.981 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-09T09:50:57.020 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T09:50:57.081 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-09T09:50:57.108 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-09T09:50:57.147 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-09T09:50:57.298 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rsa. 2024-05-09T09:50:57.325 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-09T09:50:57.356 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-09T09:50:57.475 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webtest. 2024-05-09T09:50:57.502 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-09T09:50:57.542 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-09T09:50:57.685 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-google-auth. 2024-05-09T09:50:57.712 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-09T09:50:57.751 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-09T09:50:57.853 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pecan. 2024-05-09T09:50:57.880 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-09T09:50:57.919 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T09:50:58.072 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-09T09:50:58.098 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-09T09:50:58.138 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T09:50:58.283 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-certifi. 2024-05-09T09:50:58.310 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-09T09:50:58.349 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-09T09:50:58.450 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-websocket. 2024-05-09T09:50:58.476 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-09T09:50:58.516 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-09T09:50:58.677 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-idna. 2024-05-09T09:50:58.704 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-09T09:50:58.743 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-09T09:50:58.803 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-09T09:50:58.830 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-09T09:50:58.861 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T09:50:59.030 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-urllib3. 2024-05-09T09:50:59.056 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-09T09:50:59.087 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T09:50:59.365 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests. 2024-05-09T09:50:59.381 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-09T09:50:59.415 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T09:50:59.508 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-09T09:50:59.524 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:50:59.558 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:50:59.702 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-09T09:50:59.729 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-09T09:50:59.768 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T09:50:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-09T09:50:59.955 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-09T09:50:59.994 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T09:51:00.046 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-09T09:51:00.062 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:51:00.104 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:00.339 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-09T09:51:00.367 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T09:51:00.406 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T09:51:00.459 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-09T09:51:00.486 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:00.526 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:00.709 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package jq. 2024-05-09T09:51:00.737 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T09:51:00.784 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-09T09:51:00.861 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-09T09:51:00.888 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-09T09:51:00.928 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-09T09:51:01.086 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package socat. 2024-05-09T09:51:01.102 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-09T09:51:01.153 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-09T09:51:01.231 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-openssl. 2024-05-09T09:51:01.258 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-09T09:51:01.306 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-09T09:51:01.481 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package xmlstarlet. 2024-05-09T09:51:01.497 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-09T09:51:01.539 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-09T09:51:01.583 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr. 2024-05-09T09:51:01.599 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:01.633 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:01.936 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-test. 2024-05-09T09:51:01.963 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:02.020 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mon. 2024-05-09T09:51:02.027 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-test (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:02.047 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:02.086 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mon (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:02.673 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-osd. 2024-05-09T09:51:02.700 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:02.739 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-osd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:03.917 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph. 2024-05-09T09:51:03.944 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../066-ceph_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:03.984 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:04.270 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-fuse. 2024-05-09T09:51:04.297 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:04.336 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:04.407 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-volume. 2024-05-09T09:51:04.434 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:51:04.481 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-volume (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:04.689 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mds. 2024-05-09T09:51:04.717 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:04.756 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mds (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:04.802 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-09T09:51:04.829 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:04.877 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libcephfs-dev (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:05.263 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-09T09:51:05.275 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephadm. 2024-05-09T09:51:05.290 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-09T09:51:05.302 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../069-cephadm_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:05.338 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T09:51:05.342 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:05.628 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-09T09:51:05.644 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-09T09:51:05.677 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-09T09:51:05.693 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-09T09:51:05.720 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-09T09:51:05.759 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-09T09:51:05.980 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-09T09:51:06.007 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T09:51:06.046 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T09:51:06.163 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package nvme-cli. 2024-05-09T09:51:06.191 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-09T09:51:06.238 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T09:51:06.669 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package pkg-config. 2024-05-09T09:51:06.696 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-09T09:51:06.735 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T09:51:06.997 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-09T09:51:07.024 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-09T09:51:07.052 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-babel. 2024-05-09T09:51:07.063 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-09T09:51:07.079 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T09:51:07.118 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T09:51:07.446 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jinja2. 2024-05-09T09:51:07.474 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-09T09:51:07.500 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-09T09:51:07.512 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T09:51:07.527 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-09T09:51:07.566 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-09T09:51:07.841 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-09T09:51:07.868 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:51:07.869 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pastescript. 2024-05-09T09:51:07.896 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-09T09:51:07.898 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:07.935 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-09T09:51:08.218 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-09T09:51:08.246 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-09T09:51:08.276 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-09T09:51:08.472 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pluggy. 2024-05-09T09:51:08.500 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-09T09:51:08.546 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-routes. 2024-05-09T09:51:08.547 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-09T09:51:08.573 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-09T09:51:08.614 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T09:51:08.859 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-psutil. 2024-05-09T09:51:08.886 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-09T09:51:08.925 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-09T09:51:08.932 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-09T09:51:08.960 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:51:08.998 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:09.270 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-py. 2024-05-09T09:51:09.298 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-09T09:51:09.345 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-09T09:51:09.674 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pygments. 2024-05-09T09:51:09.701 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-09T09:51:09.740 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T09:51:10.153 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-09T09:51:10.169 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-09T09:51:10.228 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-09T09:51:10.256 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-09T09:51:10.294 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-09T09:51:10.324 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T09:51:10.589 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-toml. 2024-05-09T09:51:10.616 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-09T09:51:10.655 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-09T09:51:10.857 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-joblib. 2024-05-09T09:51:10.884 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-09T09:51:10.917 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pytest. 2024-05-09T09:51:10.923 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T09:51:10.933 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-09T09:51:10.967 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T09:51:11.270 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-simplejson. 2024-05-09T09:51:11.286 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-09T09:51:11.293 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-09T09:51:11.320 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-09T09:51:11.321 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-09T09:51:11.360 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-09T09:51:11.556 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-09T09:51:11.584 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-09T09:51:11.614 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-09T09:51:11.671 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn. 2024-05-09T09:51:11.698 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-09T09:51:11.737 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T09:51:12.360 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package radosgw. 2024-05-09T09:51:12.388 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../116-radosgw_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:12.435 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking radosgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:12.454 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-09T09:51:12.482 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:51:12.597 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:13.221 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package rbd-fuse. 2024-05-09T09:51:13.237 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:13.279 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking rbd-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:13.526 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cachetools. 2024-05-09T09:51:13.553 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-09T09:51:13.584 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-09T09:51:13.601 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-09T09:51:13.862 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-09T09:51:13.868 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T09:51:13.889 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-09T09:51:13.928 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-09T09:51:13.994 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T09:51:14.254 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-09T09:51:14.273 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-09T09:51:14.289 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-09T09:51:14.331 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T09:51:14.597 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-09T09:51:14.643 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rsa. 2024-05-09T09:51:14.670 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-09T09:51:14.709 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-09T09:51:15.021 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-google-auth. 2024-05-09T09:51:15.035 INFO:teuthology.orchestra.run.smithi080.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-09T09:51:15.048 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-09T09:51:15.087 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-09T09:51:15.113 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:15.407 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-09T09:51:15.435 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-09T09:51:15.474 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T09:51:15.671 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user cephadm....done 2024-05-09T09:51:15.718 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-websocket. 2024-05-09T09:51:15.734 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-09T09:51:15.776 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-09T09:51:15.827 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T09:51:16.088 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-09T09:51:16.095 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-09T09:51:16.115 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-09T09:51:16.154 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T09:51:16.355 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-09T09:51:16.473 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-09T09:51:16.707 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-09T09:51:16.776 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-09T09:51:16.805 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:51:16.843 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:16.942 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T09:51:17.068 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-09T09:51:17.129 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-09T09:51:17.157 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-09T09:51:17.187 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T09:51:17.369 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T09:51:17.531 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-09T09:51:17.559 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T09:51:17.598 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T09:51:17.730 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-09T09:51:17.859 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package jq. 2024-05-09T09:51:17.875 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T09:51:17.917 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-09T09:51:17.973 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-09T09:51:18.169 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package socat. 2024-05-09T09:51:18.186 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-09T09:51:18.228 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-09T09:51:18.241 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-09T09:51:18.476 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-09T09:51:18.531 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package xmlstarlet. 2024-05-09T09:51:18.547 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-09T09:51:18.589 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-09T09:51:18.727 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-09T09:51:18.954 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-test. 2024-05-09T09:51:18.982 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:19.003 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-09T09:51:19.020 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-test (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:19.254 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-ceph-argparse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:19.539 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T09:51:19.640 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T09:51:19.757 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T09:51:19.883 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-09T09:51:20.143 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-09T09:51:20.573 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-09T09:51:20.599 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-09T09:51:20.663 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T09:51:20.772 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-09T09:51:21.132 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T09:51:21.233 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-09T09:51:21.358 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-volume. 2024-05-09T09:51:21.386 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:51:21.424 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-volume (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:21.500 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T09:51:21.730 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-09T09:51:21.756 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:21.761 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-09T09:51:21.795 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs-dev (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:22.069 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up zip (3.0-12build2) ... 2024-05-09T09:51:22.114 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-09T09:51:22.142 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-09T09:51:22.180 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T09:51:22.195 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T09:51:22.493 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-09T09:51:22.521 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-09T09:51:22.551 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-09T09:51:22.864 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T09:51:22.914 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package nvme-cli. 2024-05-09T09:51:22.942 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-09T09:51:22.980 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T09:51:23.107 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T09:51:23.233 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-09T09:51:23.359 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T09:51:23.394 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pkg-config. 2024-05-09T09:51:23.422 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-09T09:51:23.460 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T09:51:23.660 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-09T09:51:23.722 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-09T09:51:23.749 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-09T09:51:23.788 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-09T09:51:24.186 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-09T09:51:24.208 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-09T09:51:24.235 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-09T09:51:24.266 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-09T09:51:24.437 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T09:51:24.560 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastescript. 2024-05-09T09:51:24.588 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-09T09:51:24.627 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-09T09:51:24.789 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T09:51:24.947 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pluggy. 2024-05-09T09:51:24.975 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-09T09:51:25.013 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-09T09:51:25.066 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T09:51:25.324 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-psutil. 2024-05-09T09:51:25.353 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-09T09:51:25.391 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-09T09:51:25.400 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-09T09:51:25.651 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-09T09:51:25.744 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-py. 2024-05-09T09:51:25.772 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-09T09:51:25.777 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:25.810 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-09T09:51:26.079 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-idna (3.3-1) ... 2024-05-09T09:51:26.139 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pygments. 2024-05-09T09:51:26.167 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-09T09:51:26.205 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T09:51:26.405 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T09:51:26.651 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-09T09:51:26.680 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-09T09:51:26.726 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-09T09:51:27.037 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-toml. 2024-05-09T09:51:27.065 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-09T09:51:27.103 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-09T09:51:27.431 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pytest. 2024-05-09T09:51:27.459 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-09T09:51:27.497 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T09:51:27.577 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T09:51:27.820 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:51:27.843 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplejson. 2024-05-09T09:51:27.871 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-09T09:51:27.909 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-09T09:51:27.955 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-09T09:51:28.179 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-09T09:51:28.195 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-09T09:51:28.206 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T09:51:28.237 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-09T09:51:28.307 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-09T09:51:28.433 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T09:51:28.735 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-09T09:51:28.899 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package radosgw. 2024-05-09T09:51:28.928 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../116-radosgw_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:28.965 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking radosgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:28.994 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-09T09:51:29.237 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:51:29.338 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-09T09:51:29.606 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-09T09:51:29.777 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package rbd-fuse. 2024-05-09T09:51:29.805 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:51:29.843 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking rbd-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:29.849 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-09T09:51:30.108 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-09T09:51:30.140 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-09T09:51:30.359 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-09T09:51:30.440 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T09:51:30.566 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T09:51:30.619 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-09T09:51:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-09T09:51:30.886 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T09:51:31.012 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-09T09:51:31.224 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-09T09:51:31.306 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T09:51:31.431 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T09:51:31.648 INFO:teuthology.orchestra.run.smithi032.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-09T09:51:31.733 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-09T09:51:31.944 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:32.034 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-09T09:51:32.276 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T09:51:32.377 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-09T09:51:32.460 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user cephadm....done 2024-05-09T09:51:32.495 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T09:51:32.584 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-09T09:51:32.624 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T09:51:32.814 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T09:51:32.892 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-09T09:51:32.940 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T09:51:33.152 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-09T09:51:33.278 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-09T09:51:33.325 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-09T09:51:33.529 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-09T09:51:33.584 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-09T09:51:33.693 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-09T09:51:33.788 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T09:51:33.898 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-09T09:51:33.936 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:51:34.062 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T09:51:34.274 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T09:51:34.380 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T09:51:34.635 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-09T09:51:34.682 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T09:51:34.903 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-09T09:51:34.957 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-09T09:51:35.083 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-09T09:51:35.187 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-09T09:51:35.376 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-09T09:51:35.439 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-09T09:51:35.644 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T09:51:35.715 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-09T09:51:35.989 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-09T09:51:35.999 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-09T09:51:36.242 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-argparse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:36.357 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-09T09:51:36.510 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T09:51:36.642 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T09:51:36.652 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T09:51:36.778 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T09:51:36.904 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-09T09:51:36.970 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T09:51:37.080 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librados2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:37.155 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-09T09:51:37.181 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:37.299 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-09T09:51:37.550 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-09T09:51:37.604 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-09T09:51:37.635 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libcephfs2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:37.667 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T09:51:37.761 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libradosstriper1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:37.793 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-09T09:51:37.887 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-09T09:51:38.155 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librbd1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:38.161 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T09:51:38.282 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-modules-core (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:38.287 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-09T09:51:38.408 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:38.563 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T09:51:38.619 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T09:51:38.619 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T09:51:38.814 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-09T09:51:39.109 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libcephfs-dev (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:39.123 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up zip (3.0-12build2) ... 2024-05-09T09:51:39.235 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rados (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:39.249 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T09:51:39.394 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librgw2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:39.520 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T09:51:39.960 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T09:51:40.228 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T09:51:40.353 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-09T09:51:40.483 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T09:51:40.724 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rbd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:40.789 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-09T09:51:40.850 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up rbd-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:40.951 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:41.052 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cephfs (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:41.173 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-09T09:51:41.203 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:41.432 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T09:51:41.757 INFO:teuthology.orchestra.run.smithi080.stdout:Adding group ceph....done 2024-05-09T09:51:41.834 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T09:51:42.127 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T09:51:42.134 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user ceph....done 2024-05-09T09:51:42.260 INFO:teuthology.orchestra.run.smithi080.stdout:Setting system user ceph properties....done 2024-05-09T09:51:42.274 INFO:teuthology.orchestra.run.smithi080.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-09T09:51:42.409 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-09T09:51:42.479 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-09T09:51:42.738 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-09T09:51:42.738 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-09T09:51:42.839 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-idna (3.3-1) ... 2024-05-09T09:51:43.240 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-test (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:43.366 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up radosgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:43.466 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T09:51:43.853 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T09:51:43.854 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T09:51:44.327 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-base (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:44.680 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T09:51:44.702 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-09T09:51:44.923 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:51:45.058 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-09T09:51:45.178 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mds (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:45.325 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T09:51:45.419 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T09:51:45.419 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T09:51:45.451 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-09T09:51:45.577 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T09:51:45.879 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-09T09:51:45.914 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:46.130 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-09T09:51:46.130 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T09:51:46.130 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T09:51:46.373 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:51:46.499 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-09T09:51:46.632 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-osd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:46.825 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-09T09:51:46.903 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T09:51:46.903 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T09:51:47.084 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-09T09:51:47.361 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-09T09:51:47.409 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:47.519 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:47.620 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-09T09:51:47.653 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mon (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:47.858 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T09:51:47.858 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T09:51:47.879 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-09T09:51:48.139 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T09:51:48.265 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-09T09:51:48.408 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:48.549 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T09:51:48.619 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:48.675 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T09:51:48.840 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-dashboard (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:48.976 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-09T09:51:49.116 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-volume (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:49.303 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-09T09:51:49.529 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-09T09:51:49.570 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T09:51:49.664 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-09T09:51:49.697 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-09T09:51:49.805 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T09:51:49.808 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-09T09:51:49.887 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-09T09:51:50.124 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T09:51:50.250 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T09:51:50.626 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-09T09:51:50.634 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-09T09:51:50.919 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-09T09:51:51.045 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-09T09:51:51.295 INFO:teuthology.orchestra.run.smithi080.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-09T09:51:51.301 DEBUG:teuthology.parallel:result is None 2024-05-09T09:51:51.505 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:51:51.614 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T09:51:51.952 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T09:51:52.249 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T09:51:52.517 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-09T09:51:52.626 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-09T09:51:52.903 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-09T09:51:53.179 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T09:51:53.515 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-09T09:51:53.892 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-09T09:51:54.177 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T09:51:54.513 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T09:51:54.639 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librados2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:54.773 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:54.899 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-09T09:51:55.210 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:55.336 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libradosstriper1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:55.463 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-09T09:51:55.748 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librbd1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:55.848 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-modules-core (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:55.966 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:56.184 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T09:51:56.184 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T09:51:56.626 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs-dev (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:56.760 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rados (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:56.886 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librgw2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:57.012 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T09:51:58.324 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rbd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:58.450 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up rbd-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:58.576 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:58.711 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cephfs (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:58.837 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:51:59.321 INFO:teuthology.orchestra.run.smithi032.stdout:Adding group ceph....done 2024-05-09T09:51:59.698 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user ceph....done 2024-05-09T09:51:59.858 INFO:teuthology.orchestra.run.smithi032.stdout:Setting system user ceph properties....done 2024-05-09T09:51:59.876 INFO:teuthology.orchestra.run.smithi032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-09T09:52:00.019 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-09T09:52:00.338 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-09T09:52:00.829 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-test (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:00.955 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up radosgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:01.447 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T09:52:01.447 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T09:52:01.899 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-base (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:02.239 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-09T09:52:02.684 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mds (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T09:52:02.904 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T09:52:03.361 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:03.587 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T09:52:03.588 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T09:52:04.087 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-osd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:04.381 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T09:52:04.381 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T09:52:04.863 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:04.989 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:05.132 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mon (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:05.358 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T09:52:05.358 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T09:52:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:06.018 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:06.144 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-dashboard (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:06.295 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-volume (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:52:06.673 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-09T09:52:06.773 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-09T09:52:06.934 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-09T09:52:08.077 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-09T09:52:08.729 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-09T09:52:08.733 DEBUG:teuthology.parallel:result is None 2024-05-09T09:52:08.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:52:08.950 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-query -W -f '${Version}' ceph 2024-05-09T09:52:08.970 INFO:teuthology.orchestra.run.smithi032.stdout:19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:52:08.971 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:52:08.971 INFO:teuthology.task.install:The correct ceph version 19.0.0-3093-g2d4f3997-1jammy is installed. 2024-05-09T09:52:08.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:52:09.114 DEBUG:teuthology.orchestra.run.smithi080:> dpkg-query -W -f '${Version}' ceph 2024-05-09T09:52:09.133 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:52:09.134 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:52:09.134 INFO:teuthology.task.install:The correct ceph version 19.0.0-3093-g2d4f3997-1jammy is installed. 2024-05-09T09:52:09.135 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T09:52:09.136 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:09.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T09:52:09.150 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:09.150 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T09:52:09.190 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T09:52:09.190 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:09.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T09:52:09.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T09:52:09.265 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:09.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T09:52:09.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T09:52:09.334 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T09:52:09.334 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:09.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T09:52:09.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T09:52:09.406 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:09.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T09:52:09.419 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T09:52:09.472 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T09:52:09.473 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:09.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T09:52:09.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T09:52:09.540 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:09.541 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T09:52:09.553 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T09:52:09.608 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T09:52:09.701 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T09:52:09.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-05-09T09:52:09.704 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-05-09T09:52:09.717 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T09:52:09.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T09:52:09.758 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T09:52:09.772 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T09:52:09.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T09:52:09.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T09:52:09.838 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T09:52:09.838 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T09:52:09.838 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640', 'branch': 'wip-kkeithley-zipper-ec', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}', 'email': None, 'first_in_suite': False, 'job_id': '7699640', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-kkeithley-zipper-ec'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-kkeithley-zipper-ec', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}}, 'owner': 'scheduled_kkeithle@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 3428, 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc', 'sleep_before_teardown': 0, 'subset': '1/2', 'suite': 'rgw', 'suite_branch': 'wip-kkeithley-zipper-ec', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_2d4f3997312aba36846da54fe4ed144c644dd8fc/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc', 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFmuJYDqafWk8KQflldBOHFg3FTPSTlMYiNFWQGH39rw1KetGfP6XpdBKdK4uxIvgZjZhgSz7DDTLJgF9hoBIDw=', 'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKlZLZyn+tWxJeoEj3I4v9aPxXtZ7ZA1QY/mjkFI0TxwcoI5j71V4pJCnCDyVTJyhtJxZhZVko3A4gRh1+A6Ilo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_multipart_upload.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-09_09:15:11', 'tube': 'smithi', 'user': 'kkeithle', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T09:52:09.838 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T09:52:09.870 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T09:52:09.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T09:52:09.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T09:52:09.931 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:09.931 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T09:52:09.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T09:52:09.978 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-05-09T09:52:10.025 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T09:52:10.026 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:52:10.026 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-05-09T09:52:10.026 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:52:10.026 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-05-09 09:45:32.366189296 +0000 2024-05-09T09:52:10.026 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-09 09:45:32.362189332 +0000 2024-05-09T09:52:10.026 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-09 09:45:32.362189332 +0000 2024-05-09T09:52:10.026 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-05-09T09:52:10.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T09:52:10.080 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-05-09T09:52:10.080 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-05-09T09:52:10.080 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000314371 s, 1.6 MB/s 2024-05-09T09:52:10.081 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T09:52:10.131 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-05-09T09:52:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T09:52:10.177 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:52:10.177 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-05-09T09:52:10.178 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:52:10.178 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-05-09 09:45:33.254181375 +0000 2024-05-09T09:52:10.178 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-09 09:45:32.982183801 +0000 2024-05-09T09:52:10.178 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-09 09:45:32.982183801 +0000 2024-05-09T09:52:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-05-09T09:52:10.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T09:52:10.232 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-05-09T09:52:10.232 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-05-09T09:52:10.232 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000247832 s, 2.1 MB/s 2024-05-09T09:52:10.233 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T09:52:10.283 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-05-09T09:52:10.329 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T09:52:10.329 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:52:10.329 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-05-09T09:52:10.330 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:52:10.330 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-05-09 09:45:33.750176950 +0000 2024-05-09T09:52:10.330 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-09 09:45:33.466179483 +0000 2024-05-09T09:52:10.330 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-09 09:45:33.466179483 +0000 2024-05-09T09:52:10.330 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-05-09T09:52:10.330 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T09:52:10.383 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-05-09T09:52:10.384 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-05-09T09:52:10.384 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000294752 s, 1.7 MB/s 2024-05-09T09:52:10.385 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T09:52:10.435 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-05-09T09:52:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T09:52:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:52:10.481 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-05-09T09:52:10.482 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:52:10.482 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-05-09 09:45:34.262172383 +0000 2024-05-09T09:52:10.482 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-05-09 09:45:33.990174809 +0000 2024-05-09T09:52:10.482 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-05-09 09:45:33.990174809 +0000 2024-05-09T09:52:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-05-09T09:52:10.482 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T09:52:10.536 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-05-09T09:52:10.536 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-05-09T09:52:10.536 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000301618 s, 1.7 MB/s 2024-05-09T09:52:10.538 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T09:52:10.587 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:10.588 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:10.588 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T09:52:10.594 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T09:52:10.595 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-05-09T09:52:10.642 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T09:52:10.642 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:52:10.642 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-05-09T09:52:10.642 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:52:10.642 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-09 09:45:29.390030721 +0000 2024-05-09T09:52:10.642 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-09 09:45:29.134033008 +0000 2024-05-09T09:52:10.642 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-09 09:45:29.134033008 +0000 2024-05-09T09:52:10.642 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-09T09:52:10.643 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T09:52:10.696 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-09T09:52:10.696 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-09T09:52:10.696 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000389062 s, 1.3 MB/s 2024-05-09T09:52:10.697 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T09:52:10.746 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-05-09T09:52:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T09:52:10.793 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:52:10.793 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-05-09T09:52:10.793 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:52:10.794 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-09 09:45:29.878026362 +0000 2024-05-09T09:52:10.794 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-09 09:45:29.618028685 +0000 2024-05-09T09:52:10.794 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-09 09:45:29.618028685 +0000 2024-05-09T09:52:10.794 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-09T09:52:10.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T09:52:10.848 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-09T09:52:10.848 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-09T09:52:10.848 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00045177 s, 1.1 MB/s 2024-05-09T09:52:10.849 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T09:52:10.898 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-05-09T09:52:10.945 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T09:52:10.945 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:52:10.945 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-05-09T09:52:10.945 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:52:10.945 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-09 09:45:30.354022110 +0000 2024-05-09T09:52:10.945 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-09 09:45:30.110024289 +0000 2024-05-09T09:52:10.945 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-09 09:45:30.110024289 +0000 2024-05-09T09:52:10.945 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-09T09:52:10.946 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T09:52:11.000 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-09T09:52:11.000 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-09T09:52:11.000 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00042283 s, 1.2 MB/s 2024-05-09T09:52:11.001 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T09:52:11.050 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-05-09T09:52:11.097 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T09:52:11.097 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:52:11.097 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-05-09T09:52:11.097 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:52:11.097 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-09 09:45:30.870017500 +0000 2024-05-09T09:52:11.097 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-09 09:45:30.602019895 +0000 2024-05-09T09:52:11.097 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-09 09:45:30.602019895 +0000 2024-05-09T09:52:11.097 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-05-09T09:52:11.097 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T09:52:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-09T09:52:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-09T09:52:11.152 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000405797 s, 1.3 MB/s 2024-05-09T09:52:11.153 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T09:52:11.206 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:11.206 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T09:52:11.207 INFO:tasks.ceph:Generating config... 2024-05-09T09:52:11.208 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-05-09T09:52:11.208 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T09:52:11.208 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T09:52:11.208 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T09:52:11.208 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T09:52:11.208 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T09:52:11.208 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-09T09:52:11.208 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-09T09:52:11.208 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-09T09:52:11.208 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T09:52:11.208 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T09:52:11.208 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T09:52:11.209 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-09T09:52:11.209 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T09:52:11.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T09:52:11.244 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T09:52:11.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T09:52:11.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T09:52:11.393 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.c', '[v2:172.21.15.32:3301,v1:172.21.15.32:6790]'), ('mon.b', '172.21.15.80')] 2024-05-09T09:52:11.394 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790],172.21.15.80'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-05-09T09:52:11.395 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:11.395 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T09:52:11.441 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --addv c '[v2:172.21.15.32:3301,v1:172.21.15.32:6790]' --add b 172.21.15.80 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:11.528 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:11.528 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid ab394f08-fac0-4b9b-8c5e-bce336e83e29 2024-05-09T09:52:11.528 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = quincy 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:fsid ab394f08-fac0-4b9b-8c5e-bce336e83e29 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2024-05-09T09:52:11.531779+0000 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-09T09:52:11.531779+0000 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 17 (quincy) 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.b 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] mon.c 2024-05-09T09:52:11.529 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-09T09:52:11.530 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T09:52:11.577 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ab394f08-fac0-4b9b-8c5e-bce336e83e29... 2024-05-09T09:52:11.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T09:52:11.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T09:52:11.651 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-05-09T09:52:11.651 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-05-09T09:52:11.651 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T09:52:11.651 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.652 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-05-09T09:52:11.653 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790],172.21.15.80" 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = ab394f08-fac0-4b9b-8c5e-bce336e83e29 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.654 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug trim objects = true 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-05-09T09:52:11.655 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: bdev async discard = True 2024-05-09T09:52:11.656 INFO:teuthology.orchestra.run.smithi032.stdout: bdev enable discard = True 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore allocator = bitmap 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 1/20 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 1/20 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 4/10 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: osd blocked scrub grace period = 3600 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: osd max markdown count = 1000 2024-05-09T09:52:11.657 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: osd shutdown pgref assert = True 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-05-09T09:52:11.658 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T09:52:11.659 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout: rgw relaxed s3 bucket names = True 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-05-09T09:52:11.660 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-05-09T09:52:11.662 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.663 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-05-09T09:52:11.664 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = "172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790],172.21.15.80" 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = ab394f08-fac0-4b9b-8c5e-bce336e83e29 2024-05-09T09:52:11.665 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-05-09T09:52:11.666 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.667 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: bdev async discard = True 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: bdev enable discard = True 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore allocator = bitmap 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore block size = 96636764160 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: bluestore fsck on mount = True 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluefs = 1/20 2024-05-09T09:52:11.668 INFO:teuthology.orchestra.run.smithi080.stdout: debug bluestore = 1/20 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: debug rocksdb = 4/10 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd full ratio = 0.9 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd nearfull ratio = 0.8 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: osd blocked scrub grace period = 3600 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: osd failsafe full ratio = 0.95 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: osd max markdown count = 1000 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: osd objectstore = bluestore 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: osd shutdown pgref assert = True 2024-05-09T09:52:11.669 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.670 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-05-09T09:52:11.670 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-09T09:52:11.670 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-05-09T09:52:11.670 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-09T09:52:11.670 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-09T09:52:11.670 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-09T09:52:11.671 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-05-09T09:52:11.672 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-05-09T09:52:11.673 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-05-09T09:52:11.673 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T09:52:11.673 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T09:52:11.673 INFO:teuthology.orchestra.run.smithi080.stdout: rgw relaxed s3 bucket names = True 2024-05-09T09:52:11.673 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-05-09T09:52:11.673 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.c] 2024-05-09T09:52:11.673 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.b] 2024-05-09T09:52:11.673 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T09:52:11.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T09:52:11.755 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T09:52:11.755 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:11.755 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T09:52:11.761 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:11.761 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T09:52:11.809 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:52:11.809 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:11.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T09:52:11.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T09:52:11.874 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:11.874 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:11.921 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:52:11.921 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:11.921 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T09:52:11.921 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T09:52:11.945 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:11.945 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:11.993 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T09:52:11.993 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T09:52:11.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T09:52:12.036 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T09:52:12.040 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T09:52:12.081 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T09:52:12.131 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T09:52:12.131 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T09:52:12.131 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T09:52:12.167 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T09:52:12.178 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-09T09:52:12.213 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-09T09:52:12.223 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T09:52:12.223 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T09:52:12.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T09:52:12.236 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:12.236 INFO:tasks.ceph:role: osd.0 2024-05-09T09:52:12.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:52:12.236 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T09:52:12.293 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:52:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:52:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:52:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:52:12.294 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:52:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:52:12.294 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:52:12.294 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:52:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:52:12.294 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:52:12.317 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-05-09T09:52:12.319 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-05-09T09:52:12.319 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T09:52:12.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T09:52:12.427 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:52:12.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:12.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T09:52:12.480 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:12.480 INFO:tasks.ceph:role: osd.1 2024-05-09T09:52:12.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:52:12.480 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T09:52:12.533 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:52:12.533 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:52:12.533 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:52:12.533 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:52:12.533 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:52:12.534 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:52:12.534 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:52:12.534 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:52:12.534 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:52:12.534 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:52:12.557 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-05-09T09:52:12.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-05-09T09:52:12.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-09T09:52:12.616 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T09:52:12.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:12.670 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:52:12.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T09:52:12.723 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:12.723 INFO:tasks.ceph:role: osd.2 2024-05-09T09:52:12.723 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:52:12.723 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T09:52:12.777 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:52:12.777 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:52:12.778 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:52:12.778 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:52:12.778 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:52:12.778 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:52:12.778 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:52:12.778 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:52:12.778 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:52:12.778 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:52:12.801 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-05-09T09:52:12.803 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-05-09T09:52:12.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-09T09:52:12.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T09:52:12.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:12.918 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:52:12.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T09:52:12.971 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:12.972 INFO:tasks.ceph:role: osd.3 2024-05-09T09:52:12.972 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:52:12.972 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T09:52:13.026 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:52:13.026 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:52:13.026 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:52:13.026 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:52:13.026 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:52:13.026 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:52:13.027 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:52:13.027 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:52:13.027 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:52:13.027 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:52:13.051 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-05-09T09:52:13.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-05-09T09:52:13.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-09T09:52:13.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T09:52:13.165 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:52:13.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:13.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:13.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:13.271+0000 7f5eb9fdd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T09:52:13.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:13.271+0000 7f5eb9fdd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T09:52:13.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:13.271+0000 7f5eb9fdd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T09:52:13.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:13.271+0000 7f5eb9fdd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T09:52:13.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:13.271+0000 7f5eb9fdd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T09:52:13.272 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:13.271+0000 7f5eb9fdd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T09:52:16.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T09:52:16.247 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:16.328 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:16.327+0000 7efef44707c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T09:52:16.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:16.327+0000 7efef44707c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T09:52:16.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:16.327+0000 7efef44707c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T09:52:16.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:16.327+0000 7efef44707c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T09:52:16.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:16.327+0000 7efef44707c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T09:52:16.329 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:16.331+0000 7efef44707c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T09:52:19.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T09:52:19.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:19.458 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:19.459+0000 7f87d5a097c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T09:52:19.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:19.459+0000 7f87d5a097c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T09:52:19.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:19.459+0000 7f87d5a097c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T09:52:19.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:19.459+0000 7f87d5a097c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T09:52:19.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:19.459+0000 7f87d5a097c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T09:52:19.459 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:19.459+0000 7f87d5a097c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T09:52:22.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T09:52:22.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:22.567+0000 7f64361a37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T09:52:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:22.567+0000 7f64361a37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T09:52:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:22.567+0000 7f64361a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T09:52:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:22.567+0000 7f64361a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T09:52:22.566 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:22.567+0000 7f64361a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T09:52:22.567 INFO:teuthology.orchestra.run.smithi032.stderr:2024-05-09T09:52:22.567+0000 7f64361a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T09:52:25.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T09:52:25.598 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-09T09:52:25.613 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:25.613 INFO:tasks.ceph:role: osd.4 2024-05-09T09:52:25.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:52:25.613 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T09:52:25.677 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:52:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:52:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:52:25.677 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:52:25.678 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:52:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:52:25.678 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:52:25.678 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:52:25.678 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:52:25.678 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:52:26.135 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-09T09:52:26.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-09T09:52:26.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-09T09:52:26.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-09T09:52:26.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:26.240 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:52:26.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-09T09:52:26.291 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:26.291 INFO:tasks.ceph:role: osd.5 2024-05-09T09:52:26.291 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:52:26.291 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T09:52:26.354 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:52:26.354 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:52:26.354 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:52:26.354 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:52:26.354 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:52:26.354 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:52:26.354 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:52:26.354 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:52:26.355 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:52:26.355 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:52:26.823 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-09T09:52:26.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-09T09:52:26.825 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-09T09:52:26.977 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-09T09:52:26.988 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:52:26.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:26.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-09T09:52:27.045 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:27.045 INFO:tasks.ceph:role: osd.6 2024-05-09T09:52:27.046 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:52:27.046 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:52:27.114 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:52:27.597 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-09T09:52:27.599 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-09T09:52:27.599 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-09T09:52:27.732 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-09T09:52:27.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:27.742 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:52:27.742 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-09T09:52:27.798 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T09:52:27.798 INFO:tasks.ceph:role: osd.7 2024-05-09T09:52:27.798 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:52:27.798 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T09:52:27.861 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:52:27.861 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:52:27.861 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:52:27.861 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:52:27.861 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:52:27.861 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:52:27.862 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:52:27.862 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:52:27.862 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:52:27.862 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:52:28.282 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-09T09:52:28.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-09T09:52:28.284 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-09T09:52:28.375 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-09T09:52:28.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:28.385 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:52:28.385 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:28.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:28.582+0000 7fbe47e747c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-09T09:52:28.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:28.586+0000 7fbe47e747c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-09T09:52:28.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:28.586+0000 7fbe47e747c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T09:52:28.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:28.586+0000 7fbe47e747c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T09:52:28.586 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:28.586+0000 7fbe47e747c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T09:52:28.587 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:28.586+0000 7fbe47e747c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-09T09:52:31.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T09:52:31.591 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:31.671 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:31.670+0000 7f6fe3e007c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-09T09:52:31.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:31.670+0000 7f6fe3e007c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-09T09:52:31.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:31.670+0000 7f6fe3e007c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T09:52:31.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:31.670+0000 7f6fe3e007c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T09:52:31.672 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:31.670+0000 7f6fe3e007c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T09:52:31.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:31.670+0000 7f6fe3e007c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-09T09:52:34.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T09:52:34.708 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:34.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:34.785+0000 7f87c82ee7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-09T09:52:34.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:34.789+0000 7f87c82ee7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-09T09:52:34.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:34.789+0000 7f87c82ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T09:52:34.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:34.789+0000 7f87c82ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T09:52:34.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:34.789+0000 7f87c82ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T09:52:34.790 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:34.789+0000 7f87c82ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-09T09:52:37.757 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-09T09:52:37.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:37.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:37.897+0000 7f291830a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-09T09:52:37.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:37.897+0000 7f291830a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-09T09:52:37.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:37.897+0000 7f291830a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T09:52:37.900 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:37.897+0000 7f291830a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T09:52:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:37.897+0000 7f291830a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T09:52:37.901 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-09T09:52:37.897+0000 7f291830a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-09T09:52:40.878 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-09T09:52:40.935 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T09:52:40.935 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:40.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-09T09:52:40.950 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:40.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T09:52:41.005 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:41.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T09:52:41.061 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:41.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T09:52:41.114 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:41.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T09:52:41.169 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:41.169 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T09:52:41.183 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:41.183 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-09T09:52:41.237 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:41.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-09T09:52:41.290 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:41.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-09T09:52:41.345 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:41.345 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-09T09:52:41.401 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:41.401 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T09:52:41.407 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:41.408 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-09T09:52:41.451 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T09:52:41.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T09:52:41.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T09:52:41.496 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2024-05-09T09:52:41.496 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDMnDxm+SZkAhAAGTBQ1mzRTfqfVcYcSVxhPQ== 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDNnDxmPGVfEBAAodiqz+98Rh5qg6hqFIUqqA== 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDQnDxmizHDExAA5lUtxpefQh5MQniX1iI2iw== 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDTnDxmi/Z/GxAAsVh1ICCGN4ybj+KBM4vxRA== 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDWnDxm2hfnIRAA6Zihb9OgowIchJNHfnT9tQ== 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDMnDxmeTkRBRAApsHhYvSzW/SNCo9t8DAwew== 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDcnDxmuQIFIxAAay7jr8jnTNX2K/fpKuIG2A== 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDfnDxm9to3KBAAWCgzBdOENB7li72LvTjQUA== 2024-05-09T09:52:41.497 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2024-05-09T09:52:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDinDxmU9c6LxAA7tPTw/Dx/I8+Ay6PuLlPNg== 2024-05-09T09:52:41.498 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2024-05-09T09:52:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDlnDxmNbzRNRAAEKUgoKWWFxHBri5swTjL7g== 2024-05-09T09:52:41.498 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-05-09T09:52:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDMnDxm2i0mChAAOKBJcwFOh+zK7dfX5REptA== 2024-05-09T09:52:41.498 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2024-05-09T09:52:41.498 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQDMnDxmLI/rDBAACIvCrJcDQHMRIMyI/61U6A== 2024-05-09T09:52:41.504 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.y] 2024-05-09T09:52:41.504 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDMnDxm+SZkAhAAGTBQ1mzRTfqfVcYcSVxhPQ== 2024-05-09T09:52:41.504 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-05-09T09:52:41.504 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDNnDxmPGVfEBAAodiqz+98Rh5qg6hqFIUqqA== 2024-05-09T09:52:41.504 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-05-09T09:52:41.504 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDQnDxmizHDExAA5lUtxpefQh5MQniX1iI2iw== 2024-05-09T09:52:41.504 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-05-09T09:52:41.504 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDTnDxmi/Z/GxAAsVh1ICCGN4ybj+KBM4vxRA== 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDWnDxm2hfnIRAA6Zihb9OgowIchJNHfnT9tQ== 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr.x] 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDMnDxmeTkRBRAApsHhYvSzW/SNCo9t8DAwew== 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.4] 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDcnDxmuQIFIxAAay7jr8jnTNX2K/fpKuIG2A== 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.5] 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDfnDxm9to3KBAAWCgzBdOENB7li72LvTjQUA== 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.6] 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDinDxmU9c6LxAA7tPTw/Dx/I8+Ay6PuLlPNg== 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.7] 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDlnDxmNbzRNRAAEKUgoKWWFxHBri5swTjL7g== 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDMnDxm2i0mChAAOKBJcwFOh+zK7dfX5REptA== 2024-05-09T09:52:41.505 INFO:teuthology.orchestra.run.smithi080.stdout:[client.1] 2024-05-09T09:52:41.506 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDMnDxmLI/rDBAACIvCrJcDQHMRIMyI/61U6A== 2024-05-09T09:52:41.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T09:52:41.543 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T09:52:41.593 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:41.635 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:41.680 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:41.682 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:41.761 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:41.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:41.850 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:41.852 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:41.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T09:52:41.935 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T09:52:42.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:42.022 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:42.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:42.103 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:42.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:42.187 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:42.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:42.271 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:52:42.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T09:52:42.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T09:52:42.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T09:52:42.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T09:52:42.528 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T09:52:42.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T09:52:42.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T09:52:42.641 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T09:52:42.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-09T09:52:42.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T09:52:42.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-09T09:52:42.803 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-09T09:52:42.817 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T09:52:42.916 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-09T09:52:42.927 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:42.929 DEBUG:teuthology.orchestra.run.smithi080:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:52:42.978 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T09:52:42.978 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T09:52:42.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T09:52:42.981 INFO:tasks.ceph.mon.a:Started 2024-05-09T09:52:42.981 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-09T09:52:42.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-09T09:52:42.984 INFO:tasks.ceph.mon.c:Started 2024-05-09T09:52:42.984 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-09T09:52:42.984 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-09T09:52:43.023 INFO:tasks.ceph.mon.b:Started 2024-05-09T09:52:43.024 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T09:52:43.024 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-09T09:52:43.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-09T09:52:43.026 INFO:tasks.ceph.mgr.y:Started 2024-05-09T09:52:43.026 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T09:52:43.026 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T09:52:43.028 INFO:tasks.ceph.mgr.x:Started 2024-05-09T09:52:43.029 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T09:52:43.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T09:52:48.550 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2024-05-09T09:52:48.575 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T09:52:48.575 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T09:52:48.576 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:48.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T09:52:48.587 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:48.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T09:52:48.643 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:48.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T09:52:48.676 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:48.674+0000 7f0bdfdb9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T09:52:48.686 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:52:48.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T09:52:48.744 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:48.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-09T09:52:48.759 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:48.759 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-09T09:52:48.814 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:48.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-09T09:52:48.869 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-09T09:52:48.870 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-09T09:52:48.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new b6d1a399-da26-41fd-8eed-493a7286aa6c 0 2024-05-09T09:52:49.208 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:49.206+0000 7f0bdfdb9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T09:52:49.301 INFO:teuthology.orchestra.run.smithi080.stdout:0 2024-05-09T09:52:49.320 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e 1 2024-05-09T09:52:49.402 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:49.397+0000 7f70f3e1c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T09:52:49.419 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:49.418+0000 7f0bdfdb9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T09:52:49.527 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-05-09T09:52:49.545 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 097e00bf-5d58-4fe5-8909-8d453783b9e5 2 2024-05-09T09:52:49.741 INFO:teuthology.orchestra.run.smithi080.stdout:2 2024-05-09T09:52:49.757 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new ef14f326-2a6d-4bbb-9cce-e984a09db334 3 2024-05-09T09:52:49.882 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:49.877+0000 7f70f3e1c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T09:52:49.963 INFO:teuthology.orchestra.run.smithi080.stdout:3 2024-05-09T09:52:49.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new b609b2b6-6fec-4d82-8126-4c109f53093d 4 2024-05-09T09:52:50.019 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.018+0000 7f0bdfdb9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T09:52:50.075 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.074+0000 7f0bdfdb9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T09:52:50.079 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:50.077+0000 7f70f3e1c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T09:52:50.131 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.130+0000 7f0bdfdb9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T09:52:50.183 INFO:teuthology.orchestra.run.smithi080.stdout:4 2024-05-09T09:52:50.200 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new a8f7aea9-0c6f-4c2e-9541-b8780d58ec01 5 2024-05-09T09:52:50.212 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.210+0000 7f0bdfdb9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T09:52:50.266 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.266+0000 7f0bdfdb9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T09:52:50.347 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.346+0000 7f0bdfdb9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T09:52:50.391 INFO:teuthology.orchestra.run.smithi080.stdout:5 2024-05-09T09:52:50.403 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.402+0000 7f0bdfdb9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T09:52:50.408 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3 6 2024-05-09T09:52:50.562 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.562+0000 7f0bdfdb9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T09:52:50.610 INFO:teuthology.orchestra.run.smithi080.stdout:6 2024-05-09T09:52:50.626 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 777809d6-0cf6-4020-8efb-9f9df7bcea08 7 2024-05-09T09:52:50.627 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:50.626+0000 7f0bdfdb9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T09:52:50.643 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:50.641+0000 7f70f3e1c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T09:52:50.698 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:50.697+0000 7f70f3e1c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T09:52:50.755 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:50.753+0000 7f70f3e1c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T09:52:50.819 INFO:teuthology.orchestra.run.smithi080.stdout:7 2024-05-09T09:52:50.834 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:50.833+0000 7f70f3e1c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T09:52:50.835 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T09:52:50.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T09:52:50.838 INFO:tasks.ceph.osd.0:Started 2024-05-09T09:52:50.838 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T09:52:50.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T09:52:50.840 INFO:tasks.ceph.osd.1:Started 2024-05-09T09:52:50.840 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T09:52:50.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T09:52:50.843 INFO:tasks.ceph.osd.2:Started 2024-05-09T09:52:50.843 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T09:52:50.843 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T09:52:50.845 INFO:tasks.ceph.osd.3:Started 2024-05-09T09:52:50.845 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-09T09:52:50.845 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-09T09:52:50.880 INFO:tasks.ceph.osd.4:Started 2024-05-09T09:52:50.880 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-09T09:52:50.880 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-09T09:52:50.882 INFO:tasks.ceph.osd.5:Started 2024-05-09T09:52:50.882 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-09T09:52:50.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-09T09:52:50.884 INFO:tasks.ceph.osd.6:Started 2024-05-09T09:52:50.884 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-09T09:52:50.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-09T09:52:50.886 INFO:tasks.ceph.osd.7:Started 2024-05-09T09:52:50.886 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:52:50.887 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:50.885+0000 7f70f3e1c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T09:52:50.977 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:50.973+0000 7f70f3e1c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T09:52:51.030 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:51.029+0000 7f70f3e1c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T09:52:51.103 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:52:51.103 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"ab394f08-fac0-4b9b-8c5e-bce336e83e29","created":"2024-05-09T09:52:48.405333+0000","modified":"2024-05-09T09:52:50.817524+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T09:52:50.817524+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b6d1a399-da26-41fd-8eed-493a7286aa6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"097e00bf-5d58-4fe5-8909-8d453783b9e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef14f326-2a6d-4bbb-9cce-e984a09db334","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b609b2b6-6fec-4d82-8126-4c109f53093d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a8f7aea9-0c6f-4c2e-9541-b8780d58ec01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"777809d6-0cf6-4020-8efb-9f9df7bcea08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:52:51.119 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T09:52:51.120 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T09:52:51.178 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:51.173+0000 7f70f3e1c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T09:52:51.239 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:51.237+0000 7f70f3e1c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T09:52:51.293 INFO:tasks.ceph.mgr.y.smithi032.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-09T09:52:51.293 INFO:tasks.ceph.mgr.y.smithi032.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-09T09:52:51.294 INFO:tasks.ceph.mgr.y.smithi032.stderr: from numpy import show_config as show_numpy_config 2024-05-09T09:52:51.336 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:51.333+0000 7f0bdfdb9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T09:52:51.447 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:52:51.445+0000 7f3ebd62e7c0 -1 Falling back to public interface 2024-05-09T09:52:51.466 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:52:51.465+0000 7f855d7b57c0 -1 Falling back to public interface 2024-05-09T09:52:51.470 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:52:51.469+0000 7fcbdd2057c0 -1 Falling back to public interface 2024-05-09T09:52:51.489 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:51.485+0000 7f0bdfdb9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T09:52:51.494 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:52:51.493+0000 7fbaad5767c0 -1 Falling back to public interface 2024-05-09T09:52:51.499 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:52:51.497+0000 7fbbbdbae7c0 -1 Falling back to public interface 2024-05-09T09:52:51.503 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:52:51.501+0000 7f0df7e537c0 -1 Falling back to public interface 2024-05-09T09:52:51.523 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:52:51.521+0000 7f4c1c2507c0 -1 Falling back to public interface 2024-05-09T09:52:51.535 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:52:51.533+0000 7f3a664f27c0 -1 Falling back to public interface 2024-05-09T09:52:51.661 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:51.657+0000 7f0bdfdb9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T09:52:51.727 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:51.725+0000 7f0bdfdb9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T09:52:51.868 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:51.865+0000 7f0bdfdb9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T09:52:51.907 INFO:tasks.ceph.mgr.x.smithi080.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-09T09:52:51.907 INFO:tasks.ceph.mgr.x.smithi080.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-09T09:52:51.907 INFO:tasks.ceph.mgr.x.smithi080.stderr: from numpy import show_config as show_numpy_config 2024-05-09T09:52:51.924 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T09:52:51.954 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:51.953+0000 7f70f3e1c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T09:52:52.109 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:52.105+0000 7f70f3e1c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T09:52:52.121 INFO:teuthology.misc.health.smithi032.stdout: 2024-05-09T09:52:52.121 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"ab394f08-fac0-4b9b-8c5e-bce336e83e29","created":"2024-05-09T09:52:48.405333+0000","modified":"2024-05-09T09:52:50.817524+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T09:52:50.817524+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b6d1a399-da26-41fd-8eed-493a7286aa6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"097e00bf-5d58-4fe5-8909-8d453783b9e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ef14f326-2a6d-4bbb-9cce-e984a09db334","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b609b2b6-6fec-4d82-8126-4c109f53093d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a8f7aea9-0c6f-4c2e-9541-b8780d58ec01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"777809d6-0cf6-4020-8efb-9f9df7bcea08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:52:52.138 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T09:52:52.278 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:52.273+0000 7f70f3e1c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T09:52:52.341 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:52.337+0000 7f70f3e1c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T09:52:52.475 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:52.473+0000 7f70f3e1c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T09:52:52.524 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:52.521+0000 7f0bdfdb9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T09:52:52.602 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:52.601+0000 7f0bdfdb9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T09:52:52.794 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:52.789+0000 7f0bdfdb9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T09:52:52.870 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:52.869+0000 7f0bdfdb9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T09:52:53.077 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:53.073+0000 7f70f3e1c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T09:52:53.152 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:53.149+0000 7f70f3e1c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T09:52:53.173 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:53.169+0000 7f0bdfdb9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T09:52:53.238 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:53.237+0000 7f0bdfdb9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T09:52:53.335 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:53.333+0000 7f70f3e1c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T09:52:53.409 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:53.405+0000 7f70f3e1c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T09:52:53.697 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:53.693+0000 7f70f3e1c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T09:52:53.758 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-09T09:52:53.757+0000 7f70f3e1c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T09:52:54.277 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:54.273+0000 7f0b87201640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T09:52:54.280 INFO:tasks.ceph.mgr.y.smithi032.stderr:2024-05-09T09:52:54.277+0000 7f0b87201640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T09:52:55.049 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:52:55.044+0000 7f3a664f27c0 -1 osd.7 0 log_to_monitors true 2024-05-09T09:52:55.056 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:52:55.052+0000 7f4c1c2507c0 -1 osd.6 0 log_to_monitors true 2024-05-09T09:52:55.277 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:52:55.273+0000 7f3ebd62e7c0 -1 osd.0 0 log_to_monitors true 2024-05-09T09:52:55.328 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:52:55.325+0000 7f855d7b57c0 -1 osd.2 0 log_to_monitors true 2024-05-09T09:52:55.342 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:52:55.340+0000 7fbbbdbae7c0 -1 osd.4 0 log_to_monitors true 2024-05-09T09:52:55.355 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:52:55.353+0000 7fcbdd2057c0 -1 osd.3 0 log_to_monitors true 2024-05-09T09:52:55.392 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:52:55.389+0000 7fbaad5767c0 -1 osd.1 0 log_to_monitors true 2024-05-09T09:52:55.456 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:52:55.452+0000 7f0df7e537c0 -1 osd.5 0 log_to_monitors true 2024-05-09T09:52:57.990 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:52:57.989+0000 7f855975e640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T09:52:58.009 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:52:58.005+0000 7fbaa951f640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T09:52:58.021 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:52:58.017+0000 7fcbd91ae640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T09:52:58.030 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:52:58.029+0000 7f8551592640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:52:58.042 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:52:58.041+0000 7fbaa1353640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:52:58.051 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:52:58.049+0000 7f3eb95d7640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T09:52:58.054 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:52:58.053+0000 7fcbd0fe2640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:52:58.078 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:52:58.077+0000 7f3eb140b640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:52:58.247 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:52:58.244+0000 7fbbb9b57640 -1 osd.4 0 waiting for initial osdmap 2024-05-09T09:52:58.275 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:52:58.272+0000 7fbbb198b640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:52:58.290 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:52:58.284+0000 7f4c18a0b640 -1 osd.6 0 waiting for initial osdmap 2024-05-09T09:52:58.319 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:52:58.316+0000 7f4c1002d640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:52:58.345 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:52:58.340+0000 7f3a62cad640 -1 osd.7 0 waiting for initial osdmap 2024-05-09T09:52:58.369 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:52:58.364+0000 7f3a5a2cf640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:52:58.719 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:52:58.716+0000 7f0df3dfc640 -1 osd.5 0 waiting for initial osdmap 2024-05-09T09:52:58.740 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:52:58.736+0000 7f0debc30640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:52:58.945 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T09:52:59.252 INFO:teuthology.misc.health.smithi032.stdout: 2024-05-09T09:52:59.252 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":14,"fsid":"ab394f08-fac0-4b9b-8c5e-bce336e83e29","created":"2024-05-09T09:52:48.405333+0000","modified":"2024-05-09T09:52:59.026796+0000","last_up_change":"2024-05-09T09:52:59.026796+0000","last_in_change":"2024-05-09T09:52:50.817524+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b6d1a399-da26-41fd-8eed-493a7286aa6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6801","nonce":396091358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6803","nonce":396091358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6807","nonce":396091358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6805","nonce":396091358}]},"public_addr":"172.21.15.32:6801/396091358","cluster_addr":"172.21.15.32:6803/396091358","heartbeat_back_addr":"172.21.15.32:6807/396091358","heartbeat_front_addr":"172.21.15.32:6805/396091358","state":["exists","up"]},{"osd":1,"uuid":"6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6825","nonce":3047693294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6827","nonce":3047693294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6831","nonce":3047693294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6829","nonce":3047693294}]},"public_addr":"172.21.15.32:6825/3047693294","cluster_addr":"172.21.15.32:6827/3047693294","heartbeat_back_addr":"172.21.15.32:6831/3047693294","heartbeat_front_addr":"172.21.15.32:6829/3047693294","state":["exists","up"]},{"osd":2,"uuid":"097e00bf-5d58-4fe5-8909-8d453783b9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6809","nonce":2852540861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6811","nonce":2852540861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6815","nonce":2852540861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6813","nonce":2852540861}]},"public_addr":"172.21.15.32:6809/2852540861","cluster_addr":"172.21.15.32:6811/2852540861","heartbeat_back_addr":"172.21.15.32:6815/2852540861","heartbeat_front_addr":"172.21.15.32:6813/2852540861","state":["exists","up"]},{"osd":3,"uuid":"ef14f326-2a6d-4bbb-9cce-e984a09db334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6817","nonce":1396699085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6819","nonce":1396699085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6823","nonce":1396699085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6821","nonce":1396699085}]},"public_addr":"172.21.15.32:6817/1396699085","cluster_addr":"172.21.15.32:6819/1396699085","heartbeat_back_addr":"172.21.15.32:6823/1396699085","heartbeat_front_addr":"172.21.15.32:6821/1396699085","state":["exists","up"]},{"osd":4,"uuid":"b609b2b6-6fec-4d82-8126-4c109f53093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6801","nonce":2270167873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6803","nonce":2270167873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6807","nonce":2270167873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6805","nonce":2270167873}]},"public_addr":"172.21.15.80:6801/2270167873","cluster_addr":"172.21.15.80:6803/2270167873","heartbeat_back_addr":"172.21.15.80:6807/2270167873","heartbeat_front_addr":"172.21.15.80:6805/2270167873","state":["exists","up"]},{"osd":5,"uuid":"a8f7aea9-0c6f-4c2e-9541-b8780d58ec01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6809","nonce":1502875008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6811","nonce":1502875008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6815","nonce":1502875008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6813","nonce":1502875008}]},"public_addr":"172.21.15.80:6809/1502875008","cluster_addr":"172.21.15.80:6811/1502875008","heartbeat_back_addr":"172.21.15.80:6815/1502875008","heartbeat_front_addr":"172.21.15.80:6813/1502875008","state":["exists","up"]},{"osd":6,"uuid":"ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6817","nonce":2011375001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6819","nonce":2011375001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6823","nonce":2011375001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6821","nonce":2011375001}]},"public_addr":"172.21.15.80:6817/2011375001","cluster_addr":"172.21.15.80:6819/2011375001","heartbeat_back_addr":"172.21.15.80:6823/2011375001","heartbeat_front_addr":"172.21.15.80:6821/2011375001","state":["exists","up"]},{"osd":7,"uuid":"777809d6-0cf6-4020-8efb-9f9df7bcea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6825","nonce":4069183898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6827","nonce":4069183898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6831","nonce":4069183898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6829","nonce":4069183898}]},"public_addr":"172.21.15.80:6825/4069183898","cluster_addr":"172.21.15.80:6827/4069183898","heartbeat_back_addr":"172.21.15.80:6831/4069183898","heartbeat_front_addr":"172.21.15.80:6829/4069183898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:52:59.269 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-09T09:52:59.269 INFO:tasks.ceph:Creating RBD pool 2024-05-09T09:52:59.269 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-09T09:53:00.040 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'rbd' created 2024-05-09T09:53:00.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-09T09:53:01.034 INFO:teuthology.orchestra.run.smithi032.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-09T09:53:01.064 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T09:53:01.064 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T09:53:01.064 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T09:53:01.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T09:53:01.065 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T09:53:01.417 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:53:01.434 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":122412055},{"type":"v1","addr":"172.21.15.32:6833","nonce":122412055}]},"active_addr":"172.21.15.32:6833/122412055","active_change":"2024-05-09T09:52:53.263007+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":1590405473}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":3587058680}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":2096013238}]}]} 2024-05-09T09:53:01.440 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T09:53:01.440 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T09:53:01.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:53:01.734 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:53:01.735 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":16,"fsid":"ab394f08-fac0-4b9b-8c5e-bce336e83e29","created":"2024-05-09T09:52:48.405333+0000","modified":"2024-05-09T09:53:01.033125+0000","last_up_change":"2024-05-09T09:52:59.026796+0000","last_in_change":"2024-05-09T09:52:50.817524+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:52:59.315438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-09T09:52:59.577014+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b6d1a399-da26-41fd-8eed-493a7286aa6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6801","nonce":396091358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6803","nonce":396091358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6807","nonce":396091358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6805","nonce":396091358}]},"public_addr":"172.21.15.32:6801/396091358","cluster_addr":"172.21.15.32:6803/396091358","heartbeat_back_addr":"172.21.15.32:6807/396091358","heartbeat_front_addr":"172.21.15.32:6805/396091358","state":["exists","up"]},{"osd":1,"uuid":"6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6825","nonce":3047693294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6827","nonce":3047693294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6831","nonce":3047693294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6829","nonce":3047693294}]},"public_addr":"172.21.15.32:6825/3047693294","cluster_addr":"172.21.15.32:6827/3047693294","heartbeat_back_addr":"172.21.15.32:6831/3047693294","heartbeat_front_addr":"172.21.15.32:6829/3047693294","state":["exists","up"]},{"osd":2,"uuid":"097e00bf-5d58-4fe5-8909-8d453783b9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6809","nonce":2852540861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6811","nonce":2852540861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6815","nonce":2852540861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6813","nonce":2852540861}]},"public_addr":"172.21.15.32:6809/2852540861","cluster_addr":"172.21.15.32:6811/2852540861","heartbeat_back_addr":"172.21.15.32:6815/2852540861","heartbeat_front_addr":"172.21.15.32:6813/2852540861","state":["exists","up"]},{"osd":3,"uuid":"ef14f326-2a6d-4bbb-9cce-e984a09db334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6817","nonce":1396699085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6819","nonce":1396699085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6823","nonce":1396699085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6821","nonce":1396699085}]},"public_addr":"172.21.15.32:6817/1396699085","cluster_addr":"172.21.15.32:6819/1396699085","heartbeat_back_addr":"172.21.15.32:6823/1396699085","heartbeat_front_addr":"172.21.15.32:6821/1396699085","state":["exists","up"]},{"osd":4,"uuid":"b609b2b6-6fec-4d82-8126-4c109f53093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6801","nonce":2270167873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6803","nonce":2270167873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6807","nonce":2270167873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6805","nonce":2270167873}]},"public_addr":"172.21.15.80:6801/2270167873","cluster_addr":"172.21.15.80:6803/2270167873","heartbeat_back_addr":"172.21.15.80:6807/2270167873","heartbeat_front_addr":"172.21.15.80:6805/2270167873","state":["exists","up"]},{"osd":5,"uuid":"a8f7aea9-0c6f-4c2e-9541-b8780d58ec01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6809","nonce":1502875008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6811","nonce":1502875008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6815","nonce":1502875008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6813","nonce":1502875008}]},"public_addr":"172.21.15.80:6809/1502875008","cluster_addr":"172.21.15.80:6811/1502875008","heartbeat_back_addr":"172.21.15.80:6815/1502875008","heartbeat_front_addr":"172.21.15.80:6813/1502875008","state":["exists","up"]},{"osd":6,"uuid":"ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6817","nonce":2011375001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6819","nonce":2011375001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6823","nonce":2011375001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6821","nonce":2011375001}]},"public_addr":"172.21.15.80:6817/2011375001","cluster_addr":"172.21.15.80:6819/2011375001","heartbeat_back_addr":"172.21.15.80:6823/2011375001","heartbeat_front_addr":"172.21.15.80:6821/2011375001","state":["exists","up"]},{"osd":7,"uuid":"777809d6-0cf6-4020-8efb-9f9df7bcea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6825","nonce":4069183898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6827","nonce":4069183898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6831","nonce":4069183898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6829","nonce":4069183898}]},"public_addr":"172.21.15.80:6825/4069183898","cluster_addr":"172.21.15.80:6827/4069183898","heartbeat_back_addr":"172.21.15.80:6831/4069183898","heartbeat_front_addr":"172.21.15.80:6829/4069183898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.252744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.355061+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.322435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.394680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.304104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.434142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.028140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.015696+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:53:01.752 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T09:53:01.752 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:53:02.052 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:53:02.052 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":17,"fsid":"ab394f08-fac0-4b9b-8c5e-bce336e83e29","created":"2024-05-09T09:52:48.405333+0000","modified":"2024-05-09T09:53:02.036265+0000","last_up_change":"2024-05-09T09:52:59.026796+0000","last_in_change":"2024-05-09T09:52:50.817524+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:52:59.315438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-09T09:52:59.577014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b6d1a399-da26-41fd-8eed-493a7286aa6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6801","nonce":396091358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6803","nonce":396091358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6807","nonce":396091358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6805","nonce":396091358}]},"public_addr":"172.21.15.32:6801/396091358","cluster_addr":"172.21.15.32:6803/396091358","heartbeat_back_addr":"172.21.15.32:6807/396091358","heartbeat_front_addr":"172.21.15.32:6805/396091358","state":["exists","up"]},{"osd":1,"uuid":"6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6825","nonce":3047693294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6827","nonce":3047693294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6831","nonce":3047693294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6829","nonce":3047693294}]},"public_addr":"172.21.15.32:6825/3047693294","cluster_addr":"172.21.15.32:6827/3047693294","heartbeat_back_addr":"172.21.15.32:6831/3047693294","heartbeat_front_addr":"172.21.15.32:6829/3047693294","state":["exists","up"]},{"osd":2,"uuid":"097e00bf-5d58-4fe5-8909-8d453783b9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6809","nonce":2852540861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6811","nonce":2852540861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6815","nonce":2852540861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6813","nonce":2852540861}]},"public_addr":"172.21.15.32:6809/2852540861","cluster_addr":"172.21.15.32:6811/2852540861","heartbeat_back_addr":"172.21.15.32:6815/2852540861","heartbeat_front_addr":"172.21.15.32:6813/2852540861","state":["exists","up"]},{"osd":3,"uuid":"ef14f326-2a6d-4bbb-9cce-e984a09db334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6817","nonce":1396699085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6819","nonce":1396699085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6823","nonce":1396699085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6821","nonce":1396699085}]},"public_addr":"172.21.15.32:6817/1396699085","cluster_addr":"172.21.15.32:6819/1396699085","heartbeat_back_addr":"172.21.15.32:6823/1396699085","heartbeat_front_addr":"172.21.15.32:6821/1396699085","state":["exists","up"]},{"osd":4,"uuid":"b609b2b6-6fec-4d82-8126-4c109f53093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6801","nonce":2270167873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6803","nonce":2270167873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6807","nonce":2270167873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6805","nonce":2270167873}]},"public_addr":"172.21.15.80:6801/2270167873","cluster_addr":"172.21.15.80:6803/2270167873","heartbeat_back_addr":"172.21.15.80:6807/2270167873","heartbeat_front_addr":"172.21.15.80:6805/2270167873","state":["exists","up"]},{"osd":5,"uuid":"a8f7aea9-0c6f-4c2e-9541-b8780d58ec01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6809","nonce":1502875008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6811","nonce":1502875008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6815","nonce":1502875008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6813","nonce":1502875008}]},"public_addr":"172.21.15.80:6809/1502875008","cluster_addr":"172.21.15.80:6811/1502875008","heartbeat_back_addr":"172.21.15.80:6815/1502875008","heartbeat_front_addr":"172.21.15.80:6813/1502875008","state":["exists","up"]},{"osd":6,"uuid":"ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6817","nonce":2011375001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6819","nonce":2011375001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6823","nonce":2011375001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6821","nonce":2011375001}]},"public_addr":"172.21.15.80:6817/2011375001","cluster_addr":"172.21.15.80:6819/2011375001","heartbeat_back_addr":"172.21.15.80:6823/2011375001","heartbeat_front_addr":"172.21.15.80:6821/2011375001","state":["exists","up"]},{"osd":7,"uuid":"777809d6-0cf6-4020-8efb-9f9df7bcea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6825","nonce":4069183898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6827","nonce":4069183898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6831","nonce":4069183898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6829","nonce":4069183898}]},"public_addr":"172.21.15.80:6825/4069183898","cluster_addr":"172.21.15.80:6827/4069183898","heartbeat_back_addr":"172.21.15.80:6831/4069183898","heartbeat_front_addr":"172.21.15.80:6829/4069183898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.252744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.355061+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.322435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.394680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.304104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.434142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.028140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.015696+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:53:02.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T09:53:02.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T09:53:02.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T09:53:02.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T09:53:02.074 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-09T09:53:02.074 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-09T09:53:02.074 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-09T09:53:02.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-09T09:53:02.323 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-05-09T09:53:02.323 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T09:53:02.337 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:02.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T09:53:02.338 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:02.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T09:53:02.346 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:02.347 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T09:53:02.360 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-05-09T09:53:02.360 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T09:53:02.362 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:02.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T09:53:02.364 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:02.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T09:53:02.370 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-05-09T09:53:02.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T09:53:02.841 INFO:teuthology.orchestra.run.smithi032.stdout:60129542146 2024-05-09T09:53:02.854 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:02.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.2 2024-05-09T09:53:02.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-05-09T09:53:02.882 INFO:teuthology.orchestra.run.smithi032.stdout:60129542146 2024-05-09T09:53:02.892 INFO:teuthology.orchestra.run.smithi032.stdout:60129542146 2024-05-09T09:53:02.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.6 2024-05-09T09:53:02.901 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:02.906 INFO:teuthology.orchestra.run.smithi032.stdout:60129542146 2024-05-09T09:53:02.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.0 2024-05-09T09:53:02.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.4 2024-05-09T09:53:02.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.7 2024-05-09T09:53:02.945 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:60129542146 2024-05-09T09:53:02.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.5 2024-05-09T09:53:02.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2024-05-09T09:53:03.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T09:53:03.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T09:53:03.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T09:53:03.917 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T09:53:03.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T09:53:03.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T09:53:03.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T09:53:03.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T09:53:04.392 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:04.402 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:04.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.2 2024-05-09T09:53:04.418 DEBUG:teuthology.parallel:result is None 2024-05-09T09:53:04.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.0 2024-05-09T09:53:04.430 DEBUG:teuthology.parallel:result is None 2024-05-09T09:53:04.446 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-05-09T09:53:04.458 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:04.470 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-05-09T09:53:04.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-05-09T09:53:04.473 DEBUG:teuthology.parallel:result is None 2024-05-09T09:53:04.474 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-05-09T09:53:04.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.6 2024-05-09T09:53:04.489 DEBUG:teuthology.parallel:result is None 2024-05-09T09:53:04.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2024-05-09T09:53:04.494 DEBUG:teuthology.parallel:result is None 2024-05-09T09:53:04.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.5 2024-05-09T09:53:04.497 DEBUG:teuthology.parallel:result is None 2024-05-09T09:53:04.499 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:04.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.7 2024-05-09T09:53:04.516 DEBUG:teuthology.parallel:result is None 2024-05-09T09:53:04.524 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-05-09T09:53:04.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2024-05-09T09:53:04.541 DEBUG:teuthology.parallel:result is None 2024-05-09T09:53:04.541 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T09:53:04.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:53:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:53:04.864 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:53:04.881 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-05-09T09:53:03.276449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236100,"kb_used_data":2356,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":2412544,"data_stored":1547414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.055294+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:53:01.055294+0000","last_peered":"2024-05-09T09:53:01.055294+0000","last_clean":"2024-05-09T09:53:01.055294+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:53:01.055294+0000","last_undegraded":"2024-05-09T09:53:01.055294+0000","last_fullsized":"2024-05-09T09:53:01.055294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:50.839028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T09:53:02.050196+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:53:02.050196+0000","last_peered":"2024-05-09T09:53:02.050196+0000","last_clean":"2024-05-09T09:53:02.050196+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:53:02.050196+0000","last_undegraded":"2024-05-09T09:53:02.050196+0000","last_fullsized":"2024-05-09T09:53:02.050196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.057987+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:53:01.057987+0000","last_peered":"2024-05-09T09:53:01.057987+0000","last_clean":"2024-05-09T09:53:01.057987+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:53:01.057987+0000","last_undegraded":"2024-05-09T09:53:01.057987+0000","last_fullsized":"2024-05-09T09:53:01.057987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T09:53:02.050188+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:53:02.050188+0000","last_peered":"2024-05-09T09:53:02.050188+0000","last_clean":"2024-05-09T09:53:02.050188+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:53:02.050188+0000","last_undegraded":"2024-05-09T09:53:02.050188+0000","last_fullsized":"2024-05-09T09:53:02.050188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.054671+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:53:01.054671+0000","last_peered":"2024-05-09T09:53:01.054671+0000","last_clean":"2024-05-09T09:53:01.054671+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:53:01.054671+0000","last_undegraded":"2024-05-09T09:53:01.054671+0000","last_fullsized":"2024-05-09T09:53:01.054671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:43:39.438890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T09:53:02.234664+0000","last_change":"2024-05-09T09:53:01.049359+0000","last_active":"2024-05-09T09:53:02.234664+0000","last_peered":"2024-05-09T09:53:02.234664+0000","last_clean":"2024-05-09T09:53:02.234664+0000","last_became_active":"2024-05-09T09:53:01.048940+0000","last_became_peered":"2024-05-09T09:53:01.048940+0000","last_unstale":"2024-05-09T09:53:02.234664+0000","last_undegraded":"2024-05-09T09:53:02.234664+0000","last_fullsized":"2024-05-09T09:53:02.234664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.054885+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:53:01.054885+0000","last_peered":"2024-05-09T09:53:01.054885+0000","last_clean":"2024-05-09T09:53:01.054885+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:53:01.054885+0000","last_undegraded":"2024-05-09T09:53:01.054885+0000","last_fullsized":"2024-05-09T09:53:01.054885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.055868+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:53:01.055868+0000","last_peered":"2024-05-09T09:53:01.055868+0000","last_clean":"2024-05-09T09:53:01.055868+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:53:01.055868+0000","last_undegraded":"2024-05-09T09:53:01.055868+0000","last_fullsized":"2024-05-09T09:53:01.055868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:49.885474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.843991+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:53:01.843991+0000","last_peered":"2024-05-09T09:53:01.843991+0000","last_clean":"2024-05-09T09:53:01.843991+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:53:01.843991+0000","last_undegraded":"2024-05-09T09:53:01.843991+0000","last_fullsized":"2024-05-09T09:53:01.843991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":745472,"data_stored":635438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":51188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":745472,"data_stored":635438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:53:04.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:53:05.172 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:53:05.172 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:53:05.188 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-05-09T09:53:03.276449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236100,"kb_used_data":2356,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738620,"statfs":{"total":773094113280,"available":772852346880,"internally_reserved":0,"allocated":2412544,"data_stored":1547414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.055294+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:53:01.055294+0000","last_peered":"2024-05-09T09:53:01.055294+0000","last_clean":"2024-05-09T09:53:01.055294+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:53:01.055294+0000","last_undegraded":"2024-05-09T09:53:01.055294+0000","last_fullsized":"2024-05-09T09:53:01.055294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:50.839028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T09:53:02.050196+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:53:02.050196+0000","last_peered":"2024-05-09T09:53:02.050196+0000","last_clean":"2024-05-09T09:53:02.050196+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:53:02.050196+0000","last_undegraded":"2024-05-09T09:53:02.050196+0000","last_fullsized":"2024-05-09T09:53:02.050196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.057987+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:53:01.057987+0000","last_peered":"2024-05-09T09:53:01.057987+0000","last_clean":"2024-05-09T09:53:01.057987+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:53:01.057987+0000","last_undegraded":"2024-05-09T09:53:01.057987+0000","last_fullsized":"2024-05-09T09:53:01.057987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T09:53:02.050188+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:53:02.050188+0000","last_peered":"2024-05-09T09:53:02.050188+0000","last_clean":"2024-05-09T09:53:02.050188+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:53:02.050188+0000","last_undegraded":"2024-05-09T09:53:02.050188+0000","last_fullsized":"2024-05-09T09:53:02.050188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.054671+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:53:01.054671+0000","last_peered":"2024-05-09T09:53:01.054671+0000","last_clean":"2024-05-09T09:53:01.054671+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:53:01.054671+0000","last_undegraded":"2024-05-09T09:53:01.054671+0000","last_fullsized":"2024-05-09T09:53:01.054671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:43:39.438890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T09:53:02.234664+0000","last_change":"2024-05-09T09:53:01.049359+0000","last_active":"2024-05-09T09:53:02.234664+0000","last_peered":"2024-05-09T09:53:02.234664+0000","last_clean":"2024-05-09T09:53:02.234664+0000","last_became_active":"2024-05-09T09:53:01.048940+0000","last_became_peered":"2024-05-09T09:53:01.048940+0000","last_unstale":"2024-05-09T09:53:02.234664+0000","last_undegraded":"2024-05-09T09:53:02.234664+0000","last_fullsized":"2024-05-09T09:53:02.234664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.054885+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:53:01.054885+0000","last_peered":"2024-05-09T09:53:01.054885+0000","last_clean":"2024-05-09T09:53:01.054885+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:53:01.054885+0000","last_undegraded":"2024-05-09T09:53:01.054885+0000","last_fullsized":"2024-05-09T09:53:01.054885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.055868+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:53:01.055868+0000","last_peered":"2024-05-09T09:53:01.055868+0000","last_clean":"2024-05-09T09:53:01.055868+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:53:01.055868+0000","last_undegraded":"2024-05-09T09:53:01.055868+0000","last_fullsized":"2024-05-09T09:53:01.055868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:49.885474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":159,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-09T09:53:01.843991+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:53:01.843991+0000","last_peered":"2024-05-09T09:53:01.843991+0000","last_clean":"2024-05-09T09:53:01.843991+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:53:01.843991+0000","last_undegraded":"2024-05-09T09:53:01.843991+0000","last_fullsized":"2024-05-09T09:53:01.843991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28368,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343472,"statfs":{"total":96636764160,"available":96607715328,"internally_reserved":0,"allocated":745472,"data_stored":635438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":51188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":151552,"data_stored":45070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":745472,"data_stored":635438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:53:05.189 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T09:53:05.189 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T09:53:05.190 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T09:53:05.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T09:53:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:53:05.503 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T09:53:05.520 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T09:53:05.520 INFO:teuthology.run_tasks:Running task rgw... 2024-05-09T09:53:05.590 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-09T09:53:05.590 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-09T09:53:05.590 INFO:tasks.rgw:Creating data pools 2024-05-09T09:53:05.590 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-09T09:53:05.591 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-05-09T09:53:06.087 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'default.rgw.buckets.data' created 2024-05-09T09:53:06.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-09T09:53:07.089 INFO:teuthology.orchestra.run.smithi032.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-09T09:53:07.127 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-09T09:53:08.081 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'default.rgw.buckets.index' created 2024-05-09T09:53:08.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-09T09:53:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-09T09:53:09.130 DEBUG:tasks.rgw:Pools created 2024-05-09T09:53:09.131 INFO:tasks.rgw:Starting rgw... 2024-05-09T09:53:09.131 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-09T09:53:09.131 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-09T09:53:09.131 DEBUG:teuthology.orchestra.run.smithi032:> sudo echo -n http://smithi032.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-09T09:53:09.144 INFO:teuthology.orchestra.run.smithi032.stdout:http://smithi032.front.sepia.ceph.com:80 2024-05-09T09:53:09.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-09T09:53:09.196 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-09T09:53:09.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-09T09:53:09.239 INFO:tasks.rgw.client.0:Started 2024-05-09T09:53:09.239 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi032.front.sepia.ceph.com:80/ 2024-05-09T09:53:09.239 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-05-09T09:53:09.267 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:53:09.268 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:53:09.268 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-09T09:53:09.269 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-09T09:53:09.269 INFO:teuthology.orchestra.run.smithi032.stderr:curl: (7) Failed to connect to smithi032.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-09T09:53:10.270 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-05-09T09:53:10.283 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:53:10.284 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:53:10.284 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-09T09:53:10.284 INFO:teuthology.orchestra.run.smithi032.stderr:curl: (7) Failed to connect to smithi032.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-09T09:53:10.284 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-09T09:53:12.286 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-05-09T09:53:12.298 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:53:12.298 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:53:12.298 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-09T09:53:12.298 INFO:teuthology.orchestra.run.smithi032.stderr:curl: (7) Failed to connect to smithi032.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-09T09:53:12.299 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-09T09:53:16.300 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-05-09T09:53:16.314 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-09T09:53:16.314 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:53:16.315 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:53:16.315 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-09T09:53:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:curl: (7) Failed to connect to smithi032.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-09T09:53:18.297 INFO:tasks.rgw.client.0.smithi032.stdout:2024-05-09T09:53:18.293+0000 7f0bec2559c0 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-09T09:53:24.317 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-05-09T09:53:24.328 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:53:24.329 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:53:24.332 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 51064 0 --:--:-- --:--:-- --:--:-- 62333 2024-05-09T09:53:24.333 INFO:teuthology.orchestra.run.smithi032.stdout:anonymous 2024-05-09T09:53:24.333 INFO:teuthology.run_tasks:Running task thrashosds... 2024-05-09T09:53:24.348 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-05-09T09:53:24.349 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-kkeithley-zipper-ec'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-kkeithley-zipper-ec', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}} 2024-05-09T09:53:24.349 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-05-09T09:53:24.349 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-05-09T09:53:24.712 INFO:tasks.thrashosds:Beginning thrashosds... 2024-05-09T09:53:24.712 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T09:53:24.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:53:25.042 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:53:25.049 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:53:25.065 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-05-09T09:53:23.283626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":511,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240960,"kb_used_data":4008,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733760,"statfs":{"total":773094113280,"available":772847370240,"internally_reserved":0,"allocated":4104192,"data_stored":2358454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.135644"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190270+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:53:18.190270+0000","last_peered":"2024-05-09T09:53:18.190270+0000","last_clean":"2024-05-09T09:53:18.190270+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:53:18.190270+0000","last_undegraded":"2024-05-09T09:53:18.190270+0000","last_fullsized":"2024-05-09T09:53:18.190270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193555+0000","last_change":"2024-05-09T09:53:09.112112+0000","last_active":"2024-05-09T09:53:18.193555+0000","last_peered":"2024-05-09T09:53:18.193555+0000","last_clean":"2024-05-09T09:53:18.193555+0000","last_became_active":"2024-05-09T09:53:09.111383+0000","last_became_peered":"2024-05-09T09:53:09.111383+0000","last_unstale":"2024-05-09T09:53:18.193555+0000","last_undegraded":"2024-05-09T09:53:18.193555+0000","last_fullsized":"2024-05-09T09:53:18.193555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:28:03.943440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174348+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:53:18.174348+0000","last_peered":"2024-05-09T09:53:18.174348+0000","last_clean":"2024-05-09T09:53:18.174348+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:53:18.174348+0000","last_undegraded":"2024-05-09T09:53:18.174348+0000","last_fullsized":"2024-05-09T09:53:18.174348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187940+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:53:18.187940+0000","last_peered":"2024-05-09T09:53:18.187940+0000","last_clean":"2024-05-09T09:53:18.187940+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:53:18.187940+0000","last_undegraded":"2024-05-09T09:53:18.187940+0000","last_fullsized":"2024-05-09T09:53:18.187940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162753+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:53:18.162753+0000","last_peered":"2024-05-09T09:53:18.162753+0000","last_clean":"2024-05-09T09:53:18.162753+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:53:18.162753+0000","last_undegraded":"2024-05-09T09:53:18.162753+0000","last_fullsized":"2024-05-09T09:53:18.162753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157994+0000","last_change":"2024-05-09T09:53:09.139224+0000","last_active":"2024-05-09T09:53:18.157994+0000","last_peered":"2024-05-09T09:53:18.157994+0000","last_clean":"2024-05-09T09:53:18.157994+0000","last_became_active":"2024-05-09T09:53:09.133660+0000","last_became_peered":"2024-05-09T09:53:09.133660+0000","last_unstale":"2024-05-09T09:53:18.157994+0000","last_undegraded":"2024-05-09T09:53:18.157994+0000","last_fullsized":"2024-05-09T09:53:18.157994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196099+0000","last_change":"2024-05-09T09:53:07.122498+0000","last_active":"2024-05-09T09:53:18.196099+0000","last_peered":"2024-05-09T09:53:18.196099+0000","last_clean":"2024-05-09T09:53:18.196099+0000","last_became_active":"2024-05-09T09:53:07.121122+0000","last_became_peered":"2024-05-09T09:53:07.121122+0000","last_unstale":"2024-05-09T09:53:18.196099+0000","last_undegraded":"2024-05-09T09:53:18.196099+0000","last_fullsized":"2024-05-09T09:53:18.196099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:09:33.860750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158338+0000","last_change":"2024-05-09T09:53:09.125729+0000","last_active":"2024-05-09T09:53:18.158338+0000","last_peered":"2024-05-09T09:53:18.158338+0000","last_clean":"2024-05-09T09:53:18.158338+0000","last_became_active":"2024-05-09T09:53:09.125431+0000","last_became_peered":"2024-05-09T09:53:09.125431+0000","last_unstale":"2024-05-09T09:53:18.158338+0000","last_undegraded":"2024-05-09T09:53:18.158338+0000","last_fullsized":"2024-05-09T09:53:18.158338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188606+0000","last_change":"2024-05-09T09:53:07.131594+0000","last_active":"2024-05-09T09:53:18.188606+0000","last_peered":"2024-05-09T09:53:18.188606+0000","last_clean":"2024-05-09T09:53:18.188606+0000","last_became_active":"2024-05-09T09:53:07.129344+0000","last_became_peered":"2024-05-09T09:53:07.129344+0000","last_unstale":"2024-05-09T09:53:18.188606+0000","last_undegraded":"2024-05-09T09:53:18.188606+0000","last_fullsized":"2024-05-09T09:53:18.188606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:11.210918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199059+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:53:18.199059+0000","last_peered":"2024-05-09T09:53:18.199059+0000","last_clean":"2024-05-09T09:53:18.199059+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:53:18.199059+0000","last_undegraded":"2024-05-09T09:53:18.199059+0000","last_fullsized":"2024-05-09T09:53:18.199059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194210+0000","last_change":"2024-05-09T09:53:07.130117+0000","last_active":"2024-05-09T09:53:18.194210+0000","last_peered":"2024-05-09T09:53:18.194210+0000","last_clean":"2024-05-09T09:53:18.194210+0000","last_became_active":"2024-05-09T09:53:07.129508+0000","last_became_peered":"2024-05-09T09:53:07.129508+0000","last_unstale":"2024-05-09T09:53:18.194210+0000","last_undegraded":"2024-05-09T09:53:18.194210+0000","last_fullsized":"2024-05-09T09:53:18.194210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.230481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159136+0000","last_change":"2024-05-09T09:53:09.140117+0000","last_active":"2024-05-09T09:53:18.159136+0000","last_peered":"2024-05-09T09:53:18.159136+0000","last_clean":"2024-05-09T09:53:18.159136+0000","last_became_active":"2024-05-09T09:53:09.139223+0000","last_became_peered":"2024-05-09T09:53:09.139223+0000","last_unstale":"2024-05-09T09:53:18.159136+0000","last_undegraded":"2024-05-09T09:53:18.159136+0000","last_fullsized":"2024-05-09T09:53:18.159136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188210+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:53:18.188210+0000","last_peered":"2024-05-09T09:53:18.188210+0000","last_clean":"2024-05-09T09:53:18.188210+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:53:18.188210+0000","last_undegraded":"2024-05-09T09:53:18.188210+0000","last_fullsized":"2024-05-09T09:53:18.188210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196314+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:53:18.196314+0000","last_peered":"2024-05-09T09:53:18.196314+0000","last_clean":"2024-05-09T09:53:18.196314+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:53:18.196314+0000","last_undegraded":"2024-05-09T09:53:18.196314+0000","last_fullsized":"2024-05-09T09:53:18.196314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177349+0000","last_change":"2024-05-09T09:53:07.119794+0000","last_active":"2024-05-09T09:53:18.177349+0000","last_peered":"2024-05-09T09:53:18.177349+0000","last_clean":"2024-05-09T09:53:18.177349+0000","last_became_active":"2024-05-09T09:53:07.119402+0000","last_became_peered":"2024-05-09T09:53:07.119402+0000","last_unstale":"2024-05-09T09:53:18.177349+0000","last_undegraded":"2024-05-09T09:53:18.177349+0000","last_fullsized":"2024-05-09T09:53:18.177349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162165+0000","last_change":"2024-05-09T09:53:09.109546+0000","last_active":"2024-05-09T09:53:18.162165+0000","last_peered":"2024-05-09T09:53:18.162165+0000","last_clean":"2024-05-09T09:53:18.162165+0000","last_became_active":"2024-05-09T09:53:09.108979+0000","last_became_peered":"2024-05-09T09:53:09.108979+0000","last_unstale":"2024-05-09T09:53:18.162165+0000","last_undegraded":"2024-05-09T09:53:18.162165+0000","last_fullsized":"2024-05-09T09:53:18.162165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:57.701380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157559+0000","last_change":"2024-05-09T09:53:09.139498+0000","last_active":"2024-05-09T09:53:18.157559+0000","last_peered":"2024-05-09T09:53:18.157559+0000","last_clean":"2024-05-09T09:53:18.157559+0000","last_became_active":"2024-05-09T09:53:09.133859+0000","last_became_peered":"2024-05-09T09:53:09.133859+0000","last_unstale":"2024-05-09T09:53:18.157559+0000","last_undegraded":"2024-05-09T09:53:18.157559+0000","last_fullsized":"2024-05-09T09:53:18.157559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:18.060153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190399+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:53:18.190399+0000","last_peered":"2024-05-09T09:53:18.190399+0000","last_clean":"2024-05-09T09:53:18.190399+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:53:18.190399+0000","last_undegraded":"2024-05-09T09:53:18.190399+0000","last_fullsized":"2024-05-09T09:53:18.190399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188014+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:53:18.188014+0000","last_peered":"2024-05-09T09:53:18.188014+0000","last_clean":"2024-05-09T09:53:18.188014+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:53:18.188014+0000","last_undegraded":"2024-05-09T09:53:18.188014+0000","last_fullsized":"2024-05-09T09:53:18.188014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200153+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:53:18.200153+0000","last_peered":"2024-05-09T09:53:18.200153+0000","last_clean":"2024-05-09T09:53:18.200153+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:53:18.200153+0000","last_undegraded":"2024-05-09T09:53:18.200153+0000","last_fullsized":"2024-05-09T09:53:18.200153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194501+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:53:18.194501+0000","last_peered":"2024-05-09T09:53:18.194501+0000","last_clean":"2024-05-09T09:53:18.194501+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:53:18.194501+0000","last_undegraded":"2024-05-09T09:53:18.194501+0000","last_fullsized":"2024-05-09T09:53:18.194501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200038+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:53:18.200038+0000","last_peered":"2024-05-09T09:53:18.200038+0000","last_clean":"2024-05-09T09:53:18.200038+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:53:18.200038+0000","last_undegraded":"2024-05-09T09:53:18.200038+0000","last_fullsized":"2024-05-09T09:53:18.200038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159692+0000","last_change":"2024-05-09T09:53:09.109289+0000","last_active":"2024-05-09T09:53:18.159692+0000","last_peered":"2024-05-09T09:53:18.159692+0000","last_clean":"2024-05-09T09:53:18.159692+0000","last_became_active":"2024-05-09T09:53:09.108483+0000","last_became_peered":"2024-05-09T09:53:09.108483+0000","last_unstale":"2024-05-09T09:53:18.159692+0000","last_undegraded":"2024-05-09T09:53:18.159692+0000","last_fullsized":"2024-05-09T09:53:18.159692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:55.077672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158447+0000","last_change":"2024-05-09T09:53:07.119366+0000","last_active":"2024-05-09T09:53:18.158447+0000","last_peered":"2024-05-09T09:53:18.158447+0000","last_clean":"2024-05-09T09:53:18.158447+0000","last_became_active":"2024-05-09T09:53:07.118523+0000","last_became_peered":"2024-05-09T09:53:07.118523+0000","last_unstale":"2024-05-09T09:53:18.158447+0000","last_undegraded":"2024-05-09T09:53:18.158447+0000","last_fullsized":"2024-05-09T09:53:18.158447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160556+0000","last_change":"2024-05-09T09:53:09.119350+0000","last_active":"2024-05-09T09:53:18.160556+0000","last_peered":"2024-05-09T09:53:18.160556+0000","last_clean":"2024-05-09T09:53:18.160556+0000","last_became_active":"2024-05-09T09:53:09.118782+0000","last_became_peered":"2024-05-09T09:53:09.118782+0000","last_unstale":"2024-05-09T09:53:18.160556+0000","last_undegraded":"2024-05-09T09:53:18.160556+0000","last_fullsized":"2024-05-09T09:53:18.160556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:13.483000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178095+0000","last_change":"2024-05-09T09:53:07.113936+0000","last_active":"2024-05-09T09:53:18.178095+0000","last_peered":"2024-05-09T09:53:18.178095+0000","last_clean":"2024-05-09T09:53:18.178095+0000","last_became_active":"2024-05-09T09:53:07.113560+0000","last_became_peered":"2024-05-09T09:53:07.113560+0000","last_unstale":"2024-05-09T09:53:18.178095+0000","last_undegraded":"2024-05-09T09:53:18.178095+0000","last_fullsized":"2024-05-09T09:53:18.178095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159103+0000","last_change":"2024-05-09T09:53:09.110783+0000","last_active":"2024-05-09T09:53:18.159103+0000","last_peered":"2024-05-09T09:53:18.159103+0000","last_clean":"2024-05-09T09:53:18.159103+0000","last_became_active":"2024-05-09T09:53:09.109553+0000","last_became_peered":"2024-05-09T09:53:09.109553+0000","last_unstale":"2024-05-09T09:53:18.159103+0000","last_undegraded":"2024-05-09T09:53:18.159103+0000","last_fullsized":"2024-05-09T09:53:18.159103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158599+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:53:18.158599+0000","last_peered":"2024-05-09T09:53:18.158599+0000","last_clean":"2024-05-09T09:53:18.158599+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:53:18.158599+0000","last_undegraded":"2024-05-09T09:53:18.158599+0000","last_fullsized":"2024-05-09T09:53:18.158599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157287+0000","last_change":"2024-05-09T09:53:17.178875+0000","last_active":"2024-05-09T09:53:18.157287+0000","last_peered":"2024-05-09T09:53:18.157287+0000","last_clean":"2024-05-09T09:53:18.157287+0000","last_became_active":"2024-05-09T09:53:17.178104+0000","last_became_peered":"2024-05-09T09:53:17.178104+0000","last_unstale":"2024-05-09T09:53:18.157287+0000","last_undegraded":"2024-05-09T09:53:18.157287+0000","last_fullsized":"2024-05-09T09:53:18.157287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178807+0000","last_change":"2024-05-09T09:53:09.113975+0000","last_active":"2024-05-09T09:53:18.178807+0000","last_peered":"2024-05-09T09:53:18.178807+0000","last_clean":"2024-05-09T09:53:18.178807+0000","last_became_active":"2024-05-09T09:53:09.112863+0000","last_became_peered":"2024-05-09T09:53:09.112863+0000","last_unstale":"2024-05-09T09:53:18.178807+0000","last_undegraded":"2024-05-09T09:53:18.178807+0000","last_fullsized":"2024-05-09T09:53:18.178807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:33.354661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188944+0000","last_change":"2024-05-09T09:53:07.130149+0000","last_active":"2024-05-09T09:53:18.188944+0000","last_peered":"2024-05-09T09:53:18.188944+0000","last_clean":"2024-05-09T09:53:18.188944+0000","last_became_active":"2024-05-09T09:53:07.124250+0000","last_became_peered":"2024-05-09T09:53:07.124250+0000","last_unstale":"2024-05-09T09:53:18.188944+0000","last_undegraded":"2024-05-09T09:53:18.188944+0000","last_fullsized":"2024-05-09T09:53:18.188944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:14.443292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195765+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:53:18.195765+0000","last_peered":"2024-05-09T09:53:18.195765+0000","last_clean":"2024-05-09T09:53:18.195765+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:53:18.195765+0000","last_undegraded":"2024-05-09T09:53:18.195765+0000","last_fullsized":"2024-05-09T09:53:18.195765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.561929+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:53:18.561929+0000","last_peered":"2024-05-09T09:53:18.561929+0000","last_clean":"2024-05-09T09:53:18.561929+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:53:18.561929+0000","last_undegraded":"2024-05-09T09:53:18.561929+0000","last_fullsized":"2024-05-09T09:53:18.561929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.189912+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:53:18.189912+0000","last_peered":"2024-05-09T09:53:18.189912+0000","last_clean":"2024-05-09T09:53:18.189912+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:53:18.189912+0000","last_undegraded":"2024-05-09T09:53:18.189912+0000","last_fullsized":"2024-05-09T09:53:18.189912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193698+0000","last_change":"2024-05-09T09:53:17.184566+0000","last_active":"2024-05-09T09:53:18.193698+0000","last_peered":"2024-05-09T09:53:18.193698+0000","last_clean":"2024-05-09T09:53:18.193698+0000","last_became_active":"2024-05-09T09:53:17.183686+0000","last_became_peered":"2024-05-09T09:53:17.183686+0000","last_unstale":"2024-05-09T09:53:18.193698+0000","last_undegraded":"2024-05-09T09:53:18.193698+0000","last_fullsized":"2024-05-09T09:53:18.193698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:41.712542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196321+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:53:18.196321+0000","last_peered":"2024-05-09T09:53:18.196321+0000","last_clean":"2024-05-09T09:53:18.196321+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:53:18.196321+0000","last_undegraded":"2024-05-09T09:53:18.196321+0000","last_fullsized":"2024-05-09T09:53:18.196321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158660+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:53:18.158660+0000","last_peered":"2024-05-09T09:53:18.158660+0000","last_clean":"2024-05-09T09:53:18.158660+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:53:18.158660+0000","last_undegraded":"2024-05-09T09:53:18.158660+0000","last_fullsized":"2024-05-09T09:53:18.158660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178538+0000","last_change":"2024-05-09T09:53:11.120948+0000","last_active":"2024-05-09T09:53:18.178538+0000","last_peered":"2024-05-09T09:53:18.178538+0000","last_clean":"2024-05-09T09:53:18.178538+0000","last_became_active":"2024-05-09T09:53:11.120423+0000","last_became_peered":"2024-05-09T09:53:11.120423+0000","last_unstale":"2024-05-09T09:53:18.178538+0000","last_undegraded":"2024-05-09T09:53:18.178538+0000","last_fullsized":"2024-05-09T09:53:18.178538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:06.988958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.953892+0000","last_change":"2024-05-09T09:53:13.119274+0000","last_active":"2024-05-09T09:53:18.953892+0000","last_peered":"2024-05-09T09:53:18.953892+0000","last_clean":"2024-05-09T09:53:18.953892+0000","last_became_active":"2024-05-09T09:53:13.118463+0000","last_became_peered":"2024-05-09T09:53:13.118463+0000","last_unstale":"2024-05-09T09:53:18.953892+0000","last_undegraded":"2024-05-09T09:53:18.953892+0000","last_fullsized":"2024-05-09T09:53:18.953892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:09.306529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159114+0000","last_change":"2024-05-09T09:53:15.156089+0000","last_active":"2024-05-09T09:53:18.159114+0000","last_peered":"2024-05-09T09:53:18.159114+0000","last_clean":"2024-05-09T09:53:18.159114+0000","last_became_active":"2024-05-09T09:53:15.153893+0000","last_became_peered":"2024-05-09T09:53:15.153893+0000","last_unstale":"2024-05-09T09:53:18.159114+0000","last_undegraded":"2024-05-09T09:53:18.159114+0000","last_fullsized":"2024-05-09T09:53:18.159114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:27:53.403158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158345+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:53:18.158345+0000","last_peered":"2024-05-09T09:53:18.158345+0000","last_clean":"2024-05-09T09:53:18.158345+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:53:18.158345+0000","last_undegraded":"2024-05-09T09:53:18.158345+0000","last_fullsized":"2024-05-09T09:53:18.158345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162809+0000","last_change":"2024-05-09T09:53:09.113086+0000","last_active":"2024-05-09T09:53:18.162809+0000","last_peered":"2024-05-09T09:53:18.162809+0000","last_clean":"2024-05-09T09:53:18.162809+0000","last_became_active":"2024-05-09T09:53:09.112715+0000","last_became_peered":"2024-05-09T09:53:09.112715+0000","last_unstale":"2024-05-09T09:53:18.162809+0000","last_undegraded":"2024-05-09T09:53:18.162809+0000","last_fullsized":"2024-05-09T09:53:18.162809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188267+0000","last_change":"2024-05-09T09:53:07.136487+0000","last_active":"2024-05-09T09:53:18.188267+0000","last_peered":"2024-05-09T09:53:18.188267+0000","last_clean":"2024-05-09T09:53:18.188267+0000","last_became_active":"2024-05-09T09:53:07.135802+0000","last_became_peered":"2024-05-09T09:53:07.135802+0000","last_unstale":"2024-05-09T09:53:18.188267+0000","last_undegraded":"2024-05-09T09:53:18.188267+0000","last_fullsized":"2024-05-09T09:53:18.188267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.181881+0000","last_change":"2024-05-09T09:53:11.119863+0000","last_active":"2024-05-09T09:53:18.181881+0000","last_peered":"2024-05-09T09:53:18.181881+0000","last_clean":"2024-05-09T09:53:18.181881+0000","last_became_active":"2024-05-09T09:53:11.119093+0000","last_became_peered":"2024-05-09T09:53:11.119093+0000","last_unstale":"2024-05-09T09:53:18.181881+0000","last_undegraded":"2024-05-09T09:53:18.181881+0000","last_fullsized":"2024-05-09T09:53:18.181881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:27.928171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.009171+0000","last_change":"2024-05-09T09:53:13.118282+0000","last_active":"2024-05-09T09:53:19.009171+0000","last_peered":"2024-05-09T09:53:19.009171+0000","last_clean":"2024-05-09T09:53:19.009171+0000","last_became_active":"2024-05-09T09:53:13.117489+0000","last_became_peered":"2024-05-09T09:53:13.117489+0000","last_unstale":"2024-05-09T09:53:19.009171+0000","last_undegraded":"2024-05-09T09:53:19.009171+0000","last_fullsized":"2024-05-09T09:53:19.009171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:47.099353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.189317+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:53:18.189317+0000","last_peered":"2024-05-09T09:53:18.189317+0000","last_clean":"2024-05-09T09:53:18.189317+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:53:18.189317+0000","last_undegraded":"2024-05-09T09:53:18.189317+0000","last_fullsized":"2024-05-09T09:53:18.189317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158137+0000","last_change":"2024-05-09T09:53:17.265793+0000","last_active":"2024-05-09T09:53:18.158137+0000","last_peered":"2024-05-09T09:53:18.158137+0000","last_clean":"2024-05-09T09:53:18.158137+0000","last_became_active":"2024-05-09T09:53:17.265184+0000","last_became_peered":"2024-05-09T09:53:17.265184+0000","last_unstale":"2024-05-09T09:53:18.158137+0000","last_undegraded":"2024-05-09T09:53:18.158137+0000","last_fullsized":"2024-05-09T09:53:18.158137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179394+0000","last_change":"2024-05-09T09:53:09.133623+0000","last_active":"2024-05-09T09:53:18.179394+0000","last_peered":"2024-05-09T09:53:18.179394+0000","last_clean":"2024-05-09T09:53:18.179394+0000","last_became_active":"2024-05-09T09:53:09.133066+0000","last_became_peered":"2024-05-09T09:53:09.133066+0000","last_unstale":"2024-05-09T09:53:18.179394+0000","last_undegraded":"2024-05-09T09:53:18.179394+0000","last_fullsized":"2024-05-09T09:53:18.179394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:56.384209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198308+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:53:18.198308+0000","last_peered":"2024-05-09T09:53:18.198308+0000","last_clean":"2024-05-09T09:53:18.198308+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:53:18.198308+0000","last_undegraded":"2024-05-09T09:53:18.198308+0000","last_fullsized":"2024-05-09T09:53:18.198308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196069+0000","last_change":"2024-05-09T09:53:11.126737+0000","last_active":"2024-05-09T09:53:18.196069+0000","last_peered":"2024-05-09T09:53:18.196069+0000","last_clean":"2024-05-09T09:53:18.196069+0000","last_became_active":"2024-05-09T09:53:11.125702+0000","last_became_peered":"2024-05-09T09:53:11.125702+0000","last_unstale":"2024-05-09T09:53:18.196069+0000","last_undegraded":"2024-05-09T09:53:18.196069+0000","last_fullsized":"2024-05-09T09:53:18.196069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:31:04.360774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.016568+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:53:19.016568+0000","last_peered":"2024-05-09T09:53:19.016568+0000","last_clean":"2024-05-09T09:53:19.016568+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:53:19.016568+0000","last_undegraded":"2024-05-09T09:53:19.016568+0000","last_fullsized":"2024-05-09T09:53:19.016568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177894+0000","last_change":"2024-05-09T09:53:15.173857+0000","last_active":"2024-05-09T09:53:18.177894+0000","last_peered":"2024-05-09T09:53:18.177894+0000","last_clean":"2024-05-09T09:53:18.177894+0000","last_became_active":"2024-05-09T09:53:15.172351+0000","last_became_peered":"2024-05-09T09:53:15.172351+0000","last_unstale":"2024-05-09T09:53:18.177894+0000","last_undegraded":"2024-05-09T09:53:18.177894+0000","last_fullsized":"2024-05-09T09:53:18.177894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:19.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193986+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:53:18.193986+0000","last_peered":"2024-05-09T09:53:18.193986+0000","last_clean":"2024-05-09T09:53:18.193986+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:53:18.193986+0000","last_undegraded":"2024-05-09T09:53:18.193986+0000","last_fullsized":"2024-05-09T09:53:18.193986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190547+0000","last_change":"2024-05-09T09:53:07.135827+0000","last_active":"2024-05-09T09:53:18.190547+0000","last_peered":"2024-05-09T09:53:18.190547+0000","last_clean":"2024-05-09T09:53:18.190547+0000","last_became_active":"2024-05-09T09:53:07.128704+0000","last_became_peered":"2024-05-09T09:53:07.128704+0000","last_unstale":"2024-05-09T09:53:18.190547+0000","last_undegraded":"2024-05-09T09:53:18.190547+0000","last_fullsized":"2024-05-09T09:53:18.190547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:25.534970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187372+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:53:18.187372+0000","last_peered":"2024-05-09T09:53:18.187372+0000","last_clean":"2024-05-09T09:53:18.187372+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:53:18.187372+0000","last_undegraded":"2024-05-09T09:53:18.187372+0000","last_fullsized":"2024-05-09T09:53:18.187372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.116609+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:53:19.116609+0000","last_peered":"2024-05-09T09:53:19.116609+0000","last_clean":"2024-05-09T09:53:19.116609+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:53:19.116609+0000","last_undegraded":"2024-05-09T09:53:19.116609+0000","last_fullsized":"2024-05-09T09:53:19.116609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.172933+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:53:18.172933+0000","last_peered":"2024-05-09T09:53:18.172933+0000","last_clean":"2024-05-09T09:53:18.172933+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:53:18.172933+0000","last_undegraded":"2024-05-09T09:53:18.172933+0000","last_fullsized":"2024-05-09T09:53:18.172933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195662+0000","last_change":"2024-05-09T09:53:17.184389+0000","last_active":"2024-05-09T09:53:18.195662+0000","last_peered":"2024-05-09T09:53:18.195662+0000","last_clean":"2024-05-09T09:53:18.195662+0000","last_became_active":"2024-05-09T09:53:17.183559+0000","last_became_peered":"2024-05-09T09:53:17.183559+0000","last_unstale":"2024-05-09T09:53:18.195662+0000","last_undegraded":"2024-05-09T09:53:18.195662+0000","last_fullsized":"2024-05-09T09:53:18.195662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:08:02.927481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157830+0000","last_change":"2024-05-09T09:53:09.111818+0000","last_active":"2024-05-09T09:53:18.157830+0000","last_peered":"2024-05-09T09:53:18.157830+0000","last_clean":"2024-05-09T09:53:18.157830+0000","last_became_active":"2024-05-09T09:53:09.109522+0000","last_became_peered":"2024-05-09T09:53:09.109522+0000","last_unstale":"2024-05-09T09:53:18.157830+0000","last_undegraded":"2024-05-09T09:53:18.157830+0000","last_fullsized":"2024-05-09T09:53:18.157830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190694+0000","last_change":"2024-05-09T09:53:07.135896+0000","last_active":"2024-05-09T09:53:18.190694+0000","last_peered":"2024-05-09T09:53:18.190694+0000","last_clean":"2024-05-09T09:53:18.190694+0000","last_became_active":"2024-05-09T09:53:07.125300+0000","last_became_peered":"2024-05-09T09:53:07.125300+0000","last_unstale":"2024-05-09T09:53:18.190694+0000","last_undegraded":"2024-05-09T09:53:18.190694+0000","last_fullsized":"2024-05-09T09:53:18.190694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:16.207019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157489+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:53:18.157489+0000","last_peered":"2024-05-09T09:53:18.157489+0000","last_clean":"2024-05-09T09:53:18.157489+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:53:18.157489+0000","last_undegraded":"2024-05-09T09:53:18.157489+0000","last_fullsized":"2024-05-09T09:53:18.157489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.988119+0000","last_change":"2024-05-09T09:53:13.139707+0000","last_active":"2024-05-09T09:53:18.988119+0000","last_peered":"2024-05-09T09:53:18.988119+0000","last_clean":"2024-05-09T09:53:18.988119+0000","last_became_active":"2024-05-09T09:53:13.138048+0000","last_became_peered":"2024-05-09T09:53:13.138048+0000","last_unstale":"2024-05-09T09:53:18.988119+0000","last_undegraded":"2024-05-09T09:53:18.988119+0000","last_fullsized":"2024-05-09T09:53:18.988119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:54.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176870+0000","last_change":"2024-05-09T09:53:15.173268+0000","last_active":"2024-05-09T09:53:18.176870+0000","last_peered":"2024-05-09T09:53:18.176870+0000","last_clean":"2024-05-09T09:53:18.176870+0000","last_became_active":"2024-05-09T09:53:15.172435+0000","last_became_peered":"2024-05-09T09:53:15.172435+0000","last_unstale":"2024-05-09T09:53:18.176870+0000","last_undegraded":"2024-05-09T09:53:18.176870+0000","last_fullsized":"2024-05-09T09:53:18.176870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:04.426998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199225+0000","last_change":"2024-05-09T09:53:17.175344+0000","last_active":"2024-05-09T09:53:18.199225+0000","last_peered":"2024-05-09T09:53:18.199225+0000","last_clean":"2024-05-09T09:53:18.199225+0000","last_became_active":"2024-05-09T09:53:17.174638+0000","last_became_peered":"2024-05-09T09:53:17.174638+0000","last_unstale":"2024-05-09T09:53:18.199225+0000","last_undegraded":"2024-05-09T09:53:18.199225+0000","last_fullsized":"2024-05-09T09:53:18.199225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:31.976806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199266+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:53:18.199266+0000","last_peered":"2024-05-09T09:53:18.199266+0000","last_clean":"2024-05-09T09:53:18.199266+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:53:18.199266+0000","last_undegraded":"2024-05-09T09:53:18.199266+0000","last_fullsized":"2024-05-09T09:53:18.199266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190364+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:53:18.190364+0000","last_peered":"2024-05-09T09:53:18.190364+0000","last_clean":"2024-05-09T09:53:18.190364+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:53:18.190364+0000","last_undegraded":"2024-05-09T09:53:18.190364+0000","last_fullsized":"2024-05-09T09:53:18.190364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160478+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:53:18.160478+0000","last_peered":"2024-05-09T09:53:18.160478+0000","last_clean":"2024-05-09T09:53:18.160478+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:53:18.160478+0000","last_undegraded":"2024-05-09T09:53:18.160478+0000","last_fullsized":"2024-05-09T09:53:18.160478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.905109+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:53:18.905109+0000","last_peered":"2024-05-09T09:53:18.905109+0000","last_clean":"2024-05-09T09:53:18.905109+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:53:18.905109+0000","last_undegraded":"2024-05-09T09:53:18.905109+0000","last_fullsized":"2024-05-09T09:53:18.905109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157221+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:53:18.157221+0000","last_peered":"2024-05-09T09:53:18.157221+0000","last_clean":"2024-05-09T09:53:18.157221+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:53:18.157221+0000","last_undegraded":"2024-05-09T09:53:18.157221+0000","last_fullsized":"2024-05-09T09:53:18.157221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161607+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:53:18.161607+0000","last_peered":"2024-05-09T09:53:18.161607+0000","last_clean":"2024-05-09T09:53:18.161607+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:53:18.161607+0000","last_undegraded":"2024-05-09T09:53:18.161607+0000","last_fullsized":"2024-05-09T09:53:18.161607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159862+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:53:18.159862+0000","last_peered":"2024-05-09T09:53:18.159862+0000","last_clean":"2024-05-09T09:53:18.159862+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:53:18.159862+0000","last_undegraded":"2024-05-09T09:53:18.159862+0000","last_fullsized":"2024-05-09T09:53:18.159862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196585+0000","last_change":"2024-05-09T09:53:07.121861+0000","last_active":"2024-05-09T09:53:18.196585+0000","last_peered":"2024-05-09T09:53:18.196585+0000","last_clean":"2024-05-09T09:53:18.196585+0000","last_became_active":"2024-05-09T09:53:07.117776+0000","last_became_peered":"2024-05-09T09:53:07.117776+0000","last_unstale":"2024-05-09T09:53:18.196585+0000","last_undegraded":"2024-05-09T09:53:18.196585+0000","last_fullsized":"2024-05-09T09:53:18.196585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:31.804009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159048+0000","last_change":"2024-05-09T09:53:11.112340+0000","last_active":"2024-05-09T09:53:18.159048+0000","last_peered":"2024-05-09T09:53:18.159048+0000","last_clean":"2024-05-09T09:53:18.159048+0000","last_became_active":"2024-05-09T09:53:11.111795+0000","last_became_peered":"2024-05-09T09:53:11.111795+0000","last_unstale":"2024-05-09T09:53:18.159048+0000","last_undegraded":"2024-05-09T09:53:18.159048+0000","last_fullsized":"2024-05-09T09:53:18.159048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:20.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.524654+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:53:18.524654+0000","last_peered":"2024-05-09T09:53:18.524654+0000","last_clean":"2024-05-09T09:53:18.524654+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:53:18.524654+0000","last_undegraded":"2024-05-09T09:53:18.524654+0000","last_fullsized":"2024-05-09T09:53:18.524654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157081+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:53:18.157081+0000","last_peered":"2024-05-09T09:53:18.157081+0000","last_clean":"2024-05-09T09:53:18.157081+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:53:18.157081+0000","last_undegraded":"2024-05-09T09:53:18.157081+0000","last_fullsized":"2024-05-09T09:53:18.157081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173978+0000","last_change":"2024-05-09T09:53:17.180823+0000","last_active":"2024-05-09T09:53:18.173978+0000","last_peered":"2024-05-09T09:53:18.173978+0000","last_clean":"2024-05-09T09:53:18.173978+0000","last_became_active":"2024-05-09T09:53:17.180037+0000","last_became_peered":"2024-05-09T09:53:17.180037+0000","last_unstale":"2024-05-09T09:53:18.173978+0000","last_undegraded":"2024-05-09T09:53:18.173978+0000","last_fullsized":"2024-05-09T09:53:18.173978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:18.049912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159364+0000","last_change":"2024-05-09T09:53:09.110977+0000","last_active":"2024-05-09T09:53:18.159364+0000","last_peered":"2024-05-09T09:53:18.159364+0000","last_clean":"2024-05-09T09:53:18.159364+0000","last_became_active":"2024-05-09T09:53:09.110195+0000","last_became_peered":"2024-05-09T09:53:09.110195+0000","last_unstale":"2024-05-09T09:53:18.159364+0000","last_undegraded":"2024-05-09T09:53:18.159364+0000","last_fullsized":"2024-05-09T09:53:18.159364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:56.384209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177731+0000","last_change":"2024-05-09T09:53:07.104902+0000","last_active":"2024-05-09T09:53:18.177731+0000","last_peered":"2024-05-09T09:53:18.177731+0000","last_clean":"2024-05-09T09:53:18.177731+0000","last_became_active":"2024-05-09T09:53:07.102780+0000","last_became_peered":"2024-05-09T09:53:07.102780+0000","last_unstale":"2024-05-09T09:53:18.177731+0000","last_undegraded":"2024-05-09T09:53:18.177731+0000","last_fullsized":"2024-05-09T09:53:18.177731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160244+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:53:18.160244+0000","last_peered":"2024-05-09T09:53:18.160244+0000","last_clean":"2024-05-09T09:53:18.160244+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:53:18.160244+0000","last_undegraded":"2024-05-09T09:53:18.160244+0000","last_fullsized":"2024-05-09T09:53:18.160244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.053418+0000","last_change":"2024-05-09T09:53:13.132125+0000","last_active":"2024-05-09T09:53:19.053418+0000","last_peered":"2024-05-09T09:53:19.053418+0000","last_clean":"2024-05-09T09:53:19.053418+0000","last_became_active":"2024-05-09T09:53:13.131342+0000","last_became_peered":"2024-05-09T09:53:13.131342+0000","last_unstale":"2024-05-09T09:53:19.053418+0000","last_undegraded":"2024-05-09T09:53:19.053418+0000","last_fullsized":"2024-05-09T09:53:19.053418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:38.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161807+0000","last_change":"2024-05-09T09:53:15.165179+0000","last_active":"2024-05-09T09:53:18.161807+0000","last_peered":"2024-05-09T09:53:18.161807+0000","last_clean":"2024-05-09T09:53:18.161807+0000","last_became_active":"2024-05-09T09:53:15.164441+0000","last_became_peered":"2024-05-09T09:53:15.164441+0000","last_unstale":"2024-05-09T09:53:18.161807+0000","last_undegraded":"2024-05-09T09:53:18.161807+0000","last_fullsized":"2024-05-09T09:53:18.161807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:48.243582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176666+0000","last_change":"2024-05-09T09:53:17.191808+0000","last_active":"2024-05-09T09:53:18.176666+0000","last_peered":"2024-05-09T09:53:18.176666+0000","last_clean":"2024-05-09T09:53:18.176666+0000","last_became_active":"2024-05-09T09:53:17.191148+0000","last_became_peered":"2024-05-09T09:53:17.191148+0000","last_unstale":"2024-05-09T09:53:18.176666+0000","last_undegraded":"2024-05-09T09:53:18.176666+0000","last_fullsized":"2024-05-09T09:53:18.176666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:36.468016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159943+0000","last_change":"2024-05-09T09:53:09.139251+0000","last_active":"2024-05-09T09:53:18.159943+0000","last_peered":"2024-05-09T09:53:18.159943+0000","last_clean":"2024-05-09T09:53:18.159943+0000","last_became_active":"2024-05-09T09:53:09.130281+0000","last_became_peered":"2024-05-09T09:53:09.130281+0000","last_unstale":"2024-05-09T09:53:18.159943+0000","last_undegraded":"2024-05-09T09:53:18.159943+0000","last_fullsized":"2024-05-09T09:53:18.159943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:00.152062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199522+0000","last_change":"2024-05-09T09:53:07.133846+0000","last_active":"2024-05-09T09:53:18.199522+0000","last_peered":"2024-05-09T09:53:18.199522+0000","last_clean":"2024-05-09T09:53:18.199522+0000","last_became_active":"2024-05-09T09:53:07.113499+0000","last_became_peered":"2024-05-09T09:53:07.113499+0000","last_unstale":"2024-05-09T09:53:18.199522+0000","last_undegraded":"2024-05-09T09:53:18.199522+0000","last_fullsized":"2024-05-09T09:53:18.199522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173434+0000","last_change":"2024-05-09T09:53:11.134003+0000","last_active":"2024-05-09T09:53:18.173434+0000","last_peered":"2024-05-09T09:53:18.173434+0000","last_clean":"2024-05-09T09:53:18.173434+0000","last_became_active":"2024-05-09T09:53:11.133283+0000","last_became_peered":"2024-05-09T09:53:11.133283+0000","last_unstale":"2024-05-09T09:53:18.173434+0000","last_undegraded":"2024-05-09T09:53:18.173434+0000","last_fullsized":"2024-05-09T09:53:18.173434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:35.361627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.123341+0000","last_change":"2024-05-09T09:53:13.139144+0000","last_active":"2024-05-09T09:53:19.123341+0000","last_peered":"2024-05-09T09:53:19.123341+0000","last_clean":"2024-05-09T09:53:19.123341+0000","last_became_active":"2024-05-09T09:53:13.138683+0000","last_became_peered":"2024-05-09T09:53:13.138683+0000","last_unstale":"2024-05-09T09:53:19.123341+0000","last_undegraded":"2024-05-09T09:53:19.123341+0000","last_fullsized":"2024-05-09T09:53:19.123341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:36.290227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161441+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:53:18.161441+0000","last_peered":"2024-05-09T09:53:18.161441+0000","last_clean":"2024-05-09T09:53:18.161441+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:53:18.161441+0000","last_undegraded":"2024-05-09T09:53:18.161441+0000","last_fullsized":"2024-05-09T09:53:18.161441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174025+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:53:18.174025+0000","last_peered":"2024-05-09T09:53:18.174025+0000","last_clean":"2024-05-09T09:53:18.174025+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:53:18.174025+0000","last_undegraded":"2024-05-09T09:53:18.174025+0000","last_fullsized":"2024-05-09T09:53:18.174025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160035+0000","last_change":"2024-05-09T09:53:09.130551+0000","last_active":"2024-05-09T09:53:18.160035+0000","last_peered":"2024-05-09T09:53:18.160035+0000","last_clean":"2024-05-09T09:53:18.160035+0000","last_became_active":"2024-05-09T09:53:09.122070+0000","last_became_peered":"2024-05-09T09:53:09.122070+0000","last_unstale":"2024-05-09T09:53:18.160035+0000","last_undegraded":"2024-05-09T09:53:18.160035+0000","last_fullsized":"2024-05-09T09:53:18.160035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:33.354661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158725+0000","last_change":"2024-05-09T09:53:07.095615+0000","last_active":"2024-05-09T09:53:18.158725+0000","last_peered":"2024-05-09T09:53:18.158725+0000","last_clean":"2024-05-09T09:53:18.158725+0000","last_became_active":"2024-05-09T09:53:07.093416+0000","last_became_peered":"2024-05-09T09:53:07.093416+0000","last_unstale":"2024-05-09T09:53:18.158725+0000","last_undegraded":"2024-05-09T09:53:18.158725+0000","last_fullsized":"2024-05-09T09:53:18.158725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:52:49.886746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196669+0000","last_change":"2024-05-09T09:53:11.126527+0000","last_active":"2024-05-09T09:53:18.196669+0000","last_peered":"2024-05-09T09:53:18.196669+0000","last_clean":"2024-05-09T09:53:18.196669+0000","last_became_active":"2024-05-09T09:53:11.125760+0000","last_became_peered":"2024-05-09T09:53:11.125760+0000","last_unstale":"2024-05-09T09:53:18.196669+0000","last_undegraded":"2024-05-09T09:53:18.196669+0000","last_fullsized":"2024-05-09T09:53:18.196669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:16.811609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.911919+0000","last_change":"2024-05-09T09:53:13.149070+0000","last_active":"2024-05-09T09:53:18.911919+0000","last_peered":"2024-05-09T09:53:18.911919+0000","last_clean":"2024-05-09T09:53:18.911919+0000","last_became_active":"2024-05-09T09:53:13.148617+0000","last_became_peered":"2024-05-09T09:53:13.148617+0000","last_unstale":"2024-05-09T09:53:18.911919+0000","last_undegraded":"2024-05-09T09:53:18.911919+0000","last_fullsized":"2024-05-09T09:53:18.911919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:38.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199376+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:53:18.199376+0000","last_peered":"2024-05-09T09:53:18.199376+0000","last_clean":"2024-05-09T09:53:18.199376+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:53:18.199376+0000","last_undegraded":"2024-05-09T09:53:18.199376+0000","last_fullsized":"2024-05-09T09:53:18.199376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158136+0000","last_change":"2024-05-09T09:53:17.174559+0000","last_active":"2024-05-09T09:53:18.158136+0000","last_peered":"2024-05-09T09:53:18.158136+0000","last_clean":"2024-05-09T09:53:18.158136+0000","last_became_active":"2024-05-09T09:53:17.173755+0000","last_became_peered":"2024-05-09T09:53:17.173755+0000","last_unstale":"2024-05-09T09:53:18.158136+0000","last_undegraded":"2024-05-09T09:53:18.158136+0000","last_fullsized":"2024-05-09T09:53:18.158136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:06.446660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174301+0000","last_change":"2024-05-09T09:53:09.110661+0000","last_active":"2024-05-09T09:53:18.174301+0000","last_peered":"2024-05-09T09:53:18.174301+0000","last_clean":"2024-05-09T09:53:18.174301+0000","last_became_active":"2024-05-09T09:53:09.110341+0000","last_became_peered":"2024-05-09T09:53:09.110341+0000","last_unstale":"2024-05-09T09:53:18.174301+0000","last_undegraded":"2024-05-09T09:53:18.174301+0000","last_fullsized":"2024-05-09T09:53:18.174301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177608+0000","last_change":"2024-05-09T09:53:07.106510+0000","last_active":"2024-05-09T09:53:18.177608+0000","last_peered":"2024-05-09T09:53:18.177608+0000","last_clean":"2024-05-09T09:53:18.177608+0000","last_became_active":"2024-05-09T09:53:07.106159+0000","last_became_peered":"2024-05-09T09:53:07.106159+0000","last_unstale":"2024-05-09T09:53:18.177608+0000","last_undegraded":"2024-05-09T09:53:18.177608+0000","last_fullsized":"2024-05-09T09:53:18.177608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159732+0000","last_change":"2024-05-09T09:53:11.126762+0000","last_active":"2024-05-09T09:53:18.159732+0000","last_peered":"2024-05-09T09:53:18.159732+0000","last_clean":"2024-05-09T09:53:18.159732+0000","last_became_active":"2024-05-09T09:53:11.126031+0000","last_became_peered":"2024-05-09T09:53:11.126031+0000","last_unstale":"2024-05-09T09:53:18.159732+0000","last_undegraded":"2024-05-09T09:53:18.159732+0000","last_fullsized":"2024-05-09T09:53:18.159732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:27.928171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.045502+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:53:19.045502+0000","last_peered":"2024-05-09T09:53:19.045502+0000","last_clean":"2024-05-09T09:53:19.045502+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:53:19.045502+0000","last_undegraded":"2024-05-09T09:53:19.045502+0000","last_fullsized":"2024-05-09T09:53:19.045502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198702+0000","last_change":"2024-05-09T09:53:15.172479+0000","last_active":"2024-05-09T09:53:18.198702+0000","last_peered":"2024-05-09T09:53:18.198702+0000","last_clean":"2024-05-09T09:53:18.198702+0000","last_became_active":"2024-05-09T09:53:15.171668+0000","last_became_peered":"2024-05-09T09:53:15.171668+0000","last_unstale":"2024-05-09T09:53:18.198702+0000","last_undegraded":"2024-05-09T09:53:18.198702+0000","last_fullsized":"2024-05-09T09:53:18.198702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:10.247676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174836+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:53:18.174836+0000","last_peered":"2024-05-09T09:53:18.174836+0000","last_clean":"2024-05-09T09:53:18.174836+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:53:18.174836+0000","last_undegraded":"2024-05-09T09:53:18.174836+0000","last_fullsized":"2024-05-09T09:53:18.174836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199885+0000","last_change":"2024-05-09T09:53:09.141991+0000","last_active":"2024-05-09T09:53:18.199885+0000","last_peered":"2024-05-09T09:53:18.199885+0000","last_clean":"2024-05-09T09:53:18.199885+0000","last_became_active":"2024-05-09T09:53:09.141226+0000","last_became_peered":"2024-05-09T09:53:09.141226+0000","last_unstale":"2024-05-09T09:53:18.199885+0000","last_undegraded":"2024-05-09T09:53:18.199885+0000","last_fullsized":"2024-05-09T09:53:18.199885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:18.218867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188237+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:53:18.188237+0000","last_peered":"2024-05-09T09:53:18.188237+0000","last_clean":"2024-05-09T09:53:18.188237+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:53:18.188237+0000","last_undegraded":"2024-05-09T09:53:18.188237+0000","last_fullsized":"2024-05-09T09:53:18.188237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195030+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:53:18.195030+0000","last_peered":"2024-05-09T09:53:18.195030+0000","last_clean":"2024-05-09T09:53:18.195030+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:53:18.195030+0000","last_undegraded":"2024-05-09T09:53:18.195030+0000","last_fullsized":"2024-05-09T09:53:18.195030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177496+0000","last_change":"2024-05-09T09:53:07.133344+0000","last_active":"2024-05-09T09:53:18.177496+0000","last_peered":"2024-05-09T09:53:18.177496+0000","last_clean":"2024-05-09T09:53:18.177496+0000","last_became_active":"2024-05-09T09:53:07.132983+0000","last_became_peered":"2024-05-09T09:53:07.132983+0000","last_unstale":"2024-05-09T09:53:18.177496+0000","last_undegraded":"2024-05-09T09:53:18.177496+0000","last_fullsized":"2024-05-09T09:53:18.177496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188957+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:53:18.188957+0000","last_peered":"2024-05-09T09:53:18.188957+0000","last_clean":"2024-05-09T09:53:18.188957+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:53:18.188957+0000","last_undegraded":"2024-05-09T09:53:18.188957+0000","last_fullsized":"2024-05-09T09:53:18.188957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.839825+0000","last_change":"2024-05-09T09:53:13.142914+0000","last_active":"2024-05-09T09:53:18.839825+0000","last_peered":"2024-05-09T09:53:18.839825+0000","last_clean":"2024-05-09T09:53:18.839825+0000","last_became_active":"2024-05-09T09:53:13.142158+0000","last_became_peered":"2024-05-09T09:53:13.142158+0000","last_unstale":"2024-05-09T09:53:18.839825+0000","last_undegraded":"2024-05-09T09:53:18.839825+0000","last_fullsized":"2024-05-09T09:53:18.839825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:07:08.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161748+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:53:18.161748+0000","last_peered":"2024-05-09T09:53:18.161748+0000","last_clean":"2024-05-09T09:53:18.161748+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:53:18.161748+0000","last_undegraded":"2024-05-09T09:53:18.161748+0000","last_fullsized":"2024-05-09T09:53:18.161748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198289+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:53:18.198289+0000","last_peered":"2024-05-09T09:53:18.198289+0000","last_clean":"2024-05-09T09:53:18.198289+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:53:18.198289+0000","last_undegraded":"2024-05-09T09:53:18.198289+0000","last_fullsized":"2024-05-09T09:53:18.198289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162498+0000","last_change":"2024-05-09T09:53:09.099651+0000","last_active":"2024-05-09T09:53:18.162498+0000","last_peered":"2024-05-09T09:53:18.162498+0000","last_clean":"2024-05-09T09:53:18.162498+0000","last_became_active":"2024-05-09T09:53:09.099348+0000","last_became_peered":"2024-05-09T09:53:09.099348+0000","last_unstale":"2024-05-09T09:53:18.162498+0000","last_undegraded":"2024-05-09T09:53:18.162498+0000","last_fullsized":"2024-05-09T09:53:18.162498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187722+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:53:18.187722+0000","last_peered":"2024-05-09T09:53:18.187722+0000","last_clean":"2024-05-09T09:53:18.187722+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:53:18.187722+0000","last_undegraded":"2024-05-09T09:53:18.187722+0000","last_fullsized":"2024-05-09T09:53:18.187722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157738+0000","last_change":"2024-05-09T09:53:07.091272+0000","last_active":"2024-05-09T09:53:18.157738+0000","last_peered":"2024-05-09T09:53:18.157738+0000","last_clean":"2024-05-09T09:53:18.157738+0000","last_became_active":"2024-05-09T09:53:07.090605+0000","last_became_peered":"2024-05-09T09:53:07.090605+0000","last_unstale":"2024-05-09T09:53:18.157738+0000","last_undegraded":"2024-05-09T09:53:18.157738+0000","last_fullsized":"2024-05-09T09:53:18.157738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.197396+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:53:18.197396+0000","last_peered":"2024-05-09T09:53:18.197396+0000","last_clean":"2024-05-09T09:53:18.197396+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:53:18.197396+0000","last_undegraded":"2024-05-09T09:53:18.197396+0000","last_fullsized":"2024-05-09T09:53:18.197396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.030105+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:53:19.030105+0000","last_peered":"2024-05-09T09:53:19.030105+0000","last_clean":"2024-05-09T09:53:19.030105+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:53:19.030105+0000","last_undegraded":"2024-05-09T09:53:19.030105+0000","last_fullsized":"2024-05-09T09:53:19.030105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.189510+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:53:18.189510+0000","last_peered":"2024-05-09T09:53:18.189510+0000","last_clean":"2024-05-09T09:53:18.189510+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:53:18.189510+0000","last_undegraded":"2024-05-09T09:53:18.189510+0000","last_fullsized":"2024-05-09T09:53:18.189510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.175218+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:53:18.175218+0000","last_peered":"2024-05-09T09:53:18.175218+0000","last_clean":"2024-05-09T09:53:18.175218+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:53:18.175218+0000","last_undegraded":"2024-05-09T09:53:18.175218+0000","last_fullsized":"2024-05-09T09:53:18.175218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176318+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:53:18.176318+0000","last_peered":"2024-05-09T09:53:18.176318+0000","last_clean":"2024-05-09T09:53:18.176318+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:53:18.176318+0000","last_undegraded":"2024-05-09T09:53:18.176318+0000","last_fullsized":"2024-05-09T09:53:18.176318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157884+0000","last_change":"2024-05-09T09:53:01.049359+0000","last_active":"2024-05-09T09:53:18.157884+0000","last_peered":"2024-05-09T09:53:18.157884+0000","last_clean":"2024-05-09T09:53:18.157884+0000","last_became_active":"2024-05-09T09:53:01.048940+0000","last_became_peered":"2024-05-09T09:53:01.048940+0000","last_unstale":"2024-05-09T09:53:18.157884+0000","last_undegraded":"2024-05-09T09:53:18.157884+0000","last_fullsized":"2024-05-09T09:53:18.157884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.172901+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:53:18.172901+0000","last_peered":"2024-05-09T09:53:18.172901+0000","last_clean":"2024-05-09T09:53:18.172901+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:53:18.172901+0000","last_undegraded":"2024-05-09T09:53:18.172901+0000","last_fullsized":"2024-05-09T09:53:18.172901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161508+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:53:18.161508+0000","last_peered":"2024-05-09T09:53:18.161508+0000","last_clean":"2024-05-09T09:53:18.161508+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:53:18.161508+0000","last_undegraded":"2024-05-09T09:53:18.161508+0000","last_fullsized":"2024-05-09T09:53:18.161508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.037635+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:53:19.037635+0000","last_peered":"2024-05-09T09:53:19.037635+0000","last_clean":"2024-05-09T09:53:19.037635+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:53:19.037635+0000","last_undegraded":"2024-05-09T09:53:19.037635+0000","last_fullsized":"2024-05-09T09:53:19.037635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159024+0000","last_change":"2024-05-09T09:53:15.161561+0000","last_active":"2024-05-09T09:53:18.159024+0000","last_peered":"2024-05-09T09:53:18.159024+0000","last_clean":"2024-05-09T09:53:18.159024+0000","last_became_active":"2024-05-09T09:53:15.161099+0000","last_became_peered":"2024-05-09T09:53:15.161099+0000","last_unstale":"2024-05-09T09:53:18.159024+0000","last_undegraded":"2024-05-09T09:53:18.159024+0000","last_fullsized":"2024-05-09T09:53:18.159024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:27:53.403158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178657+0000","last_change":"2024-05-09T09:53:17.188095+0000","last_active":"2024-05-09T09:53:18.178657+0000","last_peered":"2024-05-09T09:53:18.178657+0000","last_clean":"2024-05-09T09:53:18.178657+0000","last_became_active":"2024-05-09T09:53:17.187373+0000","last_became_peered":"2024-05-09T09:53:17.187373+0000","last_unstale":"2024-05-09T09:53:18.178657+0000","last_undegraded":"2024-05-09T09:53:18.178657+0000","last_fullsized":"2024-05-09T09:53:18.178657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:11:25.096957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174027+0000","last_change":"2024-05-09T09:53:09.108330+0000","last_active":"2024-05-09T09:53:18.174027+0000","last_peered":"2024-05-09T09:53:18.174027+0000","last_clean":"2024-05-09T09:53:18.174027+0000","last_became_active":"2024-05-09T09:53:09.107980+0000","last_became_peered":"2024-05-09T09:53:09.107980+0000","last_unstale":"2024-05-09T09:53:18.174027+0000","last_undegraded":"2024-05-09T09:53:18.174027+0000","last_fullsized":"2024-05-09T09:53:18.174027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194747+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:53:18.194747+0000","last_peered":"2024-05-09T09:53:18.194747+0000","last_clean":"2024-05-09T09:53:18.194747+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:53:18.194747+0000","last_undegraded":"2024-05-09T09:53:18.194747+0000","last_fullsized":"2024-05-09T09:53:18.194747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159180+0000","last_change":"2024-05-09T09:53:07.099317+0000","last_active":"2024-05-09T09:53:18.159180+0000","last_peered":"2024-05-09T09:53:18.159180+0000","last_clean":"2024-05-09T09:53:18.159180+0000","last_became_active":"2024-05-09T09:53:07.098599+0000","last_became_peered":"2024-05-09T09:53:07.098599+0000","last_unstale":"2024-05-09T09:53:18.159180+0000","last_undegraded":"2024-05-09T09:53:18.159180+0000","last_fullsized":"2024-05-09T09:53:18.159180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:06.786227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159130+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:53:18.159130+0000","last_peered":"2024-05-09T09:53:18.159130+0000","last_clean":"2024-05-09T09:53:18.159130+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:53:18.159130+0000","last_undegraded":"2024-05-09T09:53:18.159130+0000","last_fullsized":"2024-05-09T09:53:18.159130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.875157+0000","last_change":"2024-05-09T09:53:13.138267+0000","last_active":"2024-05-09T09:53:18.875157+0000","last_peered":"2024-05-09T09:53:18.875157+0000","last_clean":"2024-05-09T09:53:18.875157+0000","last_became_active":"2024-05-09T09:53:13.137178+0000","last_became_peered":"2024-05-09T09:53:13.137178+0000","last_unstale":"2024-05-09T09:53:18.875157+0000","last_undegraded":"2024-05-09T09:53:18.875157+0000","last_fullsized":"2024-05-09T09:53:18.875157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:13.011553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199992+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:53:18.199992+0000","last_peered":"2024-05-09T09:53:18.199992+0000","last_clean":"2024-05-09T09:53:18.199992+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:53:18.199992+0000","last_undegraded":"2024-05-09T09:53:18.199992+0000","last_fullsized":"2024-05-09T09:53:18.199992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193418+0000","last_change":"2024-05-09T09:53:17.191919+0000","last_active":"2024-05-09T09:53:18.193418+0000","last_peered":"2024-05-09T09:53:18.193418+0000","last_clean":"2024-05-09T09:53:18.193418+0000","last_became_active":"2024-05-09T09:53:17.191273+0000","last_became_peered":"2024-05-09T09:53:17.191273+0000","last_unstale":"2024-05-09T09:53:18.193418+0000","last_undegraded":"2024-05-09T09:53:18.193418+0000","last_fullsized":"2024-05-09T09:53:18.193418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:41:14.437931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174951+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:53:18.174951+0000","last_peered":"2024-05-09T09:53:18.174951+0000","last_clean":"2024-05-09T09:53:18.174951+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:53:18.174951+0000","last_undegraded":"2024-05-09T09:53:18.174951+0000","last_fullsized":"2024-05-09T09:53:18.174951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196592+0000","last_change":"2024-05-09T09:53:07.117502+0000","last_active":"2024-05-09T09:53:18.196592+0000","last_peered":"2024-05-09T09:53:18.196592+0000","last_clean":"2024-05-09T09:53:18.196592+0000","last_became_active":"2024-05-09T09:53:07.116656+0000","last_became_peered":"2024-05-09T09:53:07.116656+0000","last_unstale":"2024-05-09T09:53:18.196592+0000","last_undegraded":"2024-05-09T09:53:18.196592+0000","last_fullsized":"2024-05-09T09:53:18.196592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:36.827054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174646+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:53:18.174646+0000","last_peered":"2024-05-09T09:53:18.174646+0000","last_clean":"2024-05-09T09:53:18.174646+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:53:18.174646+0000","last_undegraded":"2024-05-09T09:53:18.174646+0000","last_fullsized":"2024-05-09T09:53:18.174646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158674+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:53:18.158674+0000","last_peered":"2024-05-09T09:53:18.158674+0000","last_clean":"2024-05-09T09:53:18.158674+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:53:18.158674+0000","last_undegraded":"2024-05-09T09:53:18.158674+0000","last_fullsized":"2024-05-09T09:53:18.158674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.966972+0000","last_change":"2024-05-09T09:53:13.138657+0000","last_active":"2024-05-09T09:53:18.966972+0000","last_peered":"2024-05-09T09:53:18.966972+0000","last_clean":"2024-05-09T09:53:18.966972+0000","last_became_active":"2024-05-09T09:53:13.138098+0000","last_became_peered":"2024-05-09T09:53:13.138098+0000","last_unstale":"2024-05-09T09:53:18.966972+0000","last_undegraded":"2024-05-09T09:53:18.966972+0000","last_fullsized":"2024-05-09T09:53:18.966972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157186+0000","last_change":"2024-05-09T09:53:15.163197+0000","last_active":"2024-05-09T09:53:18.157186+0000","last_peered":"2024-05-09T09:53:18.157186+0000","last_clean":"2024-05-09T09:53:18.157186+0000","last_became_active":"2024-05-09T09:53:15.162455+0000","last_became_peered":"2024-05-09T09:53:15.162455+0000","last_unstale":"2024-05-09T09:53:18.157186+0000","last_undegraded":"2024-05-09T09:53:18.157186+0000","last_fullsized":"2024-05-09T09:53:18.157186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160927+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:53:18.160927+0000","last_peered":"2024-05-09T09:53:18.160927+0000","last_clean":"2024-05-09T09:53:18.160927+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:53:18.160927+0000","last_undegraded":"2024-05-09T09:53:18.160927+0000","last_fullsized":"2024-05-09T09:53:18.160927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159620+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:53:18.159620+0000","last_peered":"2024-05-09T09:53:18.159620+0000","last_clean":"2024-05-09T09:53:18.159620+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:53:18.159620+0000","last_undegraded":"2024-05-09T09:53:18.159620+0000","last_fullsized":"2024-05-09T09:53:18.159620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174131+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:53:18.174131+0000","last_peered":"2024-05-09T09:53:18.174131+0000","last_clean":"2024-05-09T09:53:18.174131+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:53:18.174131+0000","last_undegraded":"2024-05-09T09:53:18.174131+0000","last_fullsized":"2024-05-09T09:53:18.174131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190558+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:53:18.190558+0000","last_peered":"2024-05-09T09:53:18.190558+0000","last_clean":"2024-05-09T09:53:18.190558+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:53:18.190558+0000","last_undegraded":"2024-05-09T09:53:18.190558+0000","last_fullsized":"2024-05-09T09:53:18.190558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198746+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:53:18.198746+0000","last_peered":"2024-05-09T09:53:18.198746+0000","last_clean":"2024-05-09T09:53:18.198746+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:53:18.198746+0000","last_undegraded":"2024-05-09T09:53:18.198746+0000","last_fullsized":"2024-05-09T09:53:18.198746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.067216+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:53:19.067216+0000","last_peered":"2024-05-09T09:53:19.067216+0000","last_clean":"2024-05-09T09:53:19.067216+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:53:19.067216+0000","last_undegraded":"2024-05-09T09:53:19.067216+0000","last_fullsized":"2024-05-09T09:53:19.067216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193683+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:53:18.193683+0000","last_peered":"2024-05-09T09:53:18.193683+0000","last_clean":"2024-05-09T09:53:18.193683+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:53:18.193683+0000","last_undegraded":"2024-05-09T09:53:18.193683+0000","last_fullsized":"2024-05-09T09:53:18.193683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179971+0000","last_change":"2024-05-09T09:53:17.266084+0000","last_active":"2024-05-09T09:53:18.179971+0000","last_peered":"2024-05-09T09:53:18.179971+0000","last_clean":"2024-05-09T09:53:18.179971+0000","last_became_active":"2024-05-09T09:53:17.265259+0000","last_became_peered":"2024-05-09T09:53:17.265259+0000","last_unstale":"2024-05-09T09:53:18.179971+0000","last_undegraded":"2024-05-09T09:53:18.179971+0000","last_fullsized":"2024-05-09T09:53:18.179971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:37.896643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177093+0000","last_change":"2024-05-09T09:53:09.126588+0000","last_active":"2024-05-09T09:53:18.177093+0000","last_peered":"2024-05-09T09:53:18.177093+0000","last_clean":"2024-05-09T09:53:18.177093+0000","last_became_active":"2024-05-09T09:53:09.126306+0000","last_became_peered":"2024-05-09T09:53:09.126306+0000","last_unstale":"2024-05-09T09:53:18.177093+0000","last_undegraded":"2024-05-09T09:53:18.177093+0000","last_fullsized":"2024-05-09T09:53:18.177093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178961+0000","last_change":"2024-05-09T09:53:07.126817+0000","last_active":"2024-05-09T09:53:18.178961+0000","last_peered":"2024-05-09T09:53:18.178961+0000","last_clean":"2024-05-09T09:53:18.178961+0000","last_became_active":"2024-05-09T09:53:07.126401+0000","last_became_peered":"2024-05-09T09:53:07.126401+0000","last_unstale":"2024-05-09T09:53:18.178961+0000","last_undegraded":"2024-05-09T09:53:18.178961+0000","last_fullsized":"2024-05-09T09:53:18.178961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174497+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:53:18.174497+0000","last_peered":"2024-05-09T09:53:18.174497+0000","last_clean":"2024-05-09T09:53:18.174497+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:53:18.174497+0000","last_undegraded":"2024-05-09T09:53:18.174497+0000","last_fullsized":"2024-05-09T09:53:18.174497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157552+0000","last_change":"2024-05-09T09:53:11.124958+0000","last_active":"2024-05-09T09:53:18.157552+0000","last_peered":"2024-05-09T09:53:18.157552+0000","last_clean":"2024-05-09T09:53:18.157552+0000","last_became_active":"2024-05-09T09:53:11.123690+0000","last_became_peered":"2024-05-09T09:53:11.123690+0000","last_unstale":"2024-05-09T09:53:18.157552+0000","last_undegraded":"2024-05-09T09:53:18.157552+0000","last_fullsized":"2024-05-09T09:53:18.157552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:01.845355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.023617+0000","last_change":"2024-05-09T09:53:13.139882+0000","last_active":"2024-05-09T09:53:19.023617+0000","last_peered":"2024-05-09T09:53:19.023617+0000","last_clean":"2024-05-09T09:53:19.023617+0000","last_became_active":"2024-05-09T09:53:13.138655+0000","last_became_peered":"2024-05-09T09:53:13.138655+0000","last_unstale":"2024-05-09T09:53:19.023617+0000","last_undegraded":"2024-05-09T09:53:19.023617+0000","last_fullsized":"2024-05-09T09:53:19.023617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179893+0000","last_change":"2024-05-09T09:53:15.181187+0000","last_active":"2024-05-09T09:53:18.179893+0000","last_peered":"2024-05-09T09:53:18.179893+0000","last_clean":"2024-05-09T09:53:18.179893+0000","last_became_active":"2024-05-09T09:53:15.180486+0000","last_became_peered":"2024-05-09T09:53:15.180486+0000","last_unstale":"2024-05-09T09:53:18.179893+0000","last_undegraded":"2024-05-09T09:53:18.179893+0000","last_fullsized":"2024-05-09T09:53:18.179893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:33.941331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159424+0000","last_change":"2024-05-09T09:53:17.173663+0000","last_active":"2024-05-09T09:53:18.159424+0000","last_peered":"2024-05-09T09:53:18.159424+0000","last_clean":"2024-05-09T09:53:18.159424+0000","last_became_active":"2024-05-09T09:53:17.172903+0000","last_became_peered":"2024-05-09T09:53:17.172903+0000","last_unstale":"2024-05-09T09:53:18.159424+0000","last_undegraded":"2024-05-09T09:53:18.159424+0000","last_fullsized":"2024-05-09T09:53:18.159424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:13.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158066+0000","last_change":"2024-05-09T09:53:09.118964+0000","last_active":"2024-05-09T09:53:18.158066+0000","last_peered":"2024-05-09T09:53:18.158066+0000","last_clean":"2024-05-09T09:53:18.158066+0000","last_became_active":"2024-05-09T09:53:09.111772+0000","last_became_peered":"2024-05-09T09:53:09.111772+0000","last_unstale":"2024-05-09T09:53:18.158066+0000","last_undegraded":"2024-05-09T09:53:18.158066+0000","last_fullsized":"2024-05-09T09:53:18.158066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162766+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:53:18.162766+0000","last_peered":"2024-05-09T09:53:18.162766+0000","last_clean":"2024-05-09T09:53:18.162766+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:53:18.162766+0000","last_undegraded":"2024-05-09T09:53:18.162766+0000","last_fullsized":"2024-05-09T09:53:18.162766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200660+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:53:18.200660+0000","last_peered":"2024-05-09T09:53:18.200660+0000","last_clean":"2024-05-09T09:53:18.200660+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:53:18.200660+0000","last_undegraded":"2024-05-09T09:53:18.200660+0000","last_fullsized":"2024-05-09T09:53:18.200660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176805+0000","last_change":"2024-05-09T09:53:11.119230+0000","last_active":"2024-05-09T09:53:18.176805+0000","last_peered":"2024-05-09T09:53:18.176805+0000","last_clean":"2024-05-09T09:53:18.176805+0000","last_became_active":"2024-05-09T09:53:11.118785+0000","last_became_peered":"2024-05-09T09:53:11.118785+0000","last_unstale":"2024-05-09T09:53:18.176805+0000","last_undegraded":"2024-05-09T09:53:18.176805+0000","last_fullsized":"2024-05-09T09:53:18.176805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:01.845355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.002317+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:53:19.002317+0000","last_peered":"2024-05-09T09:53:19.002317+0000","last_clean":"2024-05-09T09:53:19.002317+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:53:19.002317+0000","last_undegraded":"2024-05-09T09:53:19.002317+0000","last_fullsized":"2024-05-09T09:53:19.002317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176879+0000","last_change":"2024-05-09T09:53:15.168489+0000","last_active":"2024-05-09T09:53:18.176879+0000","last_peered":"2024-05-09T09:53:18.176879+0000","last_clean":"2024-05-09T09:53:18.176879+0000","last_became_active":"2024-05-09T09:53:15.167829+0000","last_became_peered":"2024-05-09T09:53:15.167829+0000","last_unstale":"2024-05-09T09:53:18.176879+0000","last_undegraded":"2024-05-09T09:53:18.176879+0000","last_fullsized":"2024-05-09T09:53:18.176879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:27:00.491112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195805+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:53:18.195805+0000","last_peered":"2024-05-09T09:53:18.195805+0000","last_clean":"2024-05-09T09:53:18.195805+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:53:18.195805+0000","last_undegraded":"2024-05-09T09:53:18.195805+0000","last_fullsized":"2024-05-09T09:53:18.195805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161517+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:53:18.161517+0000","last_peered":"2024-05-09T09:53:18.161517+0000","last_clean":"2024-05-09T09:53:18.161517+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:53:18.161517+0000","last_undegraded":"2024-05-09T09:53:18.161517+0000","last_fullsized":"2024-05-09T09:53:18.161517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158093+0000","last_change":"2024-05-09T09:53:09.131427+0000","last_active":"2024-05-09T09:53:18.158093+0000","last_peered":"2024-05-09T09:53:18.158093+0000","last_clean":"2024-05-09T09:53:18.158093+0000","last_became_active":"2024-05-09T09:53:09.130677+0000","last_became_peered":"2024-05-09T09:53:09.130677+0000","last_unstale":"2024-05-09T09:53:18.158093+0000","last_undegraded":"2024-05-09T09:53:18.158093+0000","last_fullsized":"2024-05-09T09:53:18.158093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158342+0000","last_change":"2024-05-09T09:53:07.127834+0000","last_active":"2024-05-09T09:53:18.158342+0000","last_peered":"2024-05-09T09:53:18.158342+0000","last_clean":"2024-05-09T09:53:18.158342+0000","last_became_active":"2024-05-09T09:53:07.127064+0000","last_became_peered":"2024-05-09T09:53:07.127064+0000","last_unstale":"2024-05-09T09:53:18.158342+0000","last_undegraded":"2024-05-09T09:53:18.158342+0000","last_fullsized":"2024-05-09T09:53:18.158342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.175410+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:53:18.175410+0000","last_peered":"2024-05-09T09:53:18.175410+0000","last_clean":"2024-05-09T09:53:18.175410+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:53:18.175410+0000","last_undegraded":"2024-05-09T09:53:18.175410+0000","last_fullsized":"2024-05-09T09:53:18.175410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.074153+0000","last_change":"2024-05-09T09:53:13.138669+0000","last_active":"2024-05-09T09:53:19.074153+0000","last_peered":"2024-05-09T09:53:19.074153+0000","last_clean":"2024-05-09T09:53:19.074153+0000","last_became_active":"2024-05-09T09:53:13.137815+0000","last_became_peered":"2024-05-09T09:53:13.137815+0000","last_unstale":"2024-05-09T09:53:19.074153+0000","last_undegraded":"2024-05-09T09:53:19.074153+0000","last_fullsized":"2024-05-09T09:53:19.074153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:09.306529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176372+0000","last_change":"2024-05-09T09:53:15.180530+0000","last_active":"2024-05-09T09:53:18.176372+0000","last_peered":"2024-05-09T09:53:18.176372+0000","last_clean":"2024-05-09T09:53:18.176372+0000","last_became_active":"2024-05-09T09:53:15.179752+0000","last_became_peered":"2024-05-09T09:53:15.179752+0000","last_unstale":"2024-05-09T09:53:18.176372+0000","last_undegraded":"2024-05-09T09:53:18.176372+0000","last_fullsized":"2024-05-09T09:53:18.176372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:14.853148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178710+0000","last_change":"2024-05-09T09:53:17.186939+0000","last_active":"2024-05-09T09:53:18.178710+0000","last_peered":"2024-05-09T09:53:18.178710+0000","last_clean":"2024-05-09T09:53:18.178710+0000","last_became_active":"2024-05-09T09:53:17.186138+0000","last_became_peered":"2024-05-09T09:53:17.186138+0000","last_unstale":"2024-05-09T09:53:18.178710+0000","last_undegraded":"2024-05-09T09:53:18.178710+0000","last_fullsized":"2024-05-09T09:53:18.178710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:52.756156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173830+0000","last_change":"2024-05-09T09:53:09.116139+0000","last_active":"2024-05-09T09:53:18.173830+0000","last_peered":"2024-05-09T09:53:18.173830+0000","last_clean":"2024-05-09T09:53:18.173830+0000","last_became_active":"2024-05-09T09:53:09.115542+0000","last_became_peered":"2024-05-09T09:53:09.115542+0000","last_unstale":"2024-05-09T09:53:18.173830+0000","last_undegraded":"2024-05-09T09:53:18.173830+0000","last_fullsized":"2024-05-09T09:53:18.173830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:18.060153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190193+0000","last_change":"2024-05-09T09:53:07.123261+0000","last_active":"2024-05-09T09:53:18.190193+0000","last_peered":"2024-05-09T09:53:18.190193+0000","last_clean":"2024-05-09T09:53:18.190193+0000","last_became_active":"2024-05-09T09:53:07.122491+0000","last_became_peered":"2024-05-09T09:53:07.122491+0000","last_unstale":"2024-05-09T09:53:18.190193+0000","last_undegraded":"2024-05-09T09:53:18.190193+0000","last_fullsized":"2024-05-09T09:53:18.190193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:31.417620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178260+0000","last_change":"2024-05-09T09:53:11.117544+0000","last_active":"2024-05-09T09:53:18.178260+0000","last_peered":"2024-05-09T09:53:18.178260+0000","last_clean":"2024-05-09T09:53:18.178260+0000","last_became_active":"2024-05-09T09:53:11.116890+0000","last_became_peered":"2024-05-09T09:53:11.116890+0000","last_unstale":"2024-05-09T09:53:18.178260+0000","last_undegraded":"2024-05-09T09:53:18.178260+0000","last_fullsized":"2024-05-09T09:53:18.178260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:17.548338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'4","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.529895+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:53:18.529895+0000","last_peered":"2024-05-09T09:53:18.529895+0000","last_clean":"2024-05-09T09:53:18.529895+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:53:18.529895+0000","last_undegraded":"2024-05-09T09:53:18.529895+0000","last_fullsized":"2024-05-09T09:53:18.529895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187709+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:53:18.187709+0000","last_peered":"2024-05-09T09:53:18.187709+0000","last_clean":"2024-05-09T09:53:18.187709+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:53:18.187709+0000","last_undegraded":"2024-05-09T09:53:18.187709+0000","last_fullsized":"2024-05-09T09:53:18.187709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158986+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:53:18.158986+0000","last_peered":"2024-05-09T09:53:18.158986+0000","last_clean":"2024-05-09T09:53:18.158986+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:53:18.158986+0000","last_undegraded":"2024-05-09T09:53:18.158986+0000","last_fullsized":"2024-05-09T09:53:18.158986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177413+0000","last_change":"2024-05-09T09:53:09.136473+0000","last_active":"2024-05-09T09:53:18.177413+0000","last_peered":"2024-05-09T09:53:18.177413+0000","last_clean":"2024-05-09T09:53:18.177413+0000","last_became_active":"2024-05-09T09:53:09.136201+0000","last_became_peered":"2024-05-09T09:53:09.136201+0000","last_unstale":"2024-05-09T09:53:18.177413+0000","last_undegraded":"2024-05-09T09:53:18.177413+0000","last_fullsized":"2024-05-09T09:53:18.177413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.197019+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:53:18.197019+0000","last_peered":"2024-05-09T09:53:18.197019+0000","last_clean":"2024-05-09T09:53:18.197019+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:53:18.197019+0000","last_undegraded":"2024-05-09T09:53:18.197019+0000","last_fullsized":"2024-05-09T09:53:18.197019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.186978+0000","last_change":"2024-05-09T09:53:11.113491+0000","last_active":"2024-05-09T09:53:18.186978+0000","last_peered":"2024-05-09T09:53:18.186978+0000","last_clean":"2024-05-09T09:53:18.186978+0000","last_became_active":"2024-05-09T09:53:11.112773+0000","last_became_peered":"2024-05-09T09:53:11.112773+0000","last_unstale":"2024-05-09T09:53:18.186978+0000","last_undegraded":"2024-05-09T09:53:18.186978+0000","last_fullsized":"2024-05-09T09:53:18.186978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.981090+0000","last_change":"2024-05-09T09:53:13.143103+0000","last_active":"2024-05-09T09:53:18.981090+0000","last_peered":"2024-05-09T09:53:18.981090+0000","last_clean":"2024-05-09T09:53:18.981090+0000","last_became_active":"2024-05-09T09:53:13.142107+0000","last_became_peered":"2024-05-09T09:53:13.142107+0000","last_unstale":"2024-05-09T09:53:18.981090+0000","last_undegraded":"2024-05-09T09:53:18.981090+0000","last_fullsized":"2024-05-09T09:53:18.981090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:38.201518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198681+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:53:18.198681+0000","last_peered":"2024-05-09T09:53:18.198681+0000","last_clean":"2024-05-09T09:53:18.198681+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:53:18.198681+0000","last_undegraded":"2024-05-09T09:53:18.198681+0000","last_fullsized":"2024-05-09T09:53:18.198681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194149+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:53:18.194149+0000","last_peered":"2024-05-09T09:53:18.194149+0000","last_clean":"2024-05-09T09:53:18.194149+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:53:18.194149+0000","last_undegraded":"2024-05-09T09:53:18.194149+0000","last_fullsized":"2024-05-09T09:53:18.194149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177272+0000","last_change":"2024-05-09T09:53:09.113837+0000","last_active":"2024-05-09T09:53:18.177272+0000","last_peered":"2024-05-09T09:53:18.177272+0000","last_clean":"2024-05-09T09:53:18.177272+0000","last_became_active":"2024-05-09T09:53:09.113332+0000","last_became_peered":"2024-05-09T09:53:09.113332+0000","last_unstale":"2024-05-09T09:53:18.177272+0000","last_undegraded":"2024-05-09T09:53:18.177272+0000","last_fullsized":"2024-05-09T09:53:18.177272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162482+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:53:18.162482+0000","last_peered":"2024-05-09T09:53:18.162482+0000","last_clean":"2024-05-09T09:53:18.162482+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:53:18.162482+0000","last_undegraded":"2024-05-09T09:53:18.162482+0000","last_fullsized":"2024-05-09T09:53:18.162482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198590+0000","last_change":"2024-05-09T09:53:11.131068+0000","last_active":"2024-05-09T09:53:18.198590+0000","last_peered":"2024-05-09T09:53:18.198590+0000","last_clean":"2024-05-09T09:53:18.198590+0000","last_became_active":"2024-05-09T09:53:11.130286+0000","last_became_peered":"2024-05-09T09:53:11.130286+0000","last_unstale":"2024-05-09T09:53:18.198590+0000","last_undegraded":"2024-05-09T09:53:18.198590+0000","last_fullsized":"2024-05-09T09:53:18.198590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:59.197735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.754146+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:53:18.754146+0000","last_peered":"2024-05-09T09:53:18.754146+0000","last_clean":"2024-05-09T09:53:18.754146+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:53:18.754146+0000","last_undegraded":"2024-05-09T09:53:18.754146+0000","last_fullsized":"2024-05-09T09:53:18.754146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157755+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:53:18.157755+0000","last_peered":"2024-05-09T09:53:18.157755+0000","last_clean":"2024-05-09T09:53:18.157755+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:53:18.157755+0000","last_undegraded":"2024-05-09T09:53:18.157755+0000","last_fullsized":"2024-05-09T09:53:18.157755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200473+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:53:18.200473+0000","last_peered":"2024-05-09T09:53:18.200473+0000","last_clean":"2024-05-09T09:53:18.200473+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:53:18.200473+0000","last_undegraded":"2024-05-09T09:53:18.200473+0000","last_fullsized":"2024-05-09T09:53:18.200473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177536+0000","last_change":"2024-05-09T09:53:07.103925+0000","last_active":"2024-05-09T09:53:18.177536+0000","last_peered":"2024-05-09T09:53:18.177536+0000","last_clean":"2024-05-09T09:53:18.177536+0000","last_became_active":"2024-05-09T09:53:07.103470+0000","last_became_peered":"2024-05-09T09:53:07.103470+0000","last_unstale":"2024-05-09T09:53:18.177536+0000","last_undegraded":"2024-05-09T09:53:18.177536+0000","last_fullsized":"2024-05-09T09:53:18.177536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161990+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:53:18.161990+0000","last_peered":"2024-05-09T09:53:18.161990+0000","last_clean":"2024-05-09T09:53:18.161990+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:53:18.161990+0000","last_undegraded":"2024-05-09T09:53:18.161990+0000","last_fullsized":"2024-05-09T09:53:18.161990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.101722+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:53:19.101722+0000","last_peered":"2024-05-09T09:53:19.101722+0000","last_clean":"2024-05-09T09:53:19.101722+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:53:19.101722+0000","last_undegraded":"2024-05-09T09:53:19.101722+0000","last_fullsized":"2024-05-09T09:53:19.101722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195755+0000","last_change":"2024-05-09T09:53:15.165405+0000","last_active":"2024-05-09T09:53:18.195755+0000","last_peered":"2024-05-09T09:53:18.195755+0000","last_clean":"2024-05-09T09:53:18.195755+0000","last_became_active":"2024-05-09T09:53:15.164221+0000","last_became_peered":"2024-05-09T09:53:15.164221+0000","last_unstale":"2024-05-09T09:53:18.195755+0000","last_undegraded":"2024-05-09T09:53:18.195755+0000","last_fullsized":"2024-05-09T09:53:18.195755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:50.451431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177632+0000","last_change":"2024-05-09T09:53:17.269258+0000","last_active":"2024-05-09T09:53:18.177632+0000","last_peered":"2024-05-09T09:53:18.177632+0000","last_clean":"2024-05-09T09:53:18.177632+0000","last_became_active":"2024-05-09T09:53:17.268496+0000","last_became_peered":"2024-05-09T09:53:17.268496+0000","last_unstale":"2024-05-09T09:53:18.177632+0000","last_undegraded":"2024-05-09T09:53:18.177632+0000","last_fullsized":"2024-05-09T09:53:18.177632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:01.756096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162314+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:53:18.162314+0000","last_peered":"2024-05-09T09:53:18.162314+0000","last_clean":"2024-05-09T09:53:18.162314+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:53:18.162314+0000","last_undegraded":"2024-05-09T09:53:18.162314+0000","last_fullsized":"2024-05-09T09:53:18.162314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174953+0000","last_change":"2024-05-09T09:53:07.103329+0000","last_active":"2024-05-09T09:53:18.174953+0000","last_peered":"2024-05-09T09:53:18.174953+0000","last_clean":"2024-05-09T09:53:18.174953+0000","last_became_active":"2024-05-09T09:53:07.103022+0000","last_became_peered":"2024-05-09T09:53:07.103022+0000","last_unstale":"2024-05-09T09:53:18.174953+0000","last_undegraded":"2024-05-09T09:53:18.174953+0000","last_fullsized":"2024-05-09T09:53:18.174953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200240+0000","last_change":"2024-05-09T09:53:11.127978+0000","last_active":"2024-05-09T09:53:18.200240+0000","last_peered":"2024-05-09T09:53:18.200240+0000","last_clean":"2024-05-09T09:53:18.200240+0000","last_became_active":"2024-05-09T09:53:11.127238+0000","last_became_peered":"2024-05-09T09:53:11.127238+0000","last_unstale":"2024-05-09T09:53:18.200240+0000","last_undegraded":"2024-05-09T09:53:18.200240+0000","last_fullsized":"2024-05-09T09:53:18.200240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.336391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.881973+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:53:18.881973+0000","last_peered":"2024-05-09T09:53:18.881973+0000","last_clean":"2024-05-09T09:53:18.881973+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:53:18.881973+0000","last_undegraded":"2024-05-09T09:53:18.881973+0000","last_fullsized":"2024-05-09T09:53:18.881973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.175234+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:53:18.175234+0000","last_peered":"2024-05-09T09:53:18.175234+0000","last_clean":"2024-05-09T09:53:18.175234+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:53:18.175234+0000","last_undegraded":"2024-05-09T09:53:18.175234+0000","last_fullsized":"2024-05-09T09:53:18.175234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198534+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:53:18.198534+0000","last_peered":"2024-05-09T09:53:18.198534+0000","last_clean":"2024-05-09T09:53:18.198534+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:53:18.198534+0000","last_undegraded":"2024-05-09T09:53:18.198534+0000","last_fullsized":"2024-05-09T09:53:18.198534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178331+0000","last_change":"2024-05-09T09:53:09.113372+0000","last_active":"2024-05-09T09:53:18.178331+0000","last_peered":"2024-05-09T09:53:18.178331+0000","last_clean":"2024-05-09T09:53:18.178331+0000","last_became_active":"2024-05-09T09:53:09.113041+0000","last_became_peered":"2024-05-09T09:53:09.113041+0000","last_unstale":"2024-05-09T09:53:18.178331+0000","last_undegraded":"2024-05-09T09:53:18.178331+0000","last_fullsized":"2024-05-09T09:53:18.178331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:00.152062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158708+0000","last_change":"2024-05-09T09:53:07.104225+0000","last_active":"2024-05-09T09:53:18.158708+0000","last_peered":"2024-05-09T09:53:18.158708+0000","last_clean":"2024-05-09T09:53:18.158708+0000","last_became_active":"2024-05-09T09:53:07.103490+0000","last_became_peered":"2024-05-09T09:53:07.103490+0000","last_unstale":"2024-05-09T09:53:18.158708+0000","last_undegraded":"2024-05-09T09:53:18.158708+0000","last_fullsized":"2024-05-09T09:53:18.158708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:09.427100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159831+0000","last_change":"2024-05-09T09:53:11.125866+0000","last_active":"2024-05-09T09:53:18.159831+0000","last_peered":"2024-05-09T09:53:18.159831+0000","last_clean":"2024-05-09T09:53:18.159831+0000","last_became_active":"2024-05-09T09:53:11.125057+0000","last_became_peered":"2024-05-09T09:53:11.125057+0000","last_unstale":"2024-05-09T09:53:18.159831+0000","last_undegraded":"2024-05-09T09:53:18.159831+0000","last_fullsized":"2024-05-09T09:53:18.159831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:17.548338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.080751+0000","last_change":"2024-05-09T09:53:13.152997+0000","last_active":"2024-05-09T09:53:19.080751+0000","last_peered":"2024-05-09T09:53:19.080751+0000","last_clean":"2024-05-09T09:53:19.080751+0000","last_became_active":"2024-05-09T09:53:13.152490+0000","last_became_peered":"2024-05-09T09:53:13.152490+0000","last_unstale":"2024-05-09T09:53:19.080751+0000","last_undegraded":"2024-05-09T09:53:19.080751+0000","last_fullsized":"2024-05-09T09:53:19.080751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:45.449537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174430+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:53:18.174430+0000","last_peered":"2024-05-09T09:53:18.174430+0000","last_clean":"2024-05-09T09:53:18.174430+0000","last_became_active":"2024-05-09T09:53:15.167480+0000","last_became_peered":"2024-05-09T09:53:15.167480+0000","last_unstale":"2024-05-09T09:53:18.174430+0000","last_undegraded":"2024-05-09T09:53:18.174430+0000","last_fullsized":"2024-05-09T09:53:18.174430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:07.450989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193836+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:53:18.193836+0000","last_peered":"2024-05-09T09:53:18.193836+0000","last_clean":"2024-05-09T09:53:18.193836+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:53:18.193836+0000","last_undegraded":"2024-05-09T09:53:18.193836+0000","last_fullsized":"2024-05-09T09:53:18.193836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160799+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:53:18.160799+0000","last_peered":"2024-05-09T09:53:18.160799+0000","last_clean":"2024-05-09T09:53:18.160799+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:53:18.160799+0000","last_undegraded":"2024-05-09T09:53:18.160799+0000","last_fullsized":"2024-05-09T09:53:18.160799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157992+0000","last_change":"2024-05-09T09:53:07.107647+0000","last_active":"2024-05-09T09:53:18.157992+0000","last_peered":"2024-05-09T09:53:18.157992+0000","last_clean":"2024-05-09T09:53:18.157992+0000","last_became_active":"2024-05-09T09:53:07.107326+0000","last_became_peered":"2024-05-09T09:53:07.107326+0000","last_unstale":"2024-05-09T09:53:18.157992+0000","last_undegraded":"2024-05-09T09:53:18.157992+0000","last_fullsized":"2024-05-09T09:53:18.157992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.175814+0000","last_change":"2024-05-09T09:53:11.125346+0000","last_active":"2024-05-09T09:53:18.175814+0000","last_peered":"2024-05-09T09:53:18.175814+0000","last_clean":"2024-05-09T09:53:18.175814+0000","last_became_active":"2024-05-09T09:53:11.124846+0000","last_became_peered":"2024-05-09T09:53:11.124846+0000","last_unstale":"2024-05-09T09:53:18.175814+0000","last_undegraded":"2024-05-09T09:53:18.175814+0000","last_fullsized":"2024-05-09T09:53:18.175814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.060563+0000","last_change":"2024-05-09T09:53:13.150296+0000","last_active":"2024-05-09T09:53:19.060563+0000","last_peered":"2024-05-09T09:53:19.060563+0000","last_clean":"2024-05-09T09:53:19.060563+0000","last_became_active":"2024-05-09T09:53:13.149026+0000","last_became_peered":"2024-05-09T09:53:13.149026+0000","last_unstale":"2024-05-09T09:53:19.060563+0000","last_undegraded":"2024-05-09T09:53:19.060563+0000","last_fullsized":"2024-05-09T09:53:19.060563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:24.892942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"27'2","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199387+0000","last_change":"2024-05-09T09:53:15.174263+0000","last_active":"2024-05-09T09:53:18.199387+0000","last_peered":"2024-05-09T09:53:18.199387+0000","last_clean":"2024-05-09T09:53:18.199387+0000","last_became_active":"2024-05-09T09:53:15.173074+0000","last_became_peered":"2024-05-09T09:53:15.173074+0000","last_unstale":"2024-05-09T09:53:18.199387+0000","last_undegraded":"2024-05-09T09:53:18.199387+0000","last_fullsized":"2024-05-09T09:53:18.199387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:02.424004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187093+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:53:18.187093+0000","last_peered":"2024-05-09T09:53:18.187093+0000","last_clean":"2024-05-09T09:53:18.187093+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:53:18.187093+0000","last_undegraded":"2024-05-09T09:53:18.187093+0000","last_fullsized":"2024-05-09T09:53:18.187093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157873+0000","last_change":"2024-05-09T09:53:09.121084+0000","last_active":"2024-05-09T09:53:18.157873+0000","last_peered":"2024-05-09T09:53:18.157873+0000","last_clean":"2024-05-09T09:53:18.157873+0000","last_became_active":"2024-05-09T09:53:09.120348+0000","last_became_peered":"2024-05-09T09:53:09.120348+0000","last_unstale":"2024-05-09T09:53:18.157873+0000","last_undegraded":"2024-05-09T09:53:18.157873+0000","last_fullsized":"2024-05-09T09:53:18.157873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196299+0000","last_change":"2024-05-09T09:53:07.123579+0000","last_active":"2024-05-09T09:53:18.196299+0000","last_peered":"2024-05-09T09:53:18.196299+0000","last_clean":"2024-05-09T09:53:18.196299+0000","last_became_active":"2024-05-09T09:53:07.118568+0000","last_became_peered":"2024-05-09T09:53:07.118568+0000","last_unstale":"2024-05-09T09:53:18.196299+0000","last_undegraded":"2024-05-09T09:53:18.196299+0000","last_fullsized":"2024-05-09T09:53:18.196299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:14:06.373527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187642+0000","last_change":"2024-05-09T09:53:11.116337+0000","last_active":"2024-05-09T09:53:18.187642+0000","last_peered":"2024-05-09T09:53:18.187642+0000","last_clean":"2024-05-09T09:53:18.187642+0000","last_became_active":"2024-05-09T09:53:11.115610+0000","last_became_peered":"2024-05-09T09:53:11.115610+0000","last_unstale":"2024-05-09T09:53:18.187642+0000","last_undegraded":"2024-05-09T09:53:18.187642+0000","last_fullsized":"2024-05-09T09:53:18.187642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.095177+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:53:19.095177+0000","last_peered":"2024-05-09T09:53:19.095177+0000","last_clean":"2024-05-09T09:53:19.095177+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:53:19.095177+0000","last_undegraded":"2024-05-09T09:53:19.095177+0000","last_fullsized":"2024-05-09T09:53:19.095177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.156639+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:53:18.156639+0000","last_peered":"2024-05-09T09:53:18.156639+0000","last_clean":"2024-05-09T09:53:18.156639+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:53:18.156639+0000","last_undegraded":"2024-05-09T09:53:18.156639+0000","last_fullsized":"2024-05-09T09:53:18.156639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190846+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:53:18.190846+0000","last_peered":"2024-05-09T09:53:18.190846+0000","last_clean":"2024-05-09T09:53:18.190846+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:53:18.190846+0000","last_undegraded":"2024-05-09T09:53:18.190846+0000","last_fullsized":"2024-05-09T09:53:18.190846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158333+0000","last_change":"2024-05-09T09:53:09.120876+0000","last_active":"2024-05-09T09:53:18.158333+0000","last_peered":"2024-05-09T09:53:18.158333+0000","last_clean":"2024-05-09T09:53:18.158333+0000","last_became_active":"2024-05-09T09:53:09.120155+0000","last_became_peered":"2024-05-09T09:53:09.120155+0000","last_unstale":"2024-05-09T09:53:18.158333+0000","last_undegraded":"2024-05-09T09:53:18.158333+0000","last_fullsized":"2024-05-09T09:53:18.158333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196391+0000","last_change":"2024-05-09T09:53:07.121558+0000","last_active":"2024-05-09T09:53:18.196391+0000","last_peered":"2024-05-09T09:53:18.196391+0000","last_clean":"2024-05-09T09:53:18.196391+0000","last_became_active":"2024-05-09T09:53:07.118305+0000","last_became_peered":"2024-05-09T09:53:07.118305+0000","last_unstale":"2024-05-09T09:53:18.196391+0000","last_undegraded":"2024-05-09T09:53:18.196391+0000","last_fullsized":"2024-05-09T09:53:18.196391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:39.127020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194663+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:53:18.194663+0000","last_peered":"2024-05-09T09:53:18.194663+0000","last_clean":"2024-05-09T09:53:18.194663+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:53:18.194663+0000","last_undegraded":"2024-05-09T09:53:18.194663+0000","last_fullsized":"2024-05-09T09:53:18.194663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.476158+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:53:18.476158+0000","last_peered":"2024-05-09T09:53:18.476158+0000","last_clean":"2024-05-09T09:53:18.476158+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:53:18.476158+0000","last_undegraded":"2024-05-09T09:53:18.476158+0000","last_fullsized":"2024-05-09T09:53:18.476158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198198+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:53:18.198198+0000","last_peered":"2024-05-09T09:53:18.198198+0000","last_clean":"2024-05-09T09:53:18.198198+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:53:18.198198+0000","last_undegraded":"2024-05-09T09:53:18.198198+0000","last_fullsized":"2024-05-09T09:53:18.198198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178921+0000","last_change":"2024-05-09T09:53:17.266584+0000","last_active":"2024-05-09T09:53:18.178921+0000","last_peered":"2024-05-09T09:53:18.178921+0000","last_clean":"2024-05-09T09:53:18.178921+0000","last_became_active":"2024-05-09T09:53:17.265947+0000","last_became_peered":"2024-05-09T09:53:17.265947+0000","last_unstale":"2024-05-09T09:53:18.178921+0000","last_undegraded":"2024-05-09T09:53:18.178921+0000","last_fullsized":"2024-05-09T09:53:18.178921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.231815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177878+0000","last_change":"2024-05-09T09:53:09.121438+0000","last_active":"2024-05-09T09:53:18.177878+0000","last_peered":"2024-05-09T09:53:18.177878+0000","last_clean":"2024-05-09T09:53:18.177878+0000","last_became_active":"2024-05-09T09:53:09.121156+0000","last_became_peered":"2024-05-09T09:53:09.121156+0000","last_unstale":"2024-05-09T09:53:18.177878+0000","last_undegraded":"2024-05-09T09:53:18.177878+0000","last_fullsized":"2024-05-09T09:53:18.177878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:59.690822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179482+0000","last_change":"2024-05-09T09:53:07.131445+0000","last_active":"2024-05-09T09:53:18.179482+0000","last_peered":"2024-05-09T09:53:18.179482+0000","last_clean":"2024-05-09T09:53:18.179482+0000","last_became_active":"2024-05-09T09:53:07.131006+0000","last_became_peered":"2024-05-09T09:53:07.131006+0000","last_unstale":"2024-05-09T09:53:18.179482+0000","last_undegraded":"2024-05-09T09:53:18.179482+0000","last_fullsized":"2024-05-09T09:53:18.179482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157060+0000","last_change":"2024-05-09T09:53:11.127575+0000","last_active":"2024-05-09T09:53:18.157060+0000","last_peered":"2024-05-09T09:53:18.157060+0000","last_clean":"2024-05-09T09:53:18.157060+0000","last_became_active":"2024-05-09T09:53:11.126808+0000","last_became_peered":"2024-05-09T09:53:11.126808+0000","last_unstale":"2024-05-09T09:53:18.157060+0000","last_undegraded":"2024-05-09T09:53:18.157060+0000","last_fullsized":"2024-05-09T09:53:18.157060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:38.305934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.705026+0000","last_change":"2024-05-09T09:53:13.140437+0000","last_active":"2024-05-09T09:53:18.705026+0000","last_peered":"2024-05-09T09:53:18.705026+0000","last_clean":"2024-05-09T09:53:18.705026+0000","last_became_active":"2024-05-09T09:53:13.138894+0000","last_became_peered":"2024-05-09T09:53:13.138894+0000","last_unstale":"2024-05-09T09:53:18.705026+0000","last_undegraded":"2024-05-09T09:53:18.705026+0000","last_fullsized":"2024-05-09T09:53:18.705026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:14.004547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157430+0000","last_change":"2024-05-09T09:53:15.176295+0000","last_active":"2024-05-09T09:53:18.157430+0000","last_peered":"2024-05-09T09:53:18.157430+0000","last_clean":"2024-05-09T09:53:18.157430+0000","last_became_active":"2024-05-09T09:53:15.175573+0000","last_became_peered":"2024-05-09T09:53:15.175573+0000","last_unstale":"2024-05-09T09:53:18.157430+0000","last_undegraded":"2024-05-09T09:53:18.157430+0000","last_fullsized":"2024-05-09T09:53:18.157430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190037+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:53:18.190037+0000","last_peered":"2024-05-09T09:53:18.190037+0000","last_clean":"2024-05-09T09:53:18.190037+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:53:18.190037+0000","last_undegraded":"2024-05-09T09:53:18.190037+0000","last_fullsized":"2024-05-09T09:53:18.190037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157578+0000","last_change":"2024-05-09T09:53:09.130931+0000","last_active":"2024-05-09T09:53:18.157578+0000","last_peered":"2024-05-09T09:53:18.157578+0000","last_clean":"2024-05-09T09:53:18.157578+0000","last_became_active":"2024-05-09T09:53:09.130179+0000","last_became_peered":"2024-05-09T09:53:09.130179+0000","last_unstale":"2024-05-09T09:53:18.157578+0000","last_undegraded":"2024-05-09T09:53:18.157578+0000","last_fullsized":"2024-05-09T09:53:18.157578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162363+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:53:18.162363+0000","last_peered":"2024-05-09T09:53:18.162363+0000","last_clean":"2024-05-09T09:53:18.162363+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:53:18.162363+0000","last_undegraded":"2024-05-09T09:53:18.162363+0000","last_fullsized":"2024-05-09T09:53:18.162363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173151+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:53:18.173151+0000","last_peered":"2024-05-09T09:53:18.173151+0000","last_clean":"2024-05-09T09:53:18.173151+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:53:18.173151+0000","last_undegraded":"2024-05-09T09:53:18.173151+0000","last_fullsized":"2024-05-09T09:53:18.173151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.774267+0000","last_change":"2024-05-09T09:53:13.128389+0000","last_active":"2024-05-09T09:53:18.774267+0000","last_peered":"2024-05-09T09:53:18.774267+0000","last_clean":"2024-05-09T09:53:18.774267+0000","last_became_active":"2024-05-09T09:53:13.127697+0000","last_became_peered":"2024-05-09T09:53:13.127697+0000","last_unstale":"2024-05-09T09:53:18.774267+0000","last_undegraded":"2024-05-09T09:53:18.774267+0000","last_fullsized":"2024-05-09T09:53:18.774267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157290+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:53:18.157290+0000","last_peered":"2024-05-09T09:53:18.157290+0000","last_clean":"2024-05-09T09:53:18.157290+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:53:18.157290+0000","last_undegraded":"2024-05-09T09:53:18.157290+0000","last_fullsized":"2024-05-09T09:53:18.157290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160203+0000","last_change":"2024-05-09T09:53:17.176598+0000","last_active":"2024-05-09T09:53:18.160203+0000","last_peered":"2024-05-09T09:53:18.160203+0000","last_clean":"2024-05-09T09:53:18.160203+0000","last_became_active":"2024-05-09T09:53:17.175830+0000","last_became_peered":"2024-05-09T09:53:17.175830+0000","last_unstale":"2024-05-09T09:53:18.160203+0000","last_undegraded":"2024-05-09T09:53:18.160203+0000","last_fullsized":"2024-05-09T09:53:18.160203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:27:02.510774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174147+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:53:18.174147+0000","last_peered":"2024-05-09T09:53:18.174147+0000","last_clean":"2024-05-09T09:53:18.174147+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:53:18.174147+0000","last_undegraded":"2024-05-09T09:53:18.174147+0000","last_fullsized":"2024-05-09T09:53:18.174147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198201+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:53:18.198201+0000","last_peered":"2024-05-09T09:53:18.198201+0000","last_clean":"2024-05-09T09:53:18.198201+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:53:18.198201+0000","last_undegraded":"2024-05-09T09:53:18.198201+0000","last_fullsized":"2024-05-09T09:53:18.198201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173961+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:53:18.173961+0000","last_peered":"2024-05-09T09:53:18.173961+0000","last_clean":"2024-05-09T09:53:18.173961+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:53:18.173961+0000","last_undegraded":"2024-05-09T09:53:18.173961+0000","last_fullsized":"2024-05-09T09:53:18.173961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157482+0000","last_change":"2024-05-09T09:53:07.119886+0000","last_active":"2024-05-09T09:53:18.157482+0000","last_peered":"2024-05-09T09:53:18.157482+0000","last_clean":"2024-05-09T09:53:18.157482+0000","last_became_active":"2024-05-09T09:53:07.119494+0000","last_became_peered":"2024-05-09T09:53:07.119494+0000","last_unstale":"2024-05-09T09:53:18.157482+0000","last_undegraded":"2024-05-09T09:53:18.157482+0000","last_fullsized":"2024-05-09T09:53:18.157482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:06.786227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195965+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:53:18.195965+0000","last_peered":"2024-05-09T09:53:18.195965+0000","last_clean":"2024-05-09T09:53:18.195965+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:53:18.195965+0000","last_undegraded":"2024-05-09T09:53:18.195965+0000","last_fullsized":"2024-05-09T09:53:18.195965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194610+0000","last_change":"2024-05-09T09:53:07.124474+0000","last_active":"2024-05-09T09:53:18.194610+0000","last_peered":"2024-05-09T09:53:18.194610+0000","last_clean":"2024-05-09T09:53:18.194610+0000","last_became_active":"2024-05-09T09:53:07.123723+0000","last_became_peered":"2024-05-09T09:53:07.123723+0000","last_unstale":"2024-05-09T09:53:18.194610+0000","last_undegraded":"2024-05-09T09:53:18.194610+0000","last_fullsized":"2024-05-09T09:53:18.194610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:07.985561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174385+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:53:18.174385+0000","last_peered":"2024-05-09T09:53:18.174385+0000","last_clean":"2024-05-09T09:53:18.174385+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:53:18.174385+0000","last_undegraded":"2024-05-09T09:53:18.174385+0000","last_fullsized":"2024-05-09T09:53:18.174385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158585+0000","last_change":"2024-05-09T09:53:07.105696+0000","last_active":"2024-05-09T09:53:18.158585+0000","last_peered":"2024-05-09T09:53:18.158585+0000","last_clean":"2024-05-09T09:53:18.158585+0000","last_became_active":"2024-05-09T09:53:07.105002+0000","last_became_peered":"2024-05-09T09:53:07.105002+0000","last_unstale":"2024-05-09T09:53:18.158585+0000","last_undegraded":"2024-05-09T09:53:18.158585+0000","last_fullsized":"2024-05-09T09:53:18.158585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178988+0000","last_change":"2024-05-09T09:53:09.133442+0000","last_active":"2024-05-09T09:53:18.178988+0000","last_peered":"2024-05-09T09:53:18.178988+0000","last_clean":"2024-05-09T09:53:18.178988+0000","last_became_active":"2024-05-09T09:53:09.133057+0000","last_became_peered":"2024-05-09T09:53:09.133057+0000","last_unstale":"2024-05-09T09:53:18.178988+0000","last_undegraded":"2024-05-09T09:53:18.178988+0000","last_fullsized":"2024-05-09T09:53:18.178988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:41.224127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179238+0000","last_change":"2024-05-09T09:53:07.112550+0000","last_active":"2024-05-09T09:53:18.179238+0000","last_peered":"2024-05-09T09:53:18.179238+0000","last_clean":"2024-05-09T09:53:18.179238+0000","last_became_active":"2024-05-09T09:53:07.112154+0000","last_became_peered":"2024-05-09T09:53:07.112154+0000","last_unstale":"2024-05-09T09:53:18.179238+0000","last_undegraded":"2024-05-09T09:53:18.179238+0000","last_fullsized":"2024-05-09T09:53:18.179238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158602+0000","last_change":"2024-05-09T09:53:09.132281+0000","last_active":"2024-05-09T09:53:18.158602+0000","last_peered":"2024-05-09T09:53:18.158602+0000","last_clean":"2024-05-09T09:53:18.158602+0000","last_became_active":"2024-05-09T09:53:09.131536+0000","last_became_peered":"2024-05-09T09:53:09.131536+0000","last_unstale":"2024-05-09T09:53:18.158602+0000","last_undegraded":"2024-05-09T09:53:18.158602+0000","last_fullsized":"2024-05-09T09:53:18.158602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:41.224127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176203+0000","last_change":"2024-05-09T09:53:07.106145+0000","last_active":"2024-05-09T09:53:18.176203+0000","last_peered":"2024-05-09T09:53:18.176203+0000","last_clean":"2024-05-09T09:53:18.176203+0000","last_became_active":"2024-05-09T09:53:07.105747+0000","last_became_peered":"2024-05-09T09:53:07.105747+0000","last_unstale":"2024-05-09T09:53:18.176203+0000","last_undegraded":"2024-05-09T09:53:18.176203+0000","last_fullsized":"2024-05-09T09:53:18.176203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177019+0000","last_change":"2024-05-09T09:53:09.114575+0000","last_active":"2024-05-09T09:53:18.177019+0000","last_peered":"2024-05-09T09:53:18.177019+0000","last_clean":"2024-05-09T09:53:18.177019+0000","last_became_active":"2024-05-09T09:53:09.114298+0000","last_became_peered":"2024-05-09T09:53:09.114298+0000","last_unstale":"2024-05-09T09:53:18.177019+0000","last_undegraded":"2024-05-09T09:53:18.177019+0000","last_fullsized":"2024-05-09T09:53:18.177019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200509+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:53:18.200509+0000","last_peered":"2024-05-09T09:53:18.200509+0000","last_clean":"2024-05-09T09:53:18.200509+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:53:18.200509+0000","last_undegraded":"2024-05-09T09:53:18.200509+0000","last_fullsized":"2024-05-09T09:53:18.200509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198046+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:53:18.198046+0000","last_peered":"2024-05-09T09:53:18.198046+0000","last_clean":"2024-05-09T09:53:18.198046+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:53:18.198046+0000","last_undegraded":"2024-05-09T09:53:18.198046+0000","last_fullsized":"2024-05-09T09:53:18.198046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179792+0000","last_change":"2024-05-09T09:53:07.120609+0000","last_active":"2024-05-09T09:53:18.179792+0000","last_peered":"2024-05-09T09:53:18.179792+0000","last_clean":"2024-05-09T09:53:18.179792+0000","last_became_active":"2024-05-09T09:53:07.120297+0000","last_became_peered":"2024-05-09T09:53:07.120297+0000","last_unstale":"2024-05-09T09:53:18.179792+0000","last_undegraded":"2024-05-09T09:53:18.179792+0000","last_fullsized":"2024-05-09T09:53:18.179792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:11.210918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162233+0000","last_change":"2024-05-09T09:53:09.113360+0000","last_active":"2024-05-09T09:53:18.162233+0000","last_peered":"2024-05-09T09:53:18.162233+0000","last_clean":"2024-05-09T09:53:18.162233+0000","last_became_active":"2024-05-09T09:53:09.112503+0000","last_became_peered":"2024-05-09T09:53:09.112503+0000","last_unstale":"2024-05-09T09:53:18.162233+0000","last_undegraded":"2024-05-09T09:53:18.162233+0000","last_fullsized":"2024-05-09T09:53:18.162233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194215+0000","last_change":"2024-05-09T09:53:07.117804+0000","last_active":"2024-05-09T09:53:18.194215+0000","last_peered":"2024-05-09T09:53:18.194215+0000","last_clean":"2024-05-09T09:53:18.194215+0000","last_became_active":"2024-05-09T09:53:07.116606+0000","last_became_peered":"2024-05-09T09:53:07.116606+0000","last_unstale":"2024-05-09T09:53:18.194215+0000","last_undegraded":"2024-05-09T09:53:18.194215+0000","last_fullsized":"2024-05-09T09:53:18.194215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:45:54.495728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159747+0000","last_change":"2024-05-09T09:53:09.107915+0000","last_active":"2024-05-09T09:53:18.159747+0000","last_peered":"2024-05-09T09:53:18.159747+0000","last_clean":"2024-05-09T09:53:18.159747+0000","last_became_active":"2024-05-09T09:53:09.106074+0000","last_became_peered":"2024-05-09T09:53:09.106074+0000","last_unstale":"2024-05-09T09:53:18.159747+0000","last_undegraded":"2024-05-09T09:53:18.159747+0000","last_fullsized":"2024-05-09T09:53:18.159747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:59.690822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178148+0000","last_change":"2024-05-09T09:53:07.112376+0000","last_active":"2024-05-09T09:53:18.178148+0000","last_peered":"2024-05-09T09:53:18.178148+0000","last_clean":"2024-05-09T09:53:18.178148+0000","last_became_active":"2024-05-09T09:53:07.112006+0000","last_became_peered":"2024-05-09T09:53:07.112006+0000","last_unstale":"2024-05-09T09:53:18.178148+0000","last_undegraded":"2024-05-09T09:53:18.178148+0000","last_fullsized":"2024-05-09T09:53:18.178148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:14.443292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160781+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:53:18.160781+0000","last_peered":"2024-05-09T09:53:18.160781+0000","last_clean":"2024-05-09T09:53:18.160781+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:53:18.160781+0000","last_undegraded":"2024-05-09T09:53:18.160781+0000","last_fullsized":"2024-05-09T09:53:18.160781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194492+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:53:18.194492+0000","last_peered":"2024-05-09T09:53:18.194492+0000","last_clean":"2024-05-09T09:53:18.194492+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:53:18.194492+0000","last_undegraded":"2024-05-09T09:53:18.194492+0000","last_fullsized":"2024-05-09T09:53:18.194492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159533+0000","last_change":"2024-05-09T09:53:09.131033+0000","last_active":"2024-05-09T09:53:18.159533+0000","last_peered":"2024-05-09T09:53:18.159533+0000","last_clean":"2024-05-09T09:53:18.159533+0000","last_became_active":"2024-05-09T09:53:09.130085+0000","last_became_peered":"2024-05-09T09:53:09.130085+0000","last_unstale":"2024-05-09T09:53:18.159533+0000","last_undegraded":"2024-05-09T09:53:18.159533+0000","last_fullsized":"2024-05-09T09:53:18.159533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158830+0000","last_change":"2024-05-09T09:53:07.123707+0000","last_active":"2024-05-09T09:53:18.158830+0000","last_peered":"2024-05-09T09:53:18.158830+0000","last_clean":"2024-05-09T09:53:18.158830+0000","last_became_active":"2024-05-09T09:53:07.123386+0000","last_became_peered":"2024-05-09T09:53:07.123386+0000","last_unstale":"2024-05-09T09:53:18.158830+0000","last_undegraded":"2024-05-09T09:53:18.158830+0000","last_fullsized":"2024-05-09T09:53:18.158830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:26:39.731174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188219+0000","last_change":"2024-05-09T09:53:09.134867+0000","last_active":"2024-05-09T09:53:18.188219+0000","last_peered":"2024-05-09T09:53:18.188219+0000","last_clean":"2024-05-09T09:53:18.188219+0000","last_became_active":"2024-05-09T09:53:09.132179+0000","last_became_peered":"2024-05-09T09:53:09.132179+0000","last_unstale":"2024-05-09T09:53:18.188219+0000","last_undegraded":"2024-05-09T09:53:18.188219+0000","last_fullsized":"2024-05-09T09:53:18.188219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199295+0000","last_change":"2024-05-09T09:53:07.129637+0000","last_active":"2024-05-09T09:53:18.199295+0000","last_peered":"2024-05-09T09:53:18.199295+0000","last_clean":"2024-05-09T09:53:18.199295+0000","last_became_active":"2024-05-09T09:53:07.128900+0000","last_became_peered":"2024-05-09T09:53:07.128900+0000","last_unstale":"2024-05-09T09:53:18.199295+0000","last_undegraded":"2024-05-09T09:53:18.199295+0000","last_fullsized":"2024-05-09T09:53:18.199295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:26:39.731174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157966+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:53:18.157966+0000","last_peered":"2024-05-09T09:53:18.157966+0000","last_clean":"2024-05-09T09:53:18.157966+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:53:18.157966+0000","last_undegraded":"2024-05-09T09:53:18.157966+0000","last_fullsized":"2024-05-09T09:53:18.157966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190437+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:53:18.190437+0000","last_peered":"2024-05-09T09:53:18.190437+0000","last_clean":"2024-05-09T09:53:18.190437+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:53:18.190437+0000","last_undegraded":"2024-05-09T09:53:18.190437+0000","last_fullsized":"2024-05-09T09:53:18.190437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176880+0000","last_change":"2024-05-09T09:53:09.126958+0000","last_active":"2024-05-09T09:53:18.176880+0000","last_peered":"2024-05-09T09:53:18.176880+0000","last_clean":"2024-05-09T09:53:18.176880+0000","last_became_active":"2024-05-09T09:53:09.126577+0000","last_became_peered":"2024-05-09T09:53:09.126577+0000","last_unstale":"2024-05-09T09:53:18.176880+0000","last_undegraded":"2024-05-09T09:53:18.176880+0000","last_fullsized":"2024-05-09T09:53:18.176880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161934+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:53:18.161934+0000","last_peered":"2024-05-09T09:53:18.161934+0000","last_clean":"2024-05-09T09:53:18.161934+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:53:18.161934+0000","last_undegraded":"2024-05-09T09:53:18.161934+0000","last_fullsized":"2024-05-09T09:53:18.161934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187334+0000","last_change":"2024-05-09T09:53:09.136266+0000","last_active":"2024-05-09T09:53:18.187334+0000","last_peered":"2024-05-09T09:53:18.187334+0000","last_clean":"2024-05-09T09:53:18.187334+0000","last_became_active":"2024-05-09T09:53:09.135638+0000","last_became_peered":"2024-05-09T09:53:09.135638+0000","last_unstale":"2024-05-09T09:53:18.187334+0000","last_undegraded":"2024-05-09T09:53:18.187334+0000","last_fullsized":"2024-05-09T09:53:18.187334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.197612+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:53:18.197612+0000","last_peered":"2024-05-09T09:53:18.197612+0000","last_clean":"2024-05-09T09:53:18.197612+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:53:18.197612+0000","last_undegraded":"2024-05-09T09:53:18.197612+0000","last_fullsized":"2024-05-09T09:53:18.197612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193996+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:53:18.193996+0000","last_peered":"2024-05-09T09:53:18.193996+0000","last_clean":"2024-05-09T09:53:18.193996+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:53:18.193996+0000","last_undegraded":"2024-05-09T09:53:18.193996+0000","last_fullsized":"2024-05-09T09:53:18.193996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162038+0000","last_change":"2024-05-09T09:53:09.113504+0000","last_active":"2024-05-09T09:53:18.162038+0000","last_peered":"2024-05-09T09:53:18.162038+0000","last_clean":"2024-05-09T09:53:18.162038+0000","last_became_active":"2024-05-09T09:53:09.112750+0000","last_became_peered":"2024-05-09T09:53:09.112750+0000","last_unstale":"2024-05-09T09:53:18.162038+0000","last_undegraded":"2024-05-09T09:53:18.162038+0000","last_fullsized":"2024-05-09T09:53:18.162038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174500+0000","last_change":"2024-05-09T09:53:07.112133+0000","last_active":"2024-05-09T09:53:18.174500+0000","last_peered":"2024-05-09T09:53:18.174500+0000","last_clean":"2024-05-09T09:53:18.174500+0000","last_became_active":"2024-05-09T09:53:07.111827+0000","last_became_peered":"2024-05-09T09:53:07.111827+0000","last_unstale":"2024-05-09T09:53:18.174500+0000","last_undegraded":"2024-05-09T09:53:18.174500+0000","last_fullsized":"2024-05-09T09:53:18.174500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196622+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:53:18.196622+0000","last_peered":"2024-05-09T09:53:18.196622+0000","last_clean":"2024-05-09T09:53:18.196622+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:53:18.196622+0000","last_undegraded":"2024-05-09T09:53:18.196622+0000","last_fullsized":"2024-05-09T09:53:18.196622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":738721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":146700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":147964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":147627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":147096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":146262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":146950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":737134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:53:25.076 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:53:25.461 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:53:25.468 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:53:25.482 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-05-09T09:53:25.284235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240960,"kb_used_data":4008,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733760,"statfs":{"total":773094113280,"available":772847370240,"internally_reserved":0,"allocated":4104192,"data_stored":2358454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.133225"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190270+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:53:18.190270+0000","last_peered":"2024-05-09T09:53:18.190270+0000","last_clean":"2024-05-09T09:53:18.190270+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:53:18.190270+0000","last_undegraded":"2024-05-09T09:53:18.190270+0000","last_fullsized":"2024-05-09T09:53:18.190270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193555+0000","last_change":"2024-05-09T09:53:09.112112+0000","last_active":"2024-05-09T09:53:18.193555+0000","last_peered":"2024-05-09T09:53:18.193555+0000","last_clean":"2024-05-09T09:53:18.193555+0000","last_became_active":"2024-05-09T09:53:09.111383+0000","last_became_peered":"2024-05-09T09:53:09.111383+0000","last_unstale":"2024-05-09T09:53:18.193555+0000","last_undegraded":"2024-05-09T09:53:18.193555+0000","last_fullsized":"2024-05-09T09:53:18.193555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:28:03.943440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174348+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:53:18.174348+0000","last_peered":"2024-05-09T09:53:18.174348+0000","last_clean":"2024-05-09T09:53:18.174348+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:53:18.174348+0000","last_undegraded":"2024-05-09T09:53:18.174348+0000","last_fullsized":"2024-05-09T09:53:18.174348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187940+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:53:18.187940+0000","last_peered":"2024-05-09T09:53:18.187940+0000","last_clean":"2024-05-09T09:53:18.187940+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:53:18.187940+0000","last_undegraded":"2024-05-09T09:53:18.187940+0000","last_fullsized":"2024-05-09T09:53:18.187940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162753+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:53:18.162753+0000","last_peered":"2024-05-09T09:53:18.162753+0000","last_clean":"2024-05-09T09:53:18.162753+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:53:18.162753+0000","last_undegraded":"2024-05-09T09:53:18.162753+0000","last_fullsized":"2024-05-09T09:53:18.162753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157994+0000","last_change":"2024-05-09T09:53:09.139224+0000","last_active":"2024-05-09T09:53:18.157994+0000","last_peered":"2024-05-09T09:53:18.157994+0000","last_clean":"2024-05-09T09:53:18.157994+0000","last_became_active":"2024-05-09T09:53:09.133660+0000","last_became_peered":"2024-05-09T09:53:09.133660+0000","last_unstale":"2024-05-09T09:53:18.157994+0000","last_undegraded":"2024-05-09T09:53:18.157994+0000","last_fullsized":"2024-05-09T09:53:18.157994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196099+0000","last_change":"2024-05-09T09:53:07.122498+0000","last_active":"2024-05-09T09:53:18.196099+0000","last_peered":"2024-05-09T09:53:18.196099+0000","last_clean":"2024-05-09T09:53:18.196099+0000","last_became_active":"2024-05-09T09:53:07.121122+0000","last_became_peered":"2024-05-09T09:53:07.121122+0000","last_unstale":"2024-05-09T09:53:18.196099+0000","last_undegraded":"2024-05-09T09:53:18.196099+0000","last_fullsized":"2024-05-09T09:53:18.196099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:09:33.860750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158338+0000","last_change":"2024-05-09T09:53:09.125729+0000","last_active":"2024-05-09T09:53:18.158338+0000","last_peered":"2024-05-09T09:53:18.158338+0000","last_clean":"2024-05-09T09:53:18.158338+0000","last_became_active":"2024-05-09T09:53:09.125431+0000","last_became_peered":"2024-05-09T09:53:09.125431+0000","last_unstale":"2024-05-09T09:53:18.158338+0000","last_undegraded":"2024-05-09T09:53:18.158338+0000","last_fullsized":"2024-05-09T09:53:18.158338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188606+0000","last_change":"2024-05-09T09:53:07.131594+0000","last_active":"2024-05-09T09:53:18.188606+0000","last_peered":"2024-05-09T09:53:18.188606+0000","last_clean":"2024-05-09T09:53:18.188606+0000","last_became_active":"2024-05-09T09:53:07.129344+0000","last_became_peered":"2024-05-09T09:53:07.129344+0000","last_unstale":"2024-05-09T09:53:18.188606+0000","last_undegraded":"2024-05-09T09:53:18.188606+0000","last_fullsized":"2024-05-09T09:53:18.188606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:11.210918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199059+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:53:18.199059+0000","last_peered":"2024-05-09T09:53:18.199059+0000","last_clean":"2024-05-09T09:53:18.199059+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:53:18.199059+0000","last_undegraded":"2024-05-09T09:53:18.199059+0000","last_fullsized":"2024-05-09T09:53:18.199059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194210+0000","last_change":"2024-05-09T09:53:07.130117+0000","last_active":"2024-05-09T09:53:18.194210+0000","last_peered":"2024-05-09T09:53:18.194210+0000","last_clean":"2024-05-09T09:53:18.194210+0000","last_became_active":"2024-05-09T09:53:07.129508+0000","last_became_peered":"2024-05-09T09:53:07.129508+0000","last_unstale":"2024-05-09T09:53:18.194210+0000","last_undegraded":"2024-05-09T09:53:18.194210+0000","last_fullsized":"2024-05-09T09:53:18.194210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.230481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159136+0000","last_change":"2024-05-09T09:53:09.140117+0000","last_active":"2024-05-09T09:53:18.159136+0000","last_peered":"2024-05-09T09:53:18.159136+0000","last_clean":"2024-05-09T09:53:18.159136+0000","last_became_active":"2024-05-09T09:53:09.139223+0000","last_became_peered":"2024-05-09T09:53:09.139223+0000","last_unstale":"2024-05-09T09:53:18.159136+0000","last_undegraded":"2024-05-09T09:53:18.159136+0000","last_fullsized":"2024-05-09T09:53:18.159136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188210+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:53:18.188210+0000","last_peered":"2024-05-09T09:53:18.188210+0000","last_clean":"2024-05-09T09:53:18.188210+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:53:18.188210+0000","last_undegraded":"2024-05-09T09:53:18.188210+0000","last_fullsized":"2024-05-09T09:53:18.188210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196314+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:53:18.196314+0000","last_peered":"2024-05-09T09:53:18.196314+0000","last_clean":"2024-05-09T09:53:18.196314+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:53:18.196314+0000","last_undegraded":"2024-05-09T09:53:18.196314+0000","last_fullsized":"2024-05-09T09:53:18.196314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177349+0000","last_change":"2024-05-09T09:53:07.119794+0000","last_active":"2024-05-09T09:53:18.177349+0000","last_peered":"2024-05-09T09:53:18.177349+0000","last_clean":"2024-05-09T09:53:18.177349+0000","last_became_active":"2024-05-09T09:53:07.119402+0000","last_became_peered":"2024-05-09T09:53:07.119402+0000","last_unstale":"2024-05-09T09:53:18.177349+0000","last_undegraded":"2024-05-09T09:53:18.177349+0000","last_fullsized":"2024-05-09T09:53:18.177349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162165+0000","last_change":"2024-05-09T09:53:09.109546+0000","last_active":"2024-05-09T09:53:18.162165+0000","last_peered":"2024-05-09T09:53:18.162165+0000","last_clean":"2024-05-09T09:53:18.162165+0000","last_became_active":"2024-05-09T09:53:09.108979+0000","last_became_peered":"2024-05-09T09:53:09.108979+0000","last_unstale":"2024-05-09T09:53:18.162165+0000","last_undegraded":"2024-05-09T09:53:18.162165+0000","last_fullsized":"2024-05-09T09:53:18.162165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:57.701380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157559+0000","last_change":"2024-05-09T09:53:09.139498+0000","last_active":"2024-05-09T09:53:18.157559+0000","last_peered":"2024-05-09T09:53:18.157559+0000","last_clean":"2024-05-09T09:53:18.157559+0000","last_became_active":"2024-05-09T09:53:09.133859+0000","last_became_peered":"2024-05-09T09:53:09.133859+0000","last_unstale":"2024-05-09T09:53:18.157559+0000","last_undegraded":"2024-05-09T09:53:18.157559+0000","last_fullsized":"2024-05-09T09:53:18.157559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:18.060153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190399+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:53:18.190399+0000","last_peered":"2024-05-09T09:53:18.190399+0000","last_clean":"2024-05-09T09:53:18.190399+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:53:18.190399+0000","last_undegraded":"2024-05-09T09:53:18.190399+0000","last_fullsized":"2024-05-09T09:53:18.190399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188014+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:53:18.188014+0000","last_peered":"2024-05-09T09:53:18.188014+0000","last_clean":"2024-05-09T09:53:18.188014+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:53:18.188014+0000","last_undegraded":"2024-05-09T09:53:18.188014+0000","last_fullsized":"2024-05-09T09:53:18.188014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200153+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:53:18.200153+0000","last_peered":"2024-05-09T09:53:18.200153+0000","last_clean":"2024-05-09T09:53:18.200153+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:53:18.200153+0000","last_undegraded":"2024-05-09T09:53:18.200153+0000","last_fullsized":"2024-05-09T09:53:18.200153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194501+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:53:18.194501+0000","last_peered":"2024-05-09T09:53:18.194501+0000","last_clean":"2024-05-09T09:53:18.194501+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:53:18.194501+0000","last_undegraded":"2024-05-09T09:53:18.194501+0000","last_fullsized":"2024-05-09T09:53:18.194501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200038+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:53:18.200038+0000","last_peered":"2024-05-09T09:53:18.200038+0000","last_clean":"2024-05-09T09:53:18.200038+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:53:18.200038+0000","last_undegraded":"2024-05-09T09:53:18.200038+0000","last_fullsized":"2024-05-09T09:53:18.200038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159692+0000","last_change":"2024-05-09T09:53:09.109289+0000","last_active":"2024-05-09T09:53:18.159692+0000","last_peered":"2024-05-09T09:53:18.159692+0000","last_clean":"2024-05-09T09:53:18.159692+0000","last_became_active":"2024-05-09T09:53:09.108483+0000","last_became_peered":"2024-05-09T09:53:09.108483+0000","last_unstale":"2024-05-09T09:53:18.159692+0000","last_undegraded":"2024-05-09T09:53:18.159692+0000","last_fullsized":"2024-05-09T09:53:18.159692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:55.077672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158447+0000","last_change":"2024-05-09T09:53:07.119366+0000","last_active":"2024-05-09T09:53:18.158447+0000","last_peered":"2024-05-09T09:53:18.158447+0000","last_clean":"2024-05-09T09:53:18.158447+0000","last_became_active":"2024-05-09T09:53:07.118523+0000","last_became_peered":"2024-05-09T09:53:07.118523+0000","last_unstale":"2024-05-09T09:53:18.158447+0000","last_undegraded":"2024-05-09T09:53:18.158447+0000","last_fullsized":"2024-05-09T09:53:18.158447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160556+0000","last_change":"2024-05-09T09:53:09.119350+0000","last_active":"2024-05-09T09:53:18.160556+0000","last_peered":"2024-05-09T09:53:18.160556+0000","last_clean":"2024-05-09T09:53:18.160556+0000","last_became_active":"2024-05-09T09:53:09.118782+0000","last_became_peered":"2024-05-09T09:53:09.118782+0000","last_unstale":"2024-05-09T09:53:18.160556+0000","last_undegraded":"2024-05-09T09:53:18.160556+0000","last_fullsized":"2024-05-09T09:53:18.160556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:13.483000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178095+0000","last_change":"2024-05-09T09:53:07.113936+0000","last_active":"2024-05-09T09:53:18.178095+0000","last_peered":"2024-05-09T09:53:18.178095+0000","last_clean":"2024-05-09T09:53:18.178095+0000","last_became_active":"2024-05-09T09:53:07.113560+0000","last_became_peered":"2024-05-09T09:53:07.113560+0000","last_unstale":"2024-05-09T09:53:18.178095+0000","last_undegraded":"2024-05-09T09:53:18.178095+0000","last_fullsized":"2024-05-09T09:53:18.178095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159103+0000","last_change":"2024-05-09T09:53:09.110783+0000","last_active":"2024-05-09T09:53:18.159103+0000","last_peered":"2024-05-09T09:53:18.159103+0000","last_clean":"2024-05-09T09:53:18.159103+0000","last_became_active":"2024-05-09T09:53:09.109553+0000","last_became_peered":"2024-05-09T09:53:09.109553+0000","last_unstale":"2024-05-09T09:53:18.159103+0000","last_undegraded":"2024-05-09T09:53:18.159103+0000","last_fullsized":"2024-05-09T09:53:18.159103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158599+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:53:18.158599+0000","last_peered":"2024-05-09T09:53:18.158599+0000","last_clean":"2024-05-09T09:53:18.158599+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:53:18.158599+0000","last_undegraded":"2024-05-09T09:53:18.158599+0000","last_fullsized":"2024-05-09T09:53:18.158599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157287+0000","last_change":"2024-05-09T09:53:17.178875+0000","last_active":"2024-05-09T09:53:18.157287+0000","last_peered":"2024-05-09T09:53:18.157287+0000","last_clean":"2024-05-09T09:53:18.157287+0000","last_became_active":"2024-05-09T09:53:17.178104+0000","last_became_peered":"2024-05-09T09:53:17.178104+0000","last_unstale":"2024-05-09T09:53:18.157287+0000","last_undegraded":"2024-05-09T09:53:18.157287+0000","last_fullsized":"2024-05-09T09:53:18.157287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178807+0000","last_change":"2024-05-09T09:53:09.113975+0000","last_active":"2024-05-09T09:53:18.178807+0000","last_peered":"2024-05-09T09:53:18.178807+0000","last_clean":"2024-05-09T09:53:18.178807+0000","last_became_active":"2024-05-09T09:53:09.112863+0000","last_became_peered":"2024-05-09T09:53:09.112863+0000","last_unstale":"2024-05-09T09:53:18.178807+0000","last_undegraded":"2024-05-09T09:53:18.178807+0000","last_fullsized":"2024-05-09T09:53:18.178807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:33.354661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188944+0000","last_change":"2024-05-09T09:53:07.130149+0000","last_active":"2024-05-09T09:53:18.188944+0000","last_peered":"2024-05-09T09:53:18.188944+0000","last_clean":"2024-05-09T09:53:18.188944+0000","last_became_active":"2024-05-09T09:53:07.124250+0000","last_became_peered":"2024-05-09T09:53:07.124250+0000","last_unstale":"2024-05-09T09:53:18.188944+0000","last_undegraded":"2024-05-09T09:53:18.188944+0000","last_fullsized":"2024-05-09T09:53:18.188944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:14.443292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195765+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:53:18.195765+0000","last_peered":"2024-05-09T09:53:18.195765+0000","last_clean":"2024-05-09T09:53:18.195765+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:53:18.195765+0000","last_undegraded":"2024-05-09T09:53:18.195765+0000","last_fullsized":"2024-05-09T09:53:18.195765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.561929+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:53:18.561929+0000","last_peered":"2024-05-09T09:53:18.561929+0000","last_clean":"2024-05-09T09:53:18.561929+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:53:18.561929+0000","last_undegraded":"2024-05-09T09:53:18.561929+0000","last_fullsized":"2024-05-09T09:53:18.561929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.189912+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:53:18.189912+0000","last_peered":"2024-05-09T09:53:18.189912+0000","last_clean":"2024-05-09T09:53:18.189912+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:53:18.189912+0000","last_undegraded":"2024-05-09T09:53:18.189912+0000","last_fullsized":"2024-05-09T09:53:18.189912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193698+0000","last_change":"2024-05-09T09:53:17.184566+0000","last_active":"2024-05-09T09:53:18.193698+0000","last_peered":"2024-05-09T09:53:18.193698+0000","last_clean":"2024-05-09T09:53:18.193698+0000","last_became_active":"2024-05-09T09:53:17.183686+0000","last_became_peered":"2024-05-09T09:53:17.183686+0000","last_unstale":"2024-05-09T09:53:18.193698+0000","last_undegraded":"2024-05-09T09:53:18.193698+0000","last_fullsized":"2024-05-09T09:53:18.193698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:41.712542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196321+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:53:18.196321+0000","last_peered":"2024-05-09T09:53:18.196321+0000","last_clean":"2024-05-09T09:53:18.196321+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:53:18.196321+0000","last_undegraded":"2024-05-09T09:53:18.196321+0000","last_fullsized":"2024-05-09T09:53:18.196321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158660+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:53:18.158660+0000","last_peered":"2024-05-09T09:53:18.158660+0000","last_clean":"2024-05-09T09:53:18.158660+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:53:18.158660+0000","last_undegraded":"2024-05-09T09:53:18.158660+0000","last_fullsized":"2024-05-09T09:53:18.158660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178538+0000","last_change":"2024-05-09T09:53:11.120948+0000","last_active":"2024-05-09T09:53:18.178538+0000","last_peered":"2024-05-09T09:53:18.178538+0000","last_clean":"2024-05-09T09:53:18.178538+0000","last_became_active":"2024-05-09T09:53:11.120423+0000","last_became_peered":"2024-05-09T09:53:11.120423+0000","last_unstale":"2024-05-09T09:53:18.178538+0000","last_undegraded":"2024-05-09T09:53:18.178538+0000","last_fullsized":"2024-05-09T09:53:18.178538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:06.988958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.953892+0000","last_change":"2024-05-09T09:53:13.119274+0000","last_active":"2024-05-09T09:53:18.953892+0000","last_peered":"2024-05-09T09:53:18.953892+0000","last_clean":"2024-05-09T09:53:18.953892+0000","last_became_active":"2024-05-09T09:53:13.118463+0000","last_became_peered":"2024-05-09T09:53:13.118463+0000","last_unstale":"2024-05-09T09:53:18.953892+0000","last_undegraded":"2024-05-09T09:53:18.953892+0000","last_fullsized":"2024-05-09T09:53:18.953892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:09.306529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159114+0000","last_change":"2024-05-09T09:53:15.156089+0000","last_active":"2024-05-09T09:53:18.159114+0000","last_peered":"2024-05-09T09:53:18.159114+0000","last_clean":"2024-05-09T09:53:18.159114+0000","last_became_active":"2024-05-09T09:53:15.153893+0000","last_became_peered":"2024-05-09T09:53:15.153893+0000","last_unstale":"2024-05-09T09:53:18.159114+0000","last_undegraded":"2024-05-09T09:53:18.159114+0000","last_fullsized":"2024-05-09T09:53:18.159114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:27:53.403158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158345+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:53:18.158345+0000","last_peered":"2024-05-09T09:53:18.158345+0000","last_clean":"2024-05-09T09:53:18.158345+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:53:18.158345+0000","last_undegraded":"2024-05-09T09:53:18.158345+0000","last_fullsized":"2024-05-09T09:53:18.158345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162809+0000","last_change":"2024-05-09T09:53:09.113086+0000","last_active":"2024-05-09T09:53:18.162809+0000","last_peered":"2024-05-09T09:53:18.162809+0000","last_clean":"2024-05-09T09:53:18.162809+0000","last_became_active":"2024-05-09T09:53:09.112715+0000","last_became_peered":"2024-05-09T09:53:09.112715+0000","last_unstale":"2024-05-09T09:53:18.162809+0000","last_undegraded":"2024-05-09T09:53:18.162809+0000","last_fullsized":"2024-05-09T09:53:18.162809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188267+0000","last_change":"2024-05-09T09:53:07.136487+0000","last_active":"2024-05-09T09:53:18.188267+0000","last_peered":"2024-05-09T09:53:18.188267+0000","last_clean":"2024-05-09T09:53:18.188267+0000","last_became_active":"2024-05-09T09:53:07.135802+0000","last_became_peered":"2024-05-09T09:53:07.135802+0000","last_unstale":"2024-05-09T09:53:18.188267+0000","last_undegraded":"2024-05-09T09:53:18.188267+0000","last_fullsized":"2024-05-09T09:53:18.188267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.181881+0000","last_change":"2024-05-09T09:53:11.119863+0000","last_active":"2024-05-09T09:53:18.181881+0000","last_peered":"2024-05-09T09:53:18.181881+0000","last_clean":"2024-05-09T09:53:18.181881+0000","last_became_active":"2024-05-09T09:53:11.119093+0000","last_became_peered":"2024-05-09T09:53:11.119093+0000","last_unstale":"2024-05-09T09:53:18.181881+0000","last_undegraded":"2024-05-09T09:53:18.181881+0000","last_fullsized":"2024-05-09T09:53:18.181881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:27.928171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.009171+0000","last_change":"2024-05-09T09:53:13.118282+0000","last_active":"2024-05-09T09:53:19.009171+0000","last_peered":"2024-05-09T09:53:19.009171+0000","last_clean":"2024-05-09T09:53:19.009171+0000","last_became_active":"2024-05-09T09:53:13.117489+0000","last_became_peered":"2024-05-09T09:53:13.117489+0000","last_unstale":"2024-05-09T09:53:19.009171+0000","last_undegraded":"2024-05-09T09:53:19.009171+0000","last_fullsized":"2024-05-09T09:53:19.009171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:47.099353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.189441+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:53:18.189441+0000","last_peered":"2024-05-09T09:53:18.189441+0000","last_clean":"2024-05-09T09:53:18.189441+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:53:18.189441+0000","last_undegraded":"2024-05-09T09:53:18.189441+0000","last_fullsized":"2024-05-09T09:53:18.189441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158137+0000","last_change":"2024-05-09T09:53:17.265793+0000","last_active":"2024-05-09T09:53:18.158137+0000","last_peered":"2024-05-09T09:53:18.158137+0000","last_clean":"2024-05-09T09:53:18.158137+0000","last_became_active":"2024-05-09T09:53:17.265184+0000","last_became_peered":"2024-05-09T09:53:17.265184+0000","last_unstale":"2024-05-09T09:53:18.158137+0000","last_undegraded":"2024-05-09T09:53:18.158137+0000","last_fullsized":"2024-05-09T09:53:18.158137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179394+0000","last_change":"2024-05-09T09:53:09.133623+0000","last_active":"2024-05-09T09:53:18.179394+0000","last_peered":"2024-05-09T09:53:18.179394+0000","last_clean":"2024-05-09T09:53:18.179394+0000","last_became_active":"2024-05-09T09:53:09.133066+0000","last_became_peered":"2024-05-09T09:53:09.133066+0000","last_unstale":"2024-05-09T09:53:18.179394+0000","last_undegraded":"2024-05-09T09:53:18.179394+0000","last_fullsized":"2024-05-09T09:53:18.179394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:56.384209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198308+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:53:18.198308+0000","last_peered":"2024-05-09T09:53:18.198308+0000","last_clean":"2024-05-09T09:53:18.198308+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:53:18.198308+0000","last_undegraded":"2024-05-09T09:53:18.198308+0000","last_fullsized":"2024-05-09T09:53:18.198308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196069+0000","last_change":"2024-05-09T09:53:11.126737+0000","last_active":"2024-05-09T09:53:18.196069+0000","last_peered":"2024-05-09T09:53:18.196069+0000","last_clean":"2024-05-09T09:53:18.196069+0000","last_became_active":"2024-05-09T09:53:11.125702+0000","last_became_peered":"2024-05-09T09:53:11.125702+0000","last_unstale":"2024-05-09T09:53:18.196069+0000","last_undegraded":"2024-05-09T09:53:18.196069+0000","last_fullsized":"2024-05-09T09:53:18.196069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:31:04.360774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.016568+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:53:19.016568+0000","last_peered":"2024-05-09T09:53:19.016568+0000","last_clean":"2024-05-09T09:53:19.016568+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:53:19.016568+0000","last_undegraded":"2024-05-09T09:53:19.016568+0000","last_fullsized":"2024-05-09T09:53:19.016568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178052+0000","last_change":"2024-05-09T09:53:15.173857+0000","last_active":"2024-05-09T09:53:18.178052+0000","last_peered":"2024-05-09T09:53:18.178052+0000","last_clean":"2024-05-09T09:53:18.178052+0000","last_became_active":"2024-05-09T09:53:15.172351+0000","last_became_peered":"2024-05-09T09:53:15.172351+0000","last_unstale":"2024-05-09T09:53:18.178052+0000","last_undegraded":"2024-05-09T09:53:18.178052+0000","last_fullsized":"2024-05-09T09:53:18.178052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:19.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193986+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:53:18.193986+0000","last_peered":"2024-05-09T09:53:18.193986+0000","last_clean":"2024-05-09T09:53:18.193986+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:53:18.193986+0000","last_undegraded":"2024-05-09T09:53:18.193986+0000","last_fullsized":"2024-05-09T09:53:18.193986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190547+0000","last_change":"2024-05-09T09:53:07.135827+0000","last_active":"2024-05-09T09:53:18.190547+0000","last_peered":"2024-05-09T09:53:18.190547+0000","last_clean":"2024-05-09T09:53:18.190547+0000","last_became_active":"2024-05-09T09:53:07.128704+0000","last_became_peered":"2024-05-09T09:53:07.128704+0000","last_unstale":"2024-05-09T09:53:18.190547+0000","last_undegraded":"2024-05-09T09:53:18.190547+0000","last_fullsized":"2024-05-09T09:53:18.190547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:25.534970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187372+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:53:18.187372+0000","last_peered":"2024-05-09T09:53:18.187372+0000","last_clean":"2024-05-09T09:53:18.187372+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:53:18.187372+0000","last_undegraded":"2024-05-09T09:53:18.187372+0000","last_fullsized":"2024-05-09T09:53:18.187372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.116609+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:53:19.116609+0000","last_peered":"2024-05-09T09:53:19.116609+0000","last_clean":"2024-05-09T09:53:19.116609+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:53:19.116609+0000","last_undegraded":"2024-05-09T09:53:19.116609+0000","last_fullsized":"2024-05-09T09:53:19.116609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.172933+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:53:18.172933+0000","last_peered":"2024-05-09T09:53:18.172933+0000","last_clean":"2024-05-09T09:53:18.172933+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:53:18.172933+0000","last_undegraded":"2024-05-09T09:53:18.172933+0000","last_fullsized":"2024-05-09T09:53:18.172933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195662+0000","last_change":"2024-05-09T09:53:17.184389+0000","last_active":"2024-05-09T09:53:18.195662+0000","last_peered":"2024-05-09T09:53:18.195662+0000","last_clean":"2024-05-09T09:53:18.195662+0000","last_became_active":"2024-05-09T09:53:17.183559+0000","last_became_peered":"2024-05-09T09:53:17.183559+0000","last_unstale":"2024-05-09T09:53:18.195662+0000","last_undegraded":"2024-05-09T09:53:18.195662+0000","last_fullsized":"2024-05-09T09:53:18.195662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:08:02.927481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157830+0000","last_change":"2024-05-09T09:53:09.111818+0000","last_active":"2024-05-09T09:53:18.157830+0000","last_peered":"2024-05-09T09:53:18.157830+0000","last_clean":"2024-05-09T09:53:18.157830+0000","last_became_active":"2024-05-09T09:53:09.109522+0000","last_became_peered":"2024-05-09T09:53:09.109522+0000","last_unstale":"2024-05-09T09:53:18.157830+0000","last_undegraded":"2024-05-09T09:53:18.157830+0000","last_fullsized":"2024-05-09T09:53:18.157830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190694+0000","last_change":"2024-05-09T09:53:07.135896+0000","last_active":"2024-05-09T09:53:18.190694+0000","last_peered":"2024-05-09T09:53:18.190694+0000","last_clean":"2024-05-09T09:53:18.190694+0000","last_became_active":"2024-05-09T09:53:07.125300+0000","last_became_peered":"2024-05-09T09:53:07.125300+0000","last_unstale":"2024-05-09T09:53:18.190694+0000","last_undegraded":"2024-05-09T09:53:18.190694+0000","last_fullsized":"2024-05-09T09:53:18.190694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:16.207019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157489+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:53:18.157489+0000","last_peered":"2024-05-09T09:53:18.157489+0000","last_clean":"2024-05-09T09:53:18.157489+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:53:18.157489+0000","last_undegraded":"2024-05-09T09:53:18.157489+0000","last_fullsized":"2024-05-09T09:53:18.157489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.988119+0000","last_change":"2024-05-09T09:53:13.139707+0000","last_active":"2024-05-09T09:53:18.988119+0000","last_peered":"2024-05-09T09:53:18.988119+0000","last_clean":"2024-05-09T09:53:18.988119+0000","last_became_active":"2024-05-09T09:53:13.138048+0000","last_became_peered":"2024-05-09T09:53:13.138048+0000","last_unstale":"2024-05-09T09:53:18.988119+0000","last_undegraded":"2024-05-09T09:53:18.988119+0000","last_fullsized":"2024-05-09T09:53:18.988119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:54.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176870+0000","last_change":"2024-05-09T09:53:15.173268+0000","last_active":"2024-05-09T09:53:18.176870+0000","last_peered":"2024-05-09T09:53:18.176870+0000","last_clean":"2024-05-09T09:53:18.176870+0000","last_became_active":"2024-05-09T09:53:15.172435+0000","last_became_peered":"2024-05-09T09:53:15.172435+0000","last_unstale":"2024-05-09T09:53:18.176870+0000","last_undegraded":"2024-05-09T09:53:18.176870+0000","last_fullsized":"2024-05-09T09:53:18.176870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:04.426998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199225+0000","last_change":"2024-05-09T09:53:17.175344+0000","last_active":"2024-05-09T09:53:18.199225+0000","last_peered":"2024-05-09T09:53:18.199225+0000","last_clean":"2024-05-09T09:53:18.199225+0000","last_became_active":"2024-05-09T09:53:17.174638+0000","last_became_peered":"2024-05-09T09:53:17.174638+0000","last_unstale":"2024-05-09T09:53:18.199225+0000","last_undegraded":"2024-05-09T09:53:18.199225+0000","last_fullsized":"2024-05-09T09:53:18.199225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:31.976806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199266+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:53:18.199266+0000","last_peered":"2024-05-09T09:53:18.199266+0000","last_clean":"2024-05-09T09:53:18.199266+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:53:18.199266+0000","last_undegraded":"2024-05-09T09:53:18.199266+0000","last_fullsized":"2024-05-09T09:53:18.199266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190364+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:53:18.190364+0000","last_peered":"2024-05-09T09:53:18.190364+0000","last_clean":"2024-05-09T09:53:18.190364+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:53:18.190364+0000","last_undegraded":"2024-05-09T09:53:18.190364+0000","last_fullsized":"2024-05-09T09:53:18.190364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160478+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:53:18.160478+0000","last_peered":"2024-05-09T09:53:18.160478+0000","last_clean":"2024-05-09T09:53:18.160478+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:53:18.160478+0000","last_undegraded":"2024-05-09T09:53:18.160478+0000","last_fullsized":"2024-05-09T09:53:18.160478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.905109+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:53:18.905109+0000","last_peered":"2024-05-09T09:53:18.905109+0000","last_clean":"2024-05-09T09:53:18.905109+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:53:18.905109+0000","last_undegraded":"2024-05-09T09:53:18.905109+0000","last_fullsized":"2024-05-09T09:53:18.905109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157361+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:53:18.157361+0000","last_peered":"2024-05-09T09:53:18.157361+0000","last_clean":"2024-05-09T09:53:18.157361+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:53:18.157361+0000","last_undegraded":"2024-05-09T09:53:18.157361+0000","last_fullsized":"2024-05-09T09:53:18.157361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161607+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:53:18.161607+0000","last_peered":"2024-05-09T09:53:18.161607+0000","last_clean":"2024-05-09T09:53:18.161607+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:53:18.161607+0000","last_undegraded":"2024-05-09T09:53:18.161607+0000","last_fullsized":"2024-05-09T09:53:18.161607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159862+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:53:18.159862+0000","last_peered":"2024-05-09T09:53:18.159862+0000","last_clean":"2024-05-09T09:53:18.159862+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:53:18.159862+0000","last_undegraded":"2024-05-09T09:53:18.159862+0000","last_fullsized":"2024-05-09T09:53:18.159862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196585+0000","last_change":"2024-05-09T09:53:07.121861+0000","last_active":"2024-05-09T09:53:18.196585+0000","last_peered":"2024-05-09T09:53:18.196585+0000","last_clean":"2024-05-09T09:53:18.196585+0000","last_became_active":"2024-05-09T09:53:07.117776+0000","last_became_peered":"2024-05-09T09:53:07.117776+0000","last_unstale":"2024-05-09T09:53:18.196585+0000","last_undegraded":"2024-05-09T09:53:18.196585+0000","last_fullsized":"2024-05-09T09:53:18.196585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:31.804009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159048+0000","last_change":"2024-05-09T09:53:11.112340+0000","last_active":"2024-05-09T09:53:18.159048+0000","last_peered":"2024-05-09T09:53:18.159048+0000","last_clean":"2024-05-09T09:53:18.159048+0000","last_became_active":"2024-05-09T09:53:11.111795+0000","last_became_peered":"2024-05-09T09:53:11.111795+0000","last_unstale":"2024-05-09T09:53:18.159048+0000","last_undegraded":"2024-05-09T09:53:18.159048+0000","last_fullsized":"2024-05-09T09:53:18.159048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:20.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.524654+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:53:18.524654+0000","last_peered":"2024-05-09T09:53:18.524654+0000","last_clean":"2024-05-09T09:53:18.524654+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:53:18.524654+0000","last_undegraded":"2024-05-09T09:53:18.524654+0000","last_fullsized":"2024-05-09T09:53:18.524654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157081+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:53:18.157081+0000","last_peered":"2024-05-09T09:53:18.157081+0000","last_clean":"2024-05-09T09:53:18.157081+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:53:18.157081+0000","last_undegraded":"2024-05-09T09:53:18.157081+0000","last_fullsized":"2024-05-09T09:53:18.157081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173978+0000","last_change":"2024-05-09T09:53:17.180823+0000","last_active":"2024-05-09T09:53:18.173978+0000","last_peered":"2024-05-09T09:53:18.173978+0000","last_clean":"2024-05-09T09:53:18.173978+0000","last_became_active":"2024-05-09T09:53:17.180037+0000","last_became_peered":"2024-05-09T09:53:17.180037+0000","last_unstale":"2024-05-09T09:53:18.173978+0000","last_undegraded":"2024-05-09T09:53:18.173978+0000","last_fullsized":"2024-05-09T09:53:18.173978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:18.049912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159364+0000","last_change":"2024-05-09T09:53:09.110977+0000","last_active":"2024-05-09T09:53:18.159364+0000","last_peered":"2024-05-09T09:53:18.159364+0000","last_clean":"2024-05-09T09:53:18.159364+0000","last_became_active":"2024-05-09T09:53:09.110195+0000","last_became_peered":"2024-05-09T09:53:09.110195+0000","last_unstale":"2024-05-09T09:53:18.159364+0000","last_undegraded":"2024-05-09T09:53:18.159364+0000","last_fullsized":"2024-05-09T09:53:18.159364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:56.384209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177731+0000","last_change":"2024-05-09T09:53:07.104902+0000","last_active":"2024-05-09T09:53:18.177731+0000","last_peered":"2024-05-09T09:53:18.177731+0000","last_clean":"2024-05-09T09:53:18.177731+0000","last_became_active":"2024-05-09T09:53:07.102780+0000","last_became_peered":"2024-05-09T09:53:07.102780+0000","last_unstale":"2024-05-09T09:53:18.177731+0000","last_undegraded":"2024-05-09T09:53:18.177731+0000","last_fullsized":"2024-05-09T09:53:18.177731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160244+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:53:18.160244+0000","last_peered":"2024-05-09T09:53:18.160244+0000","last_clean":"2024-05-09T09:53:18.160244+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:53:18.160244+0000","last_undegraded":"2024-05-09T09:53:18.160244+0000","last_fullsized":"2024-05-09T09:53:18.160244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.053418+0000","last_change":"2024-05-09T09:53:13.132125+0000","last_active":"2024-05-09T09:53:19.053418+0000","last_peered":"2024-05-09T09:53:19.053418+0000","last_clean":"2024-05-09T09:53:19.053418+0000","last_became_active":"2024-05-09T09:53:13.131342+0000","last_became_peered":"2024-05-09T09:53:13.131342+0000","last_unstale":"2024-05-09T09:53:19.053418+0000","last_undegraded":"2024-05-09T09:53:19.053418+0000","last_fullsized":"2024-05-09T09:53:19.053418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:38.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161807+0000","last_change":"2024-05-09T09:53:15.165179+0000","last_active":"2024-05-09T09:53:18.161807+0000","last_peered":"2024-05-09T09:53:18.161807+0000","last_clean":"2024-05-09T09:53:18.161807+0000","last_became_active":"2024-05-09T09:53:15.164441+0000","last_became_peered":"2024-05-09T09:53:15.164441+0000","last_unstale":"2024-05-09T09:53:18.161807+0000","last_undegraded":"2024-05-09T09:53:18.161807+0000","last_fullsized":"2024-05-09T09:53:18.161807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:48.243582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176666+0000","last_change":"2024-05-09T09:53:17.191808+0000","last_active":"2024-05-09T09:53:18.176666+0000","last_peered":"2024-05-09T09:53:18.176666+0000","last_clean":"2024-05-09T09:53:18.176666+0000","last_became_active":"2024-05-09T09:53:17.191148+0000","last_became_peered":"2024-05-09T09:53:17.191148+0000","last_unstale":"2024-05-09T09:53:18.176666+0000","last_undegraded":"2024-05-09T09:53:18.176666+0000","last_fullsized":"2024-05-09T09:53:18.176666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:36.468016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159943+0000","last_change":"2024-05-09T09:53:09.139251+0000","last_active":"2024-05-09T09:53:18.159943+0000","last_peered":"2024-05-09T09:53:18.159943+0000","last_clean":"2024-05-09T09:53:18.159943+0000","last_became_active":"2024-05-09T09:53:09.130281+0000","last_became_peered":"2024-05-09T09:53:09.130281+0000","last_unstale":"2024-05-09T09:53:18.159943+0000","last_undegraded":"2024-05-09T09:53:18.159943+0000","last_fullsized":"2024-05-09T09:53:18.159943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:00.152062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199522+0000","last_change":"2024-05-09T09:53:07.133846+0000","last_active":"2024-05-09T09:53:18.199522+0000","last_peered":"2024-05-09T09:53:18.199522+0000","last_clean":"2024-05-09T09:53:18.199522+0000","last_became_active":"2024-05-09T09:53:07.113499+0000","last_became_peered":"2024-05-09T09:53:07.113499+0000","last_unstale":"2024-05-09T09:53:18.199522+0000","last_undegraded":"2024-05-09T09:53:18.199522+0000","last_fullsized":"2024-05-09T09:53:18.199522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173434+0000","last_change":"2024-05-09T09:53:11.134003+0000","last_active":"2024-05-09T09:53:18.173434+0000","last_peered":"2024-05-09T09:53:18.173434+0000","last_clean":"2024-05-09T09:53:18.173434+0000","last_became_active":"2024-05-09T09:53:11.133283+0000","last_became_peered":"2024-05-09T09:53:11.133283+0000","last_unstale":"2024-05-09T09:53:18.173434+0000","last_undegraded":"2024-05-09T09:53:18.173434+0000","last_fullsized":"2024-05-09T09:53:18.173434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:35.361627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.123341+0000","last_change":"2024-05-09T09:53:13.139144+0000","last_active":"2024-05-09T09:53:19.123341+0000","last_peered":"2024-05-09T09:53:19.123341+0000","last_clean":"2024-05-09T09:53:19.123341+0000","last_became_active":"2024-05-09T09:53:13.138683+0000","last_became_peered":"2024-05-09T09:53:13.138683+0000","last_unstale":"2024-05-09T09:53:19.123341+0000","last_undegraded":"2024-05-09T09:53:19.123341+0000","last_fullsized":"2024-05-09T09:53:19.123341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:36.290227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161570+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:53:18.161570+0000","last_peered":"2024-05-09T09:53:18.161570+0000","last_clean":"2024-05-09T09:53:18.161570+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:53:18.161570+0000","last_undegraded":"2024-05-09T09:53:18.161570+0000","last_fullsized":"2024-05-09T09:53:18.161570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174025+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:53:18.174025+0000","last_peered":"2024-05-09T09:53:18.174025+0000","last_clean":"2024-05-09T09:53:18.174025+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:53:18.174025+0000","last_undegraded":"2024-05-09T09:53:18.174025+0000","last_fullsized":"2024-05-09T09:53:18.174025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160035+0000","last_change":"2024-05-09T09:53:09.130551+0000","last_active":"2024-05-09T09:53:18.160035+0000","last_peered":"2024-05-09T09:53:18.160035+0000","last_clean":"2024-05-09T09:53:18.160035+0000","last_became_active":"2024-05-09T09:53:09.122070+0000","last_became_peered":"2024-05-09T09:53:09.122070+0000","last_unstale":"2024-05-09T09:53:18.160035+0000","last_undegraded":"2024-05-09T09:53:18.160035+0000","last_fullsized":"2024-05-09T09:53:18.160035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:33.354661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158725+0000","last_change":"2024-05-09T09:53:07.095615+0000","last_active":"2024-05-09T09:53:18.158725+0000","last_peered":"2024-05-09T09:53:18.158725+0000","last_clean":"2024-05-09T09:53:18.158725+0000","last_became_active":"2024-05-09T09:53:07.093416+0000","last_became_peered":"2024-05-09T09:53:07.093416+0000","last_unstale":"2024-05-09T09:53:18.158725+0000","last_undegraded":"2024-05-09T09:53:18.158725+0000","last_fullsized":"2024-05-09T09:53:18.158725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:52:49.886746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196669+0000","last_change":"2024-05-09T09:53:11.126527+0000","last_active":"2024-05-09T09:53:18.196669+0000","last_peered":"2024-05-09T09:53:18.196669+0000","last_clean":"2024-05-09T09:53:18.196669+0000","last_became_active":"2024-05-09T09:53:11.125760+0000","last_became_peered":"2024-05-09T09:53:11.125760+0000","last_unstale":"2024-05-09T09:53:18.196669+0000","last_undegraded":"2024-05-09T09:53:18.196669+0000","last_fullsized":"2024-05-09T09:53:18.196669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:16.811609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.911919+0000","last_change":"2024-05-09T09:53:13.149070+0000","last_active":"2024-05-09T09:53:18.911919+0000","last_peered":"2024-05-09T09:53:18.911919+0000","last_clean":"2024-05-09T09:53:18.911919+0000","last_became_active":"2024-05-09T09:53:13.148617+0000","last_became_peered":"2024-05-09T09:53:13.148617+0000","last_unstale":"2024-05-09T09:53:18.911919+0000","last_undegraded":"2024-05-09T09:53:18.911919+0000","last_fullsized":"2024-05-09T09:53:18.911919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:38.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199501+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:53:18.199501+0000","last_peered":"2024-05-09T09:53:18.199501+0000","last_clean":"2024-05-09T09:53:18.199501+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:53:18.199501+0000","last_undegraded":"2024-05-09T09:53:18.199501+0000","last_fullsized":"2024-05-09T09:53:18.199501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158136+0000","last_change":"2024-05-09T09:53:17.174559+0000","last_active":"2024-05-09T09:53:18.158136+0000","last_peered":"2024-05-09T09:53:18.158136+0000","last_clean":"2024-05-09T09:53:18.158136+0000","last_became_active":"2024-05-09T09:53:17.173755+0000","last_became_peered":"2024-05-09T09:53:17.173755+0000","last_unstale":"2024-05-09T09:53:18.158136+0000","last_undegraded":"2024-05-09T09:53:18.158136+0000","last_fullsized":"2024-05-09T09:53:18.158136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:06.446660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174301+0000","last_change":"2024-05-09T09:53:09.110661+0000","last_active":"2024-05-09T09:53:18.174301+0000","last_peered":"2024-05-09T09:53:18.174301+0000","last_clean":"2024-05-09T09:53:18.174301+0000","last_became_active":"2024-05-09T09:53:09.110341+0000","last_became_peered":"2024-05-09T09:53:09.110341+0000","last_unstale":"2024-05-09T09:53:18.174301+0000","last_undegraded":"2024-05-09T09:53:18.174301+0000","last_fullsized":"2024-05-09T09:53:18.174301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177608+0000","last_change":"2024-05-09T09:53:07.106510+0000","last_active":"2024-05-09T09:53:18.177608+0000","last_peered":"2024-05-09T09:53:18.177608+0000","last_clean":"2024-05-09T09:53:18.177608+0000","last_became_active":"2024-05-09T09:53:07.106159+0000","last_became_peered":"2024-05-09T09:53:07.106159+0000","last_unstale":"2024-05-09T09:53:18.177608+0000","last_undegraded":"2024-05-09T09:53:18.177608+0000","last_fullsized":"2024-05-09T09:53:18.177608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159732+0000","last_change":"2024-05-09T09:53:11.126762+0000","last_active":"2024-05-09T09:53:18.159732+0000","last_peered":"2024-05-09T09:53:18.159732+0000","last_clean":"2024-05-09T09:53:18.159732+0000","last_became_active":"2024-05-09T09:53:11.126031+0000","last_became_peered":"2024-05-09T09:53:11.126031+0000","last_unstale":"2024-05-09T09:53:18.159732+0000","last_undegraded":"2024-05-09T09:53:18.159732+0000","last_fullsized":"2024-05-09T09:53:18.159732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:27.928171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.045502+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:53:19.045502+0000","last_peered":"2024-05-09T09:53:19.045502+0000","last_clean":"2024-05-09T09:53:19.045502+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:53:19.045502+0000","last_undegraded":"2024-05-09T09:53:19.045502+0000","last_fullsized":"2024-05-09T09:53:19.045502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198702+0000","last_change":"2024-05-09T09:53:15.172479+0000","last_active":"2024-05-09T09:53:18.198702+0000","last_peered":"2024-05-09T09:53:18.198702+0000","last_clean":"2024-05-09T09:53:18.198702+0000","last_became_active":"2024-05-09T09:53:15.171668+0000","last_became_peered":"2024-05-09T09:53:15.171668+0000","last_unstale":"2024-05-09T09:53:18.198702+0000","last_undegraded":"2024-05-09T09:53:18.198702+0000","last_fullsized":"2024-05-09T09:53:18.198702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:10.247676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174836+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:53:18.174836+0000","last_peered":"2024-05-09T09:53:18.174836+0000","last_clean":"2024-05-09T09:53:18.174836+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:53:18.174836+0000","last_undegraded":"2024-05-09T09:53:18.174836+0000","last_fullsized":"2024-05-09T09:53:18.174836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199885+0000","last_change":"2024-05-09T09:53:09.141991+0000","last_active":"2024-05-09T09:53:18.199885+0000","last_peered":"2024-05-09T09:53:18.199885+0000","last_clean":"2024-05-09T09:53:18.199885+0000","last_became_active":"2024-05-09T09:53:09.141226+0000","last_became_peered":"2024-05-09T09:53:09.141226+0000","last_unstale":"2024-05-09T09:53:18.199885+0000","last_undegraded":"2024-05-09T09:53:18.199885+0000","last_fullsized":"2024-05-09T09:53:18.199885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:18.218867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188237+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:53:18.188237+0000","last_peered":"2024-05-09T09:53:18.188237+0000","last_clean":"2024-05-09T09:53:18.188237+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:53:18.188237+0000","last_undegraded":"2024-05-09T09:53:18.188237+0000","last_fullsized":"2024-05-09T09:53:18.188237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195030+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:53:18.195030+0000","last_peered":"2024-05-09T09:53:18.195030+0000","last_clean":"2024-05-09T09:53:18.195030+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:53:18.195030+0000","last_undegraded":"2024-05-09T09:53:18.195030+0000","last_fullsized":"2024-05-09T09:53:18.195030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177496+0000","last_change":"2024-05-09T09:53:07.133344+0000","last_active":"2024-05-09T09:53:18.177496+0000","last_peered":"2024-05-09T09:53:18.177496+0000","last_clean":"2024-05-09T09:53:18.177496+0000","last_became_active":"2024-05-09T09:53:07.132983+0000","last_became_peered":"2024-05-09T09:53:07.132983+0000","last_unstale":"2024-05-09T09:53:18.177496+0000","last_undegraded":"2024-05-09T09:53:18.177496+0000","last_fullsized":"2024-05-09T09:53:18.177496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188957+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:53:18.188957+0000","last_peered":"2024-05-09T09:53:18.188957+0000","last_clean":"2024-05-09T09:53:18.188957+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:53:18.188957+0000","last_undegraded":"2024-05-09T09:53:18.188957+0000","last_fullsized":"2024-05-09T09:53:18.188957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.839825+0000","last_change":"2024-05-09T09:53:13.142914+0000","last_active":"2024-05-09T09:53:18.839825+0000","last_peered":"2024-05-09T09:53:18.839825+0000","last_clean":"2024-05-09T09:53:18.839825+0000","last_became_active":"2024-05-09T09:53:13.142158+0000","last_became_peered":"2024-05-09T09:53:13.142158+0000","last_unstale":"2024-05-09T09:53:18.839825+0000","last_undegraded":"2024-05-09T09:53:18.839825+0000","last_fullsized":"2024-05-09T09:53:18.839825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:07:08.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161748+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:53:18.161748+0000","last_peered":"2024-05-09T09:53:18.161748+0000","last_clean":"2024-05-09T09:53:18.161748+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:53:18.161748+0000","last_undegraded":"2024-05-09T09:53:18.161748+0000","last_fullsized":"2024-05-09T09:53:18.161748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198289+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:53:18.198289+0000","last_peered":"2024-05-09T09:53:18.198289+0000","last_clean":"2024-05-09T09:53:18.198289+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:53:18.198289+0000","last_undegraded":"2024-05-09T09:53:18.198289+0000","last_fullsized":"2024-05-09T09:53:18.198289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162498+0000","last_change":"2024-05-09T09:53:09.099651+0000","last_active":"2024-05-09T09:53:18.162498+0000","last_peered":"2024-05-09T09:53:18.162498+0000","last_clean":"2024-05-09T09:53:18.162498+0000","last_became_active":"2024-05-09T09:53:09.099348+0000","last_became_peered":"2024-05-09T09:53:09.099348+0000","last_unstale":"2024-05-09T09:53:18.162498+0000","last_undegraded":"2024-05-09T09:53:18.162498+0000","last_fullsized":"2024-05-09T09:53:18.162498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187722+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:53:18.187722+0000","last_peered":"2024-05-09T09:53:18.187722+0000","last_clean":"2024-05-09T09:53:18.187722+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:53:18.187722+0000","last_undegraded":"2024-05-09T09:53:18.187722+0000","last_fullsized":"2024-05-09T09:53:18.187722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157738+0000","last_change":"2024-05-09T09:53:07.091272+0000","last_active":"2024-05-09T09:53:18.157738+0000","last_peered":"2024-05-09T09:53:18.157738+0000","last_clean":"2024-05-09T09:53:18.157738+0000","last_became_active":"2024-05-09T09:53:07.090605+0000","last_became_peered":"2024-05-09T09:53:07.090605+0000","last_unstale":"2024-05-09T09:53:18.157738+0000","last_undegraded":"2024-05-09T09:53:18.157738+0000","last_fullsized":"2024-05-09T09:53:18.157738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.197396+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:53:18.197396+0000","last_peered":"2024-05-09T09:53:18.197396+0000","last_clean":"2024-05-09T09:53:18.197396+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:53:18.197396+0000","last_undegraded":"2024-05-09T09:53:18.197396+0000","last_fullsized":"2024-05-09T09:53:18.197396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.033235+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:53:19.033235+0000","last_peered":"2024-05-09T09:53:19.033235+0000","last_clean":"2024-05-09T09:53:19.033235+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:53:19.033235+0000","last_undegraded":"2024-05-09T09:53:19.033235+0000","last_fullsized":"2024-05-09T09:53:19.033235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.189510+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:53:18.189510+0000","last_peered":"2024-05-09T09:53:18.189510+0000","last_clean":"2024-05-09T09:53:18.189510+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:53:18.189510+0000","last_undegraded":"2024-05-09T09:53:18.189510+0000","last_fullsized":"2024-05-09T09:53:18.189510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.175218+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:53:18.175218+0000","last_peered":"2024-05-09T09:53:18.175218+0000","last_clean":"2024-05-09T09:53:18.175218+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:53:18.175218+0000","last_undegraded":"2024-05-09T09:53:18.175218+0000","last_fullsized":"2024-05-09T09:53:18.175218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176318+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:53:18.176318+0000","last_peered":"2024-05-09T09:53:18.176318+0000","last_clean":"2024-05-09T09:53:18.176318+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:53:18.176318+0000","last_undegraded":"2024-05-09T09:53:18.176318+0000","last_fullsized":"2024-05-09T09:53:18.176318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157884+0000","last_change":"2024-05-09T09:53:01.049359+0000","last_active":"2024-05-09T09:53:18.157884+0000","last_peered":"2024-05-09T09:53:18.157884+0000","last_clean":"2024-05-09T09:53:18.157884+0000","last_became_active":"2024-05-09T09:53:01.048940+0000","last_became_peered":"2024-05-09T09:53:01.048940+0000","last_unstale":"2024-05-09T09:53:18.157884+0000","last_undegraded":"2024-05-09T09:53:18.157884+0000","last_fullsized":"2024-05-09T09:53:18.157884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.172901+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:53:18.172901+0000","last_peered":"2024-05-09T09:53:18.172901+0000","last_clean":"2024-05-09T09:53:18.172901+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:53:18.172901+0000","last_undegraded":"2024-05-09T09:53:18.172901+0000","last_fullsized":"2024-05-09T09:53:18.172901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161508+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:53:18.161508+0000","last_peered":"2024-05-09T09:53:18.161508+0000","last_clean":"2024-05-09T09:53:18.161508+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:53:18.161508+0000","last_undegraded":"2024-05-09T09:53:18.161508+0000","last_fullsized":"2024-05-09T09:53:18.161508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.040864+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:53:19.040864+0000","last_peered":"2024-05-09T09:53:19.040864+0000","last_clean":"2024-05-09T09:53:19.040864+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:53:19.040864+0000","last_undegraded":"2024-05-09T09:53:19.040864+0000","last_fullsized":"2024-05-09T09:53:19.040864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159024+0000","last_change":"2024-05-09T09:53:15.161561+0000","last_active":"2024-05-09T09:53:18.159024+0000","last_peered":"2024-05-09T09:53:18.159024+0000","last_clean":"2024-05-09T09:53:18.159024+0000","last_became_active":"2024-05-09T09:53:15.161099+0000","last_became_peered":"2024-05-09T09:53:15.161099+0000","last_unstale":"2024-05-09T09:53:18.159024+0000","last_undegraded":"2024-05-09T09:53:18.159024+0000","last_fullsized":"2024-05-09T09:53:18.159024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:27:53.403158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178657+0000","last_change":"2024-05-09T09:53:17.188095+0000","last_active":"2024-05-09T09:53:18.178657+0000","last_peered":"2024-05-09T09:53:18.178657+0000","last_clean":"2024-05-09T09:53:18.178657+0000","last_became_active":"2024-05-09T09:53:17.187373+0000","last_became_peered":"2024-05-09T09:53:17.187373+0000","last_unstale":"2024-05-09T09:53:18.178657+0000","last_undegraded":"2024-05-09T09:53:18.178657+0000","last_fullsized":"2024-05-09T09:53:18.178657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:11:25.096957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174027+0000","last_change":"2024-05-09T09:53:09.108330+0000","last_active":"2024-05-09T09:53:18.174027+0000","last_peered":"2024-05-09T09:53:18.174027+0000","last_clean":"2024-05-09T09:53:18.174027+0000","last_became_active":"2024-05-09T09:53:09.107980+0000","last_became_peered":"2024-05-09T09:53:09.107980+0000","last_unstale":"2024-05-09T09:53:18.174027+0000","last_undegraded":"2024-05-09T09:53:18.174027+0000","last_fullsized":"2024-05-09T09:53:18.174027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194747+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:53:18.194747+0000","last_peered":"2024-05-09T09:53:18.194747+0000","last_clean":"2024-05-09T09:53:18.194747+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:53:18.194747+0000","last_undegraded":"2024-05-09T09:53:18.194747+0000","last_fullsized":"2024-05-09T09:53:18.194747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159180+0000","last_change":"2024-05-09T09:53:07.099317+0000","last_active":"2024-05-09T09:53:18.159180+0000","last_peered":"2024-05-09T09:53:18.159180+0000","last_clean":"2024-05-09T09:53:18.159180+0000","last_became_active":"2024-05-09T09:53:07.098599+0000","last_became_peered":"2024-05-09T09:53:07.098599+0000","last_unstale":"2024-05-09T09:53:18.159180+0000","last_undegraded":"2024-05-09T09:53:18.159180+0000","last_fullsized":"2024-05-09T09:53:18.159180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:06.786227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159130+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:53:18.159130+0000","last_peered":"2024-05-09T09:53:18.159130+0000","last_clean":"2024-05-09T09:53:18.159130+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:53:18.159130+0000","last_undegraded":"2024-05-09T09:53:18.159130+0000","last_fullsized":"2024-05-09T09:53:18.159130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.875157+0000","last_change":"2024-05-09T09:53:13.138267+0000","last_active":"2024-05-09T09:53:18.875157+0000","last_peered":"2024-05-09T09:53:18.875157+0000","last_clean":"2024-05-09T09:53:18.875157+0000","last_became_active":"2024-05-09T09:53:13.137178+0000","last_became_peered":"2024-05-09T09:53:13.137178+0000","last_unstale":"2024-05-09T09:53:18.875157+0000","last_undegraded":"2024-05-09T09:53:18.875157+0000","last_fullsized":"2024-05-09T09:53:18.875157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:13.011553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199992+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:53:18.199992+0000","last_peered":"2024-05-09T09:53:18.199992+0000","last_clean":"2024-05-09T09:53:18.199992+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:53:18.199992+0000","last_undegraded":"2024-05-09T09:53:18.199992+0000","last_fullsized":"2024-05-09T09:53:18.199992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193418+0000","last_change":"2024-05-09T09:53:17.191919+0000","last_active":"2024-05-09T09:53:18.193418+0000","last_peered":"2024-05-09T09:53:18.193418+0000","last_clean":"2024-05-09T09:53:18.193418+0000","last_became_active":"2024-05-09T09:53:17.191273+0000","last_became_peered":"2024-05-09T09:53:17.191273+0000","last_unstale":"2024-05-09T09:53:18.193418+0000","last_undegraded":"2024-05-09T09:53:18.193418+0000","last_fullsized":"2024-05-09T09:53:18.193418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:41:14.437931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174951+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:53:18.174951+0000","last_peered":"2024-05-09T09:53:18.174951+0000","last_clean":"2024-05-09T09:53:18.174951+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:53:18.174951+0000","last_undegraded":"2024-05-09T09:53:18.174951+0000","last_fullsized":"2024-05-09T09:53:18.174951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196592+0000","last_change":"2024-05-09T09:53:07.117502+0000","last_active":"2024-05-09T09:53:18.196592+0000","last_peered":"2024-05-09T09:53:18.196592+0000","last_clean":"2024-05-09T09:53:18.196592+0000","last_became_active":"2024-05-09T09:53:07.116656+0000","last_became_peered":"2024-05-09T09:53:07.116656+0000","last_unstale":"2024-05-09T09:53:18.196592+0000","last_undegraded":"2024-05-09T09:53:18.196592+0000","last_fullsized":"2024-05-09T09:53:18.196592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:36.827054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174646+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:53:18.174646+0000","last_peered":"2024-05-09T09:53:18.174646+0000","last_clean":"2024-05-09T09:53:18.174646+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:53:18.174646+0000","last_undegraded":"2024-05-09T09:53:18.174646+0000","last_fullsized":"2024-05-09T09:53:18.174646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158674+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:53:18.158674+0000","last_peered":"2024-05-09T09:53:18.158674+0000","last_clean":"2024-05-09T09:53:18.158674+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:53:18.158674+0000","last_undegraded":"2024-05-09T09:53:18.158674+0000","last_fullsized":"2024-05-09T09:53:18.158674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.966972+0000","last_change":"2024-05-09T09:53:13.138657+0000","last_active":"2024-05-09T09:53:18.966972+0000","last_peered":"2024-05-09T09:53:18.966972+0000","last_clean":"2024-05-09T09:53:18.966972+0000","last_became_active":"2024-05-09T09:53:13.138098+0000","last_became_peered":"2024-05-09T09:53:13.138098+0000","last_unstale":"2024-05-09T09:53:18.966972+0000","last_undegraded":"2024-05-09T09:53:18.966972+0000","last_fullsized":"2024-05-09T09:53:18.966972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157186+0000","last_change":"2024-05-09T09:53:15.163197+0000","last_active":"2024-05-09T09:53:18.157186+0000","last_peered":"2024-05-09T09:53:18.157186+0000","last_clean":"2024-05-09T09:53:18.157186+0000","last_became_active":"2024-05-09T09:53:15.162455+0000","last_became_peered":"2024-05-09T09:53:15.162455+0000","last_unstale":"2024-05-09T09:53:18.157186+0000","last_undegraded":"2024-05-09T09:53:18.157186+0000","last_fullsized":"2024-05-09T09:53:18.157186+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160927+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:53:18.160927+0000","last_peered":"2024-05-09T09:53:18.160927+0000","last_clean":"2024-05-09T09:53:18.160927+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:53:18.160927+0000","last_undegraded":"2024-05-09T09:53:18.160927+0000","last_fullsized":"2024-05-09T09:53:18.160927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159620+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:53:18.159620+0000","last_peered":"2024-05-09T09:53:18.159620+0000","last_clean":"2024-05-09T09:53:18.159620+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:53:18.159620+0000","last_undegraded":"2024-05-09T09:53:18.159620+0000","last_fullsized":"2024-05-09T09:53:18.159620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174131+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:53:18.174131+0000","last_peered":"2024-05-09T09:53:18.174131+0000","last_clean":"2024-05-09T09:53:18.174131+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:53:18.174131+0000","last_undegraded":"2024-05-09T09:53:18.174131+0000","last_fullsized":"2024-05-09T09:53:18.174131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190558+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:53:18.190558+0000","last_peered":"2024-05-09T09:53:18.190558+0000","last_clean":"2024-05-09T09:53:18.190558+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:53:18.190558+0000","last_undegraded":"2024-05-09T09:53:18.190558+0000","last_fullsized":"2024-05-09T09:53:18.190558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198746+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:53:18.198746+0000","last_peered":"2024-05-09T09:53:18.198746+0000","last_clean":"2024-05-09T09:53:18.198746+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:53:18.198746+0000","last_undegraded":"2024-05-09T09:53:18.198746+0000","last_fullsized":"2024-05-09T09:53:18.198746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.067216+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:53:19.067216+0000","last_peered":"2024-05-09T09:53:19.067216+0000","last_clean":"2024-05-09T09:53:19.067216+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:53:19.067216+0000","last_undegraded":"2024-05-09T09:53:19.067216+0000","last_fullsized":"2024-05-09T09:53:19.067216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193810+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:53:18.193810+0000","last_peered":"2024-05-09T09:53:18.193810+0000","last_clean":"2024-05-09T09:53:18.193810+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:53:18.193810+0000","last_undegraded":"2024-05-09T09:53:18.193810+0000","last_fullsized":"2024-05-09T09:53:18.193810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179971+0000","last_change":"2024-05-09T09:53:17.266084+0000","last_active":"2024-05-09T09:53:18.179971+0000","last_peered":"2024-05-09T09:53:18.179971+0000","last_clean":"2024-05-09T09:53:18.179971+0000","last_became_active":"2024-05-09T09:53:17.265259+0000","last_became_peered":"2024-05-09T09:53:17.265259+0000","last_unstale":"2024-05-09T09:53:18.179971+0000","last_undegraded":"2024-05-09T09:53:18.179971+0000","last_fullsized":"2024-05-09T09:53:18.179971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:37.896643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177093+0000","last_change":"2024-05-09T09:53:09.126588+0000","last_active":"2024-05-09T09:53:18.177093+0000","last_peered":"2024-05-09T09:53:18.177093+0000","last_clean":"2024-05-09T09:53:18.177093+0000","last_became_active":"2024-05-09T09:53:09.126306+0000","last_became_peered":"2024-05-09T09:53:09.126306+0000","last_unstale":"2024-05-09T09:53:18.177093+0000","last_undegraded":"2024-05-09T09:53:18.177093+0000","last_fullsized":"2024-05-09T09:53:18.177093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178961+0000","last_change":"2024-05-09T09:53:07.126817+0000","last_active":"2024-05-09T09:53:18.178961+0000","last_peered":"2024-05-09T09:53:18.178961+0000","last_clean":"2024-05-09T09:53:18.178961+0000","last_became_active":"2024-05-09T09:53:07.126401+0000","last_became_peered":"2024-05-09T09:53:07.126401+0000","last_unstale":"2024-05-09T09:53:18.178961+0000","last_undegraded":"2024-05-09T09:53:18.178961+0000","last_fullsized":"2024-05-09T09:53:18.178961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174497+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:53:18.174497+0000","last_peered":"2024-05-09T09:53:18.174497+0000","last_clean":"2024-05-09T09:53:18.174497+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:53:18.174497+0000","last_undegraded":"2024-05-09T09:53:18.174497+0000","last_fullsized":"2024-05-09T09:53:18.174497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157552+0000","last_change":"2024-05-09T09:53:11.124958+0000","last_active":"2024-05-09T09:53:18.157552+0000","last_peered":"2024-05-09T09:53:18.157552+0000","last_clean":"2024-05-09T09:53:18.157552+0000","last_became_active":"2024-05-09T09:53:11.123690+0000","last_became_peered":"2024-05-09T09:53:11.123690+0000","last_unstale":"2024-05-09T09:53:18.157552+0000","last_undegraded":"2024-05-09T09:53:18.157552+0000","last_fullsized":"2024-05-09T09:53:18.157552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:01.845355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.023617+0000","last_change":"2024-05-09T09:53:13.139882+0000","last_active":"2024-05-09T09:53:19.023617+0000","last_peered":"2024-05-09T09:53:19.023617+0000","last_clean":"2024-05-09T09:53:19.023617+0000","last_became_active":"2024-05-09T09:53:13.138655+0000","last_became_peered":"2024-05-09T09:53:13.138655+0000","last_unstale":"2024-05-09T09:53:19.023617+0000","last_undegraded":"2024-05-09T09:53:19.023617+0000","last_fullsized":"2024-05-09T09:53:19.023617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.180014+0000","last_change":"2024-05-09T09:53:15.181187+0000","last_active":"2024-05-09T09:53:18.180014+0000","last_peered":"2024-05-09T09:53:18.180014+0000","last_clean":"2024-05-09T09:53:18.180014+0000","last_became_active":"2024-05-09T09:53:15.180486+0000","last_became_peered":"2024-05-09T09:53:15.180486+0000","last_unstale":"2024-05-09T09:53:18.180014+0000","last_undegraded":"2024-05-09T09:53:18.180014+0000","last_fullsized":"2024-05-09T09:53:18.180014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:33.941331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159424+0000","last_change":"2024-05-09T09:53:17.173663+0000","last_active":"2024-05-09T09:53:18.159424+0000","last_peered":"2024-05-09T09:53:18.159424+0000","last_clean":"2024-05-09T09:53:18.159424+0000","last_became_active":"2024-05-09T09:53:17.172903+0000","last_became_peered":"2024-05-09T09:53:17.172903+0000","last_unstale":"2024-05-09T09:53:18.159424+0000","last_undegraded":"2024-05-09T09:53:18.159424+0000","last_fullsized":"2024-05-09T09:53:18.159424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:13.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158066+0000","last_change":"2024-05-09T09:53:09.118964+0000","last_active":"2024-05-09T09:53:18.158066+0000","last_peered":"2024-05-09T09:53:18.158066+0000","last_clean":"2024-05-09T09:53:18.158066+0000","last_became_active":"2024-05-09T09:53:09.111772+0000","last_became_peered":"2024-05-09T09:53:09.111772+0000","last_unstale":"2024-05-09T09:53:18.158066+0000","last_undegraded":"2024-05-09T09:53:18.158066+0000","last_fullsized":"2024-05-09T09:53:18.158066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162766+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:53:18.162766+0000","last_peered":"2024-05-09T09:53:18.162766+0000","last_clean":"2024-05-09T09:53:18.162766+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:53:18.162766+0000","last_undegraded":"2024-05-09T09:53:18.162766+0000","last_fullsized":"2024-05-09T09:53:18.162766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200660+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:53:18.200660+0000","last_peered":"2024-05-09T09:53:18.200660+0000","last_clean":"2024-05-09T09:53:18.200660+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:53:18.200660+0000","last_undegraded":"2024-05-09T09:53:18.200660+0000","last_fullsized":"2024-05-09T09:53:18.200660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176805+0000","last_change":"2024-05-09T09:53:11.119230+0000","last_active":"2024-05-09T09:53:18.176805+0000","last_peered":"2024-05-09T09:53:18.176805+0000","last_clean":"2024-05-09T09:53:18.176805+0000","last_became_active":"2024-05-09T09:53:11.118785+0000","last_became_peered":"2024-05-09T09:53:11.118785+0000","last_unstale":"2024-05-09T09:53:18.176805+0000","last_undegraded":"2024-05-09T09:53:18.176805+0000","last_fullsized":"2024-05-09T09:53:18.176805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:01.845355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.002317+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:53:19.002317+0000","last_peered":"2024-05-09T09:53:19.002317+0000","last_clean":"2024-05-09T09:53:19.002317+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:53:19.002317+0000","last_undegraded":"2024-05-09T09:53:19.002317+0000","last_fullsized":"2024-05-09T09:53:19.002317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176879+0000","last_change":"2024-05-09T09:53:15.168489+0000","last_active":"2024-05-09T09:53:18.176879+0000","last_peered":"2024-05-09T09:53:18.176879+0000","last_clean":"2024-05-09T09:53:18.176879+0000","last_became_active":"2024-05-09T09:53:15.167829+0000","last_became_peered":"2024-05-09T09:53:15.167829+0000","last_unstale":"2024-05-09T09:53:18.176879+0000","last_undegraded":"2024-05-09T09:53:18.176879+0000","last_fullsized":"2024-05-09T09:53:18.176879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:27:00.491112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195805+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:53:18.195805+0000","last_peered":"2024-05-09T09:53:18.195805+0000","last_clean":"2024-05-09T09:53:18.195805+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:53:18.195805+0000","last_undegraded":"2024-05-09T09:53:18.195805+0000","last_fullsized":"2024-05-09T09:53:18.195805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161517+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:53:18.161517+0000","last_peered":"2024-05-09T09:53:18.161517+0000","last_clean":"2024-05-09T09:53:18.161517+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:53:18.161517+0000","last_undegraded":"2024-05-09T09:53:18.161517+0000","last_fullsized":"2024-05-09T09:53:18.161517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158093+0000","last_change":"2024-05-09T09:53:09.131427+0000","last_active":"2024-05-09T09:53:18.158093+0000","last_peered":"2024-05-09T09:53:18.158093+0000","last_clean":"2024-05-09T09:53:18.158093+0000","last_became_active":"2024-05-09T09:53:09.130677+0000","last_became_peered":"2024-05-09T09:53:09.130677+0000","last_unstale":"2024-05-09T09:53:18.158093+0000","last_undegraded":"2024-05-09T09:53:18.158093+0000","last_fullsized":"2024-05-09T09:53:18.158093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158342+0000","last_change":"2024-05-09T09:53:07.127834+0000","last_active":"2024-05-09T09:53:18.158342+0000","last_peered":"2024-05-09T09:53:18.158342+0000","last_clean":"2024-05-09T09:53:18.158342+0000","last_became_active":"2024-05-09T09:53:07.127064+0000","last_became_peered":"2024-05-09T09:53:07.127064+0000","last_unstale":"2024-05-09T09:53:18.158342+0000","last_undegraded":"2024-05-09T09:53:18.158342+0000","last_fullsized":"2024-05-09T09:53:18.158342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.175410+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:53:18.175410+0000","last_peered":"2024-05-09T09:53:18.175410+0000","last_clean":"2024-05-09T09:53:18.175410+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:53:18.175410+0000","last_undegraded":"2024-05-09T09:53:18.175410+0000","last_fullsized":"2024-05-09T09:53:18.175410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.074153+0000","last_change":"2024-05-09T09:53:13.138669+0000","last_active":"2024-05-09T09:53:19.074153+0000","last_peered":"2024-05-09T09:53:19.074153+0000","last_clean":"2024-05-09T09:53:19.074153+0000","last_became_active":"2024-05-09T09:53:13.137815+0000","last_became_peered":"2024-05-09T09:53:13.137815+0000","last_unstale":"2024-05-09T09:53:19.074153+0000","last_undegraded":"2024-05-09T09:53:19.074153+0000","last_fullsized":"2024-05-09T09:53:19.074153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:09.306529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176372+0000","last_change":"2024-05-09T09:53:15.180530+0000","last_active":"2024-05-09T09:53:18.176372+0000","last_peered":"2024-05-09T09:53:18.176372+0000","last_clean":"2024-05-09T09:53:18.176372+0000","last_became_active":"2024-05-09T09:53:15.179752+0000","last_became_peered":"2024-05-09T09:53:15.179752+0000","last_unstale":"2024-05-09T09:53:18.176372+0000","last_undegraded":"2024-05-09T09:53:18.176372+0000","last_fullsized":"2024-05-09T09:53:18.176372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:14.853148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178710+0000","last_change":"2024-05-09T09:53:17.186939+0000","last_active":"2024-05-09T09:53:18.178710+0000","last_peered":"2024-05-09T09:53:18.178710+0000","last_clean":"2024-05-09T09:53:18.178710+0000","last_became_active":"2024-05-09T09:53:17.186138+0000","last_became_peered":"2024-05-09T09:53:17.186138+0000","last_unstale":"2024-05-09T09:53:18.178710+0000","last_undegraded":"2024-05-09T09:53:18.178710+0000","last_fullsized":"2024-05-09T09:53:18.178710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:52.756156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173830+0000","last_change":"2024-05-09T09:53:09.116139+0000","last_active":"2024-05-09T09:53:18.173830+0000","last_peered":"2024-05-09T09:53:18.173830+0000","last_clean":"2024-05-09T09:53:18.173830+0000","last_became_active":"2024-05-09T09:53:09.115542+0000","last_became_peered":"2024-05-09T09:53:09.115542+0000","last_unstale":"2024-05-09T09:53:18.173830+0000","last_undegraded":"2024-05-09T09:53:18.173830+0000","last_fullsized":"2024-05-09T09:53:18.173830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:18.060153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190193+0000","last_change":"2024-05-09T09:53:07.123261+0000","last_active":"2024-05-09T09:53:18.190193+0000","last_peered":"2024-05-09T09:53:18.190193+0000","last_clean":"2024-05-09T09:53:18.190193+0000","last_became_active":"2024-05-09T09:53:07.122491+0000","last_became_peered":"2024-05-09T09:53:07.122491+0000","last_unstale":"2024-05-09T09:53:18.190193+0000","last_undegraded":"2024-05-09T09:53:18.190193+0000","last_fullsized":"2024-05-09T09:53:18.190193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:31.417620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178260+0000","last_change":"2024-05-09T09:53:11.117544+0000","last_active":"2024-05-09T09:53:18.178260+0000","last_peered":"2024-05-09T09:53:18.178260+0000","last_clean":"2024-05-09T09:53:18.178260+0000","last_became_active":"2024-05-09T09:53:11.116890+0000","last_became_peered":"2024-05-09T09:53:11.116890+0000","last_unstale":"2024-05-09T09:53:18.178260+0000","last_undegraded":"2024-05-09T09:53:18.178260+0000","last_fullsized":"2024-05-09T09:53:18.178260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:17.548338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"30'4","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.529895+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:53:18.529895+0000","last_peered":"2024-05-09T09:53:18.529895+0000","last_clean":"2024-05-09T09:53:18.529895+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:53:18.529895+0000","last_undegraded":"2024-05-09T09:53:18.529895+0000","last_fullsized":"2024-05-09T09:53:18.529895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187709+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:53:18.187709+0000","last_peered":"2024-05-09T09:53:18.187709+0000","last_clean":"2024-05-09T09:53:18.187709+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:53:18.187709+0000","last_undegraded":"2024-05-09T09:53:18.187709+0000","last_fullsized":"2024-05-09T09:53:18.187709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158986+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:53:18.158986+0000","last_peered":"2024-05-09T09:53:18.158986+0000","last_clean":"2024-05-09T09:53:18.158986+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:53:18.158986+0000","last_undegraded":"2024-05-09T09:53:18.158986+0000","last_fullsized":"2024-05-09T09:53:18.158986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177413+0000","last_change":"2024-05-09T09:53:09.136473+0000","last_active":"2024-05-09T09:53:18.177413+0000","last_peered":"2024-05-09T09:53:18.177413+0000","last_clean":"2024-05-09T09:53:18.177413+0000","last_became_active":"2024-05-09T09:53:09.136201+0000","last_became_peered":"2024-05-09T09:53:09.136201+0000","last_unstale":"2024-05-09T09:53:18.177413+0000","last_undegraded":"2024-05-09T09:53:18.177413+0000","last_fullsized":"2024-05-09T09:53:18.177413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.197019+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:53:18.197019+0000","last_peered":"2024-05-09T09:53:18.197019+0000","last_clean":"2024-05-09T09:53:18.197019+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:53:18.197019+0000","last_undegraded":"2024-05-09T09:53:18.197019+0000","last_fullsized":"2024-05-09T09:53:18.197019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.186978+0000","last_change":"2024-05-09T09:53:11.113491+0000","last_active":"2024-05-09T09:53:18.186978+0000","last_peered":"2024-05-09T09:53:18.186978+0000","last_clean":"2024-05-09T09:53:18.186978+0000","last_became_active":"2024-05-09T09:53:11.112773+0000","last_became_peered":"2024-05-09T09:53:11.112773+0000","last_unstale":"2024-05-09T09:53:18.186978+0000","last_undegraded":"2024-05-09T09:53:18.186978+0000","last_fullsized":"2024-05-09T09:53:18.186978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.981090+0000","last_change":"2024-05-09T09:53:13.143103+0000","last_active":"2024-05-09T09:53:18.981090+0000","last_peered":"2024-05-09T09:53:18.981090+0000","last_clean":"2024-05-09T09:53:18.981090+0000","last_became_active":"2024-05-09T09:53:13.142107+0000","last_became_peered":"2024-05-09T09:53:13.142107+0000","last_unstale":"2024-05-09T09:53:18.981090+0000","last_undegraded":"2024-05-09T09:53:18.981090+0000","last_fullsized":"2024-05-09T09:53:18.981090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:38.201518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198681+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:53:18.198681+0000","last_peered":"2024-05-09T09:53:18.198681+0000","last_clean":"2024-05-09T09:53:18.198681+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:53:18.198681+0000","last_undegraded":"2024-05-09T09:53:18.198681+0000","last_fullsized":"2024-05-09T09:53:18.198681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194149+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:53:18.194149+0000","last_peered":"2024-05-09T09:53:18.194149+0000","last_clean":"2024-05-09T09:53:18.194149+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:53:18.194149+0000","last_undegraded":"2024-05-09T09:53:18.194149+0000","last_fullsized":"2024-05-09T09:53:18.194149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177272+0000","last_change":"2024-05-09T09:53:09.113837+0000","last_active":"2024-05-09T09:53:18.177272+0000","last_peered":"2024-05-09T09:53:18.177272+0000","last_clean":"2024-05-09T09:53:18.177272+0000","last_became_active":"2024-05-09T09:53:09.113332+0000","last_became_peered":"2024-05-09T09:53:09.113332+0000","last_unstale":"2024-05-09T09:53:18.177272+0000","last_undegraded":"2024-05-09T09:53:18.177272+0000","last_fullsized":"2024-05-09T09:53:18.177272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162482+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:53:18.162482+0000","last_peered":"2024-05-09T09:53:18.162482+0000","last_clean":"2024-05-09T09:53:18.162482+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:53:18.162482+0000","last_undegraded":"2024-05-09T09:53:18.162482+0000","last_fullsized":"2024-05-09T09:53:18.162482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198590+0000","last_change":"2024-05-09T09:53:11.131068+0000","last_active":"2024-05-09T09:53:18.198590+0000","last_peered":"2024-05-09T09:53:18.198590+0000","last_clean":"2024-05-09T09:53:18.198590+0000","last_became_active":"2024-05-09T09:53:11.130286+0000","last_became_peered":"2024-05-09T09:53:11.130286+0000","last_unstale":"2024-05-09T09:53:18.198590+0000","last_undegraded":"2024-05-09T09:53:18.198590+0000","last_fullsized":"2024-05-09T09:53:18.198590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:59.197735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.754146+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:53:18.754146+0000","last_peered":"2024-05-09T09:53:18.754146+0000","last_clean":"2024-05-09T09:53:18.754146+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:53:18.754146+0000","last_undegraded":"2024-05-09T09:53:18.754146+0000","last_fullsized":"2024-05-09T09:53:18.754146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157755+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:53:18.157755+0000","last_peered":"2024-05-09T09:53:18.157755+0000","last_clean":"2024-05-09T09:53:18.157755+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:53:18.157755+0000","last_undegraded":"2024-05-09T09:53:18.157755+0000","last_fullsized":"2024-05-09T09:53:18.157755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200473+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:53:18.200473+0000","last_peered":"2024-05-09T09:53:18.200473+0000","last_clean":"2024-05-09T09:53:18.200473+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:53:18.200473+0000","last_undegraded":"2024-05-09T09:53:18.200473+0000","last_fullsized":"2024-05-09T09:53:18.200473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177536+0000","last_change":"2024-05-09T09:53:07.103925+0000","last_active":"2024-05-09T09:53:18.177536+0000","last_peered":"2024-05-09T09:53:18.177536+0000","last_clean":"2024-05-09T09:53:18.177536+0000","last_became_active":"2024-05-09T09:53:07.103470+0000","last_became_peered":"2024-05-09T09:53:07.103470+0000","last_unstale":"2024-05-09T09:53:18.177536+0000","last_undegraded":"2024-05-09T09:53:18.177536+0000","last_fullsized":"2024-05-09T09:53:18.177536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161990+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:53:18.161990+0000","last_peered":"2024-05-09T09:53:18.161990+0000","last_clean":"2024-05-09T09:53:18.161990+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:53:18.161990+0000","last_undegraded":"2024-05-09T09:53:18.161990+0000","last_fullsized":"2024-05-09T09:53:18.161990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.101722+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:53:19.101722+0000","last_peered":"2024-05-09T09:53:19.101722+0000","last_clean":"2024-05-09T09:53:19.101722+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:53:19.101722+0000","last_undegraded":"2024-05-09T09:53:19.101722+0000","last_fullsized":"2024-05-09T09:53:19.101722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195755+0000","last_change":"2024-05-09T09:53:15.165405+0000","last_active":"2024-05-09T09:53:18.195755+0000","last_peered":"2024-05-09T09:53:18.195755+0000","last_clean":"2024-05-09T09:53:18.195755+0000","last_became_active":"2024-05-09T09:53:15.164221+0000","last_became_peered":"2024-05-09T09:53:15.164221+0000","last_unstale":"2024-05-09T09:53:18.195755+0000","last_undegraded":"2024-05-09T09:53:18.195755+0000","last_fullsized":"2024-05-09T09:53:18.195755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:50.451431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177632+0000","last_change":"2024-05-09T09:53:17.269258+0000","last_active":"2024-05-09T09:53:18.177632+0000","last_peered":"2024-05-09T09:53:18.177632+0000","last_clean":"2024-05-09T09:53:18.177632+0000","last_became_active":"2024-05-09T09:53:17.268496+0000","last_became_peered":"2024-05-09T09:53:17.268496+0000","last_unstale":"2024-05-09T09:53:18.177632+0000","last_undegraded":"2024-05-09T09:53:18.177632+0000","last_fullsized":"2024-05-09T09:53:18.177632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:01.756096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162314+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:53:18.162314+0000","last_peered":"2024-05-09T09:53:18.162314+0000","last_clean":"2024-05-09T09:53:18.162314+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:53:18.162314+0000","last_undegraded":"2024-05-09T09:53:18.162314+0000","last_fullsized":"2024-05-09T09:53:18.162314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174953+0000","last_change":"2024-05-09T09:53:07.103329+0000","last_active":"2024-05-09T09:53:18.174953+0000","last_peered":"2024-05-09T09:53:18.174953+0000","last_clean":"2024-05-09T09:53:18.174953+0000","last_became_active":"2024-05-09T09:53:07.103022+0000","last_became_peered":"2024-05-09T09:53:07.103022+0000","last_unstale":"2024-05-09T09:53:18.174953+0000","last_undegraded":"2024-05-09T09:53:18.174953+0000","last_fullsized":"2024-05-09T09:53:18.174953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200240+0000","last_change":"2024-05-09T09:53:11.127978+0000","last_active":"2024-05-09T09:53:18.200240+0000","last_peered":"2024-05-09T09:53:18.200240+0000","last_clean":"2024-05-09T09:53:18.200240+0000","last_became_active":"2024-05-09T09:53:11.127238+0000","last_became_peered":"2024-05-09T09:53:11.127238+0000","last_unstale":"2024-05-09T09:53:18.200240+0000","last_undegraded":"2024-05-09T09:53:18.200240+0000","last_fullsized":"2024-05-09T09:53:18.200240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:55.336391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.881973+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:53:18.881973+0000","last_peered":"2024-05-09T09:53:18.881973+0000","last_clean":"2024-05-09T09:53:18.881973+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:53:18.881973+0000","last_undegraded":"2024-05-09T09:53:18.881973+0000","last_fullsized":"2024-05-09T09:53:18.881973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.175234+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:53:18.175234+0000","last_peered":"2024-05-09T09:53:18.175234+0000","last_clean":"2024-05-09T09:53:18.175234+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:53:18.175234+0000","last_undegraded":"2024-05-09T09:53:18.175234+0000","last_fullsized":"2024-05-09T09:53:18.175234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198534+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:53:18.198534+0000","last_peered":"2024-05-09T09:53:18.198534+0000","last_clean":"2024-05-09T09:53:18.198534+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:53:18.198534+0000","last_undegraded":"2024-05-09T09:53:18.198534+0000","last_fullsized":"2024-05-09T09:53:18.198534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178331+0000","last_change":"2024-05-09T09:53:09.113372+0000","last_active":"2024-05-09T09:53:18.178331+0000","last_peered":"2024-05-09T09:53:18.178331+0000","last_clean":"2024-05-09T09:53:18.178331+0000","last_became_active":"2024-05-09T09:53:09.113041+0000","last_became_peered":"2024-05-09T09:53:09.113041+0000","last_unstale":"2024-05-09T09:53:18.178331+0000","last_undegraded":"2024-05-09T09:53:18.178331+0000","last_fullsized":"2024-05-09T09:53:18.178331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:00.152062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158708+0000","last_change":"2024-05-09T09:53:07.104225+0000","last_active":"2024-05-09T09:53:18.158708+0000","last_peered":"2024-05-09T09:53:18.158708+0000","last_clean":"2024-05-09T09:53:18.158708+0000","last_became_active":"2024-05-09T09:53:07.103490+0000","last_became_peered":"2024-05-09T09:53:07.103490+0000","last_unstale":"2024-05-09T09:53:18.158708+0000","last_undegraded":"2024-05-09T09:53:18.158708+0000","last_fullsized":"2024-05-09T09:53:18.158708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:09.427100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159831+0000","last_change":"2024-05-09T09:53:11.125866+0000","last_active":"2024-05-09T09:53:18.159831+0000","last_peered":"2024-05-09T09:53:18.159831+0000","last_clean":"2024-05-09T09:53:18.159831+0000","last_became_active":"2024-05-09T09:53:11.125057+0000","last_became_peered":"2024-05-09T09:53:11.125057+0000","last_unstale":"2024-05-09T09:53:18.159831+0000","last_undegraded":"2024-05-09T09:53:18.159831+0000","last_fullsized":"2024-05-09T09:53:18.159831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:17.548338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.080751+0000","last_change":"2024-05-09T09:53:13.152997+0000","last_active":"2024-05-09T09:53:19.080751+0000","last_peered":"2024-05-09T09:53:19.080751+0000","last_clean":"2024-05-09T09:53:19.080751+0000","last_became_active":"2024-05-09T09:53:13.152490+0000","last_became_peered":"2024-05-09T09:53:13.152490+0000","last_unstale":"2024-05-09T09:53:19.080751+0000","last_undegraded":"2024-05-09T09:53:19.080751+0000","last_fullsized":"2024-05-09T09:53:19.080751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:45.449537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174430+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:53:18.174430+0000","last_peered":"2024-05-09T09:53:18.174430+0000","last_clean":"2024-05-09T09:53:18.174430+0000","last_became_active":"2024-05-09T09:53:15.167480+0000","last_became_peered":"2024-05-09T09:53:15.167480+0000","last_unstale":"2024-05-09T09:53:18.174430+0000","last_undegraded":"2024-05-09T09:53:18.174430+0000","last_fullsized":"2024-05-09T09:53:18.174430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:07.450989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193836+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:53:18.193836+0000","last_peered":"2024-05-09T09:53:18.193836+0000","last_clean":"2024-05-09T09:53:18.193836+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:53:18.193836+0000","last_undegraded":"2024-05-09T09:53:18.193836+0000","last_fullsized":"2024-05-09T09:53:18.193836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160799+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:53:18.160799+0000","last_peered":"2024-05-09T09:53:18.160799+0000","last_clean":"2024-05-09T09:53:18.160799+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:53:18.160799+0000","last_undegraded":"2024-05-09T09:53:18.160799+0000","last_fullsized":"2024-05-09T09:53:18.160799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157992+0000","last_change":"2024-05-09T09:53:07.107647+0000","last_active":"2024-05-09T09:53:18.157992+0000","last_peered":"2024-05-09T09:53:18.157992+0000","last_clean":"2024-05-09T09:53:18.157992+0000","last_became_active":"2024-05-09T09:53:07.107326+0000","last_became_peered":"2024-05-09T09:53:07.107326+0000","last_unstale":"2024-05-09T09:53:18.157992+0000","last_undegraded":"2024-05-09T09:53:18.157992+0000","last_fullsized":"2024-05-09T09:53:18.157992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.175814+0000","last_change":"2024-05-09T09:53:11.125346+0000","last_active":"2024-05-09T09:53:18.175814+0000","last_peered":"2024-05-09T09:53:18.175814+0000","last_clean":"2024-05-09T09:53:18.175814+0000","last_became_active":"2024-05-09T09:53:11.124846+0000","last_became_peered":"2024-05-09T09:53:11.124846+0000","last_unstale":"2024-05-09T09:53:18.175814+0000","last_undegraded":"2024-05-09T09:53:18.175814+0000","last_fullsized":"2024-05-09T09:53:18.175814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.060563+0000","last_change":"2024-05-09T09:53:13.150296+0000","last_active":"2024-05-09T09:53:19.060563+0000","last_peered":"2024-05-09T09:53:19.060563+0000","last_clean":"2024-05-09T09:53:19.060563+0000","last_became_active":"2024-05-09T09:53:13.149026+0000","last_became_peered":"2024-05-09T09:53:13.149026+0000","last_unstale":"2024-05-09T09:53:19.060563+0000","last_undegraded":"2024-05-09T09:53:19.060563+0000","last_fullsized":"2024-05-09T09:53:19.060563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:24.892942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"27'2","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199515+0000","last_change":"2024-05-09T09:53:15.174263+0000","last_active":"2024-05-09T09:53:18.199515+0000","last_peered":"2024-05-09T09:53:18.199515+0000","last_clean":"2024-05-09T09:53:18.199515+0000","last_became_active":"2024-05-09T09:53:15.173074+0000","last_became_peered":"2024-05-09T09:53:15.173074+0000","last_unstale":"2024-05-09T09:53:18.199515+0000","last_undegraded":"2024-05-09T09:53:18.199515+0000","last_fullsized":"2024-05-09T09:53:18.199515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:02.424004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187093+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:53:18.187093+0000","last_peered":"2024-05-09T09:53:18.187093+0000","last_clean":"2024-05-09T09:53:18.187093+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:53:18.187093+0000","last_undegraded":"2024-05-09T09:53:18.187093+0000","last_fullsized":"2024-05-09T09:53:18.187093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157873+0000","last_change":"2024-05-09T09:53:09.121084+0000","last_active":"2024-05-09T09:53:18.157873+0000","last_peered":"2024-05-09T09:53:18.157873+0000","last_clean":"2024-05-09T09:53:18.157873+0000","last_became_active":"2024-05-09T09:53:09.120348+0000","last_became_peered":"2024-05-09T09:53:09.120348+0000","last_unstale":"2024-05-09T09:53:18.157873+0000","last_undegraded":"2024-05-09T09:53:18.157873+0000","last_fullsized":"2024-05-09T09:53:18.157873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196299+0000","last_change":"2024-05-09T09:53:07.123579+0000","last_active":"2024-05-09T09:53:18.196299+0000","last_peered":"2024-05-09T09:53:18.196299+0000","last_clean":"2024-05-09T09:53:18.196299+0000","last_became_active":"2024-05-09T09:53:07.118568+0000","last_became_peered":"2024-05-09T09:53:07.118568+0000","last_unstale":"2024-05-09T09:53:18.196299+0000","last_undegraded":"2024-05-09T09:53:18.196299+0000","last_fullsized":"2024-05-09T09:53:18.196299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:14:06.373527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187642+0000","last_change":"2024-05-09T09:53:11.116337+0000","last_active":"2024-05-09T09:53:18.187642+0000","last_peered":"2024-05-09T09:53:18.187642+0000","last_clean":"2024-05-09T09:53:18.187642+0000","last_became_active":"2024-05-09T09:53:11.115610+0000","last_became_peered":"2024-05-09T09:53:11.115610+0000","last_unstale":"2024-05-09T09:53:18.187642+0000","last_undegraded":"2024-05-09T09:53:18.187642+0000","last_fullsized":"2024-05-09T09:53:18.187642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:19.095177+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:53:19.095177+0000","last_peered":"2024-05-09T09:53:19.095177+0000","last_clean":"2024-05-09T09:53:19.095177+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:53:19.095177+0000","last_undegraded":"2024-05-09T09:53:19.095177+0000","last_fullsized":"2024-05-09T09:53:19.095177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.156639+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:53:18.156639+0000","last_peered":"2024-05-09T09:53:18.156639+0000","last_clean":"2024-05-09T09:53:18.156639+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:53:18.156639+0000","last_undegraded":"2024-05-09T09:53:18.156639+0000","last_fullsized":"2024-05-09T09:53:18.156639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190846+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:53:18.190846+0000","last_peered":"2024-05-09T09:53:18.190846+0000","last_clean":"2024-05-09T09:53:18.190846+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:53:18.190846+0000","last_undegraded":"2024-05-09T09:53:18.190846+0000","last_fullsized":"2024-05-09T09:53:18.190846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158333+0000","last_change":"2024-05-09T09:53:09.120876+0000","last_active":"2024-05-09T09:53:18.158333+0000","last_peered":"2024-05-09T09:53:18.158333+0000","last_clean":"2024-05-09T09:53:18.158333+0000","last_became_active":"2024-05-09T09:53:09.120155+0000","last_became_peered":"2024-05-09T09:53:09.120155+0000","last_unstale":"2024-05-09T09:53:18.158333+0000","last_undegraded":"2024-05-09T09:53:18.158333+0000","last_fullsized":"2024-05-09T09:53:18.158333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196391+0000","last_change":"2024-05-09T09:53:07.121558+0000","last_active":"2024-05-09T09:53:18.196391+0000","last_peered":"2024-05-09T09:53:18.196391+0000","last_clean":"2024-05-09T09:53:18.196391+0000","last_became_active":"2024-05-09T09:53:07.118305+0000","last_became_peered":"2024-05-09T09:53:07.118305+0000","last_unstale":"2024-05-09T09:53:18.196391+0000","last_undegraded":"2024-05-09T09:53:18.196391+0000","last_fullsized":"2024-05-09T09:53:18.196391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:39.127020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194663+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:53:18.194663+0000","last_peered":"2024-05-09T09:53:18.194663+0000","last_clean":"2024-05-09T09:53:18.194663+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:53:18.194663+0000","last_undegraded":"2024-05-09T09:53:18.194663+0000","last_fullsized":"2024-05-09T09:53:18.194663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.476158+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:53:18.476158+0000","last_peered":"2024-05-09T09:53:18.476158+0000","last_clean":"2024-05-09T09:53:18.476158+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:53:18.476158+0000","last_undegraded":"2024-05-09T09:53:18.476158+0000","last_fullsized":"2024-05-09T09:53:18.476158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198198+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:53:18.198198+0000","last_peered":"2024-05-09T09:53:18.198198+0000","last_clean":"2024-05-09T09:53:18.198198+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:53:18.198198+0000","last_undegraded":"2024-05-09T09:53:18.198198+0000","last_fullsized":"2024-05-09T09:53:18.198198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178921+0000","last_change":"2024-05-09T09:53:17.266584+0000","last_active":"2024-05-09T09:53:18.178921+0000","last_peered":"2024-05-09T09:53:18.178921+0000","last_clean":"2024-05-09T09:53:18.178921+0000","last_became_active":"2024-05-09T09:53:17.265947+0000","last_became_peered":"2024-05-09T09:53:17.265947+0000","last_unstale":"2024-05-09T09:53:18.178921+0000","last_undegraded":"2024-05-09T09:53:18.178921+0000","last_fullsized":"2024-05-09T09:53:18.178921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.231815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177878+0000","last_change":"2024-05-09T09:53:09.121438+0000","last_active":"2024-05-09T09:53:18.177878+0000","last_peered":"2024-05-09T09:53:18.177878+0000","last_clean":"2024-05-09T09:53:18.177878+0000","last_became_active":"2024-05-09T09:53:09.121156+0000","last_became_peered":"2024-05-09T09:53:09.121156+0000","last_unstale":"2024-05-09T09:53:18.177878+0000","last_undegraded":"2024-05-09T09:53:18.177878+0000","last_fullsized":"2024-05-09T09:53:18.177878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:59.690822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179482+0000","last_change":"2024-05-09T09:53:07.131445+0000","last_active":"2024-05-09T09:53:18.179482+0000","last_peered":"2024-05-09T09:53:18.179482+0000","last_clean":"2024-05-09T09:53:18.179482+0000","last_became_active":"2024-05-09T09:53:07.131006+0000","last_became_peered":"2024-05-09T09:53:07.131006+0000","last_unstale":"2024-05-09T09:53:18.179482+0000","last_undegraded":"2024-05-09T09:53:18.179482+0000","last_fullsized":"2024-05-09T09:53:18.179482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157060+0000","last_change":"2024-05-09T09:53:11.127575+0000","last_active":"2024-05-09T09:53:18.157060+0000","last_peered":"2024-05-09T09:53:18.157060+0000","last_clean":"2024-05-09T09:53:18.157060+0000","last_became_active":"2024-05-09T09:53:11.126808+0000","last_became_peered":"2024-05-09T09:53:11.126808+0000","last_unstale":"2024-05-09T09:53:18.157060+0000","last_undegraded":"2024-05-09T09:53:18.157060+0000","last_fullsized":"2024-05-09T09:53:18.157060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:38.305934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.705026+0000","last_change":"2024-05-09T09:53:13.140437+0000","last_active":"2024-05-09T09:53:18.705026+0000","last_peered":"2024-05-09T09:53:18.705026+0000","last_clean":"2024-05-09T09:53:18.705026+0000","last_became_active":"2024-05-09T09:53:13.138894+0000","last_became_peered":"2024-05-09T09:53:13.138894+0000","last_unstale":"2024-05-09T09:53:18.705026+0000","last_undegraded":"2024-05-09T09:53:18.705026+0000","last_fullsized":"2024-05-09T09:53:18.705026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:14.004547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157430+0000","last_change":"2024-05-09T09:53:15.176295+0000","last_active":"2024-05-09T09:53:18.157430+0000","last_peered":"2024-05-09T09:53:18.157430+0000","last_clean":"2024-05-09T09:53:18.157430+0000","last_became_active":"2024-05-09T09:53:15.175573+0000","last_became_peered":"2024-05-09T09:53:15.175573+0000","last_unstale":"2024-05-09T09:53:18.157430+0000","last_undegraded":"2024-05-09T09:53:18.157430+0000","last_fullsized":"2024-05-09T09:53:18.157430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190037+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:53:18.190037+0000","last_peered":"2024-05-09T09:53:18.190037+0000","last_clean":"2024-05-09T09:53:18.190037+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:53:18.190037+0000","last_undegraded":"2024-05-09T09:53:18.190037+0000","last_fullsized":"2024-05-09T09:53:18.190037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157578+0000","last_change":"2024-05-09T09:53:09.130931+0000","last_active":"2024-05-09T09:53:18.157578+0000","last_peered":"2024-05-09T09:53:18.157578+0000","last_clean":"2024-05-09T09:53:18.157578+0000","last_became_active":"2024-05-09T09:53:09.130179+0000","last_became_peered":"2024-05-09T09:53:09.130179+0000","last_unstale":"2024-05-09T09:53:18.157578+0000","last_undegraded":"2024-05-09T09:53:18.157578+0000","last_fullsized":"2024-05-09T09:53:18.157578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162363+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:53:18.162363+0000","last_peered":"2024-05-09T09:53:18.162363+0000","last_clean":"2024-05-09T09:53:18.162363+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:53:18.162363+0000","last_undegraded":"2024-05-09T09:53:18.162363+0000","last_fullsized":"2024-05-09T09:53:18.162363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173151+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:53:18.173151+0000","last_peered":"2024-05-09T09:53:18.173151+0000","last_clean":"2024-05-09T09:53:18.173151+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:53:18.173151+0000","last_undegraded":"2024-05-09T09:53:18.173151+0000","last_fullsized":"2024-05-09T09:53:18.173151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.774267+0000","last_change":"2024-05-09T09:53:13.128389+0000","last_active":"2024-05-09T09:53:18.774267+0000","last_peered":"2024-05-09T09:53:18.774267+0000","last_clean":"2024-05-09T09:53:18.774267+0000","last_became_active":"2024-05-09T09:53:13.127697+0000","last_became_peered":"2024-05-09T09:53:13.127697+0000","last_unstale":"2024-05-09T09:53:18.774267+0000","last_undegraded":"2024-05-09T09:53:18.774267+0000","last_fullsized":"2024-05-09T09:53:18.774267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157290+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:53:18.157290+0000","last_peered":"2024-05-09T09:53:18.157290+0000","last_clean":"2024-05-09T09:53:18.157290+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:53:18.157290+0000","last_undegraded":"2024-05-09T09:53:18.157290+0000","last_fullsized":"2024-05-09T09:53:18.157290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160203+0000","last_change":"2024-05-09T09:53:17.176598+0000","last_active":"2024-05-09T09:53:18.160203+0000","last_peered":"2024-05-09T09:53:18.160203+0000","last_clean":"2024-05-09T09:53:18.160203+0000","last_became_active":"2024-05-09T09:53:17.175830+0000","last_became_peered":"2024-05-09T09:53:17.175830+0000","last_unstale":"2024-05-09T09:53:18.160203+0000","last_undegraded":"2024-05-09T09:53:18.160203+0000","last_fullsized":"2024-05-09T09:53:18.160203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:27:02.510774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174147+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:53:18.174147+0000","last_peered":"2024-05-09T09:53:18.174147+0000","last_clean":"2024-05-09T09:53:18.174147+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:53:18.174147+0000","last_undegraded":"2024-05-09T09:53:18.174147+0000","last_fullsized":"2024-05-09T09:53:18.174147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198201+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:53:18.198201+0000","last_peered":"2024-05-09T09:53:18.198201+0000","last_clean":"2024-05-09T09:53:18.198201+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:53:18.198201+0000","last_undegraded":"2024-05-09T09:53:18.198201+0000","last_fullsized":"2024-05-09T09:53:18.198201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.173961+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:53:18.173961+0000","last_peered":"2024-05-09T09:53:18.173961+0000","last_clean":"2024-05-09T09:53:18.173961+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:53:18.173961+0000","last_undegraded":"2024-05-09T09:53:18.173961+0000","last_fullsized":"2024-05-09T09:53:18.173961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157482+0000","last_change":"2024-05-09T09:53:07.119886+0000","last_active":"2024-05-09T09:53:18.157482+0000","last_peered":"2024-05-09T09:53:18.157482+0000","last_clean":"2024-05-09T09:53:18.157482+0000","last_became_active":"2024-05-09T09:53:07.119494+0000","last_became_peered":"2024-05-09T09:53:07.119494+0000","last_unstale":"2024-05-09T09:53:18.157482+0000","last_undegraded":"2024-05-09T09:53:18.157482+0000","last_fullsized":"2024-05-09T09:53:18.157482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:52:06.786227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.195965+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:53:18.195965+0000","last_peered":"2024-05-09T09:53:18.195965+0000","last_clean":"2024-05-09T09:53:18.195965+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:53:18.195965+0000","last_undegraded":"2024-05-09T09:53:18.195965+0000","last_fullsized":"2024-05-09T09:53:18.195965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194610+0000","last_change":"2024-05-09T09:53:07.124474+0000","last_active":"2024-05-09T09:53:18.194610+0000","last_peered":"2024-05-09T09:53:18.194610+0000","last_clean":"2024-05-09T09:53:18.194610+0000","last_became_active":"2024-05-09T09:53:07.123723+0000","last_became_peered":"2024-05-09T09:53:07.123723+0000","last_unstale":"2024-05-09T09:53:18.194610+0000","last_undegraded":"2024-05-09T09:53:18.194610+0000","last_fullsized":"2024-05-09T09:53:18.194610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:07.985561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174385+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:53:18.174385+0000","last_peered":"2024-05-09T09:53:18.174385+0000","last_clean":"2024-05-09T09:53:18.174385+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:53:18.174385+0000","last_undegraded":"2024-05-09T09:53:18.174385+0000","last_fullsized":"2024-05-09T09:53:18.174385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158585+0000","last_change":"2024-05-09T09:53:07.105696+0000","last_active":"2024-05-09T09:53:18.158585+0000","last_peered":"2024-05-09T09:53:18.158585+0000","last_clean":"2024-05-09T09:53:18.158585+0000","last_became_active":"2024-05-09T09:53:07.105002+0000","last_became_peered":"2024-05-09T09:53:07.105002+0000","last_unstale":"2024-05-09T09:53:18.158585+0000","last_undegraded":"2024-05-09T09:53:18.158585+0000","last_fullsized":"2024-05-09T09:53:18.158585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178988+0000","last_change":"2024-05-09T09:53:09.133442+0000","last_active":"2024-05-09T09:53:18.178988+0000","last_peered":"2024-05-09T09:53:18.178988+0000","last_clean":"2024-05-09T09:53:18.178988+0000","last_became_active":"2024-05-09T09:53:09.133057+0000","last_became_peered":"2024-05-09T09:53:09.133057+0000","last_unstale":"2024-05-09T09:53:18.178988+0000","last_undegraded":"2024-05-09T09:53:18.178988+0000","last_fullsized":"2024-05-09T09:53:18.178988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:41.224127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179238+0000","last_change":"2024-05-09T09:53:07.112550+0000","last_active":"2024-05-09T09:53:18.179238+0000","last_peered":"2024-05-09T09:53:18.179238+0000","last_clean":"2024-05-09T09:53:18.179238+0000","last_became_active":"2024-05-09T09:53:07.112154+0000","last_became_peered":"2024-05-09T09:53:07.112154+0000","last_unstale":"2024-05-09T09:53:18.179238+0000","last_undegraded":"2024-05-09T09:53:18.179238+0000","last_fullsized":"2024-05-09T09:53:18.179238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158602+0000","last_change":"2024-05-09T09:53:09.132281+0000","last_active":"2024-05-09T09:53:18.158602+0000","last_peered":"2024-05-09T09:53:18.158602+0000","last_clean":"2024-05-09T09:53:18.158602+0000","last_became_active":"2024-05-09T09:53:09.131536+0000","last_became_peered":"2024-05-09T09:53:09.131536+0000","last_unstale":"2024-05-09T09:53:18.158602+0000","last_undegraded":"2024-05-09T09:53:18.158602+0000","last_fullsized":"2024-05-09T09:53:18.158602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:41.224127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176203+0000","last_change":"2024-05-09T09:53:07.106145+0000","last_active":"2024-05-09T09:53:18.176203+0000","last_peered":"2024-05-09T09:53:18.176203+0000","last_clean":"2024-05-09T09:53:18.176203+0000","last_became_active":"2024-05-09T09:53:07.105747+0000","last_became_peered":"2024-05-09T09:53:07.105747+0000","last_unstale":"2024-05-09T09:53:18.176203+0000","last_undegraded":"2024-05-09T09:53:18.176203+0000","last_fullsized":"2024-05-09T09:53:18.176203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.177019+0000","last_change":"2024-05-09T09:53:09.114575+0000","last_active":"2024-05-09T09:53:18.177019+0000","last_peered":"2024-05-09T09:53:18.177019+0000","last_clean":"2024-05-09T09:53:18.177019+0000","last_became_active":"2024-05-09T09:53:09.114298+0000","last_became_peered":"2024-05-09T09:53:09.114298+0000","last_unstale":"2024-05-09T09:53:18.177019+0000","last_undegraded":"2024-05-09T09:53:18.177019+0000","last_fullsized":"2024-05-09T09:53:18.177019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.200509+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:53:18.200509+0000","last_peered":"2024-05-09T09:53:18.200509+0000","last_clean":"2024-05-09T09:53:18.200509+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:53:18.200509+0000","last_undegraded":"2024-05-09T09:53:18.200509+0000","last_fullsized":"2024-05-09T09:53:18.200509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.198046+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:53:18.198046+0000","last_peered":"2024-05-09T09:53:18.198046+0000","last_clean":"2024-05-09T09:53:18.198046+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:53:18.198046+0000","last_undegraded":"2024-05-09T09:53:18.198046+0000","last_fullsized":"2024-05-09T09:53:18.198046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.179792+0000","last_change":"2024-05-09T09:53:07.120609+0000","last_active":"2024-05-09T09:53:18.179792+0000","last_peered":"2024-05-09T09:53:18.179792+0000","last_clean":"2024-05-09T09:53:18.179792+0000","last_became_active":"2024-05-09T09:53:07.120297+0000","last_became_peered":"2024-05-09T09:53:07.120297+0000","last_unstale":"2024-05-09T09:53:18.179792+0000","last_undegraded":"2024-05-09T09:53:18.179792+0000","last_fullsized":"2024-05-09T09:53:18.179792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:11.210918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162233+0000","last_change":"2024-05-09T09:53:09.113360+0000","last_active":"2024-05-09T09:53:18.162233+0000","last_peered":"2024-05-09T09:53:18.162233+0000","last_clean":"2024-05-09T09:53:18.162233+0000","last_became_active":"2024-05-09T09:53:09.112503+0000","last_became_peered":"2024-05-09T09:53:09.112503+0000","last_unstale":"2024-05-09T09:53:18.162233+0000","last_undegraded":"2024-05-09T09:53:18.162233+0000","last_fullsized":"2024-05-09T09:53:18.162233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194215+0000","last_change":"2024-05-09T09:53:07.117804+0000","last_active":"2024-05-09T09:53:18.194215+0000","last_peered":"2024-05-09T09:53:18.194215+0000","last_clean":"2024-05-09T09:53:18.194215+0000","last_became_active":"2024-05-09T09:53:07.116606+0000","last_became_peered":"2024-05-09T09:53:07.116606+0000","last_unstale":"2024-05-09T09:53:18.194215+0000","last_undegraded":"2024-05-09T09:53:18.194215+0000","last_fullsized":"2024-05-09T09:53:18.194215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:45:54.495728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159747+0000","last_change":"2024-05-09T09:53:09.107915+0000","last_active":"2024-05-09T09:53:18.159747+0000","last_peered":"2024-05-09T09:53:18.159747+0000","last_clean":"2024-05-09T09:53:18.159747+0000","last_became_active":"2024-05-09T09:53:09.106074+0000","last_became_peered":"2024-05-09T09:53:09.106074+0000","last_unstale":"2024-05-09T09:53:18.159747+0000","last_undegraded":"2024-05-09T09:53:18.159747+0000","last_fullsized":"2024-05-09T09:53:18.159747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:59.690822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.178148+0000","last_change":"2024-05-09T09:53:07.112376+0000","last_active":"2024-05-09T09:53:18.178148+0000","last_peered":"2024-05-09T09:53:18.178148+0000","last_clean":"2024-05-09T09:53:18.178148+0000","last_became_active":"2024-05-09T09:53:07.112006+0000","last_became_peered":"2024-05-09T09:53:07.112006+0000","last_unstale":"2024-05-09T09:53:18.178148+0000","last_undegraded":"2024-05-09T09:53:18.178148+0000","last_fullsized":"2024-05-09T09:53:18.178148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:14.443292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.160781+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:53:18.160781+0000","last_peered":"2024-05-09T09:53:18.160781+0000","last_clean":"2024-05-09T09:53:18.160781+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:53:18.160781+0000","last_undegraded":"2024-05-09T09:53:18.160781+0000","last_fullsized":"2024-05-09T09:53:18.160781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.194492+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:53:18.194492+0000","last_peered":"2024-05-09T09:53:18.194492+0000","last_clean":"2024-05-09T09:53:18.194492+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:53:18.194492+0000","last_undegraded":"2024-05-09T09:53:18.194492+0000","last_fullsized":"2024-05-09T09:53:18.194492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.159533+0000","last_change":"2024-05-09T09:53:09.131033+0000","last_active":"2024-05-09T09:53:18.159533+0000","last_peered":"2024-05-09T09:53:18.159533+0000","last_clean":"2024-05-09T09:53:18.159533+0000","last_became_active":"2024-05-09T09:53:09.130085+0000","last_became_peered":"2024-05-09T09:53:09.130085+0000","last_unstale":"2024-05-09T09:53:18.159533+0000","last_undegraded":"2024-05-09T09:53:18.159533+0000","last_fullsized":"2024-05-09T09:53:18.159533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.158830+0000","last_change":"2024-05-09T09:53:07.123707+0000","last_active":"2024-05-09T09:53:18.158830+0000","last_peered":"2024-05-09T09:53:18.158830+0000","last_clean":"2024-05-09T09:53:18.158830+0000","last_became_active":"2024-05-09T09:53:07.123386+0000","last_became_peered":"2024-05-09T09:53:07.123386+0000","last_unstale":"2024-05-09T09:53:18.158830+0000","last_undegraded":"2024-05-09T09:53:18.158830+0000","last_fullsized":"2024-05-09T09:53:18.158830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:26:39.731174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.188219+0000","last_change":"2024-05-09T09:53:09.134867+0000","last_active":"2024-05-09T09:53:18.188219+0000","last_peered":"2024-05-09T09:53:18.188219+0000","last_clean":"2024-05-09T09:53:18.188219+0000","last_became_active":"2024-05-09T09:53:09.132179+0000","last_became_peered":"2024-05-09T09:53:09.132179+0000","last_unstale":"2024-05-09T09:53:18.188219+0000","last_undegraded":"2024-05-09T09:53:18.188219+0000","last_fullsized":"2024-05-09T09:53:18.188219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.199295+0000","last_change":"2024-05-09T09:53:07.129637+0000","last_active":"2024-05-09T09:53:18.199295+0000","last_peered":"2024-05-09T09:53:18.199295+0000","last_clean":"2024-05-09T09:53:18.199295+0000","last_became_active":"2024-05-09T09:53:07.128900+0000","last_became_peered":"2024-05-09T09:53:07.128900+0000","last_unstale":"2024-05-09T09:53:18.199295+0000","last_undegraded":"2024-05-09T09:53:18.199295+0000","last_fullsized":"2024-05-09T09:53:18.199295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:26:39.731174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.157966+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:53:18.157966+0000","last_peered":"2024-05-09T09:53:18.157966+0000","last_clean":"2024-05-09T09:53:18.157966+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:53:18.157966+0000","last_undegraded":"2024-05-09T09:53:18.157966+0000","last_fullsized":"2024-05-09T09:53:18.157966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.190437+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:53:18.190437+0000","last_peered":"2024-05-09T09:53:18.190437+0000","last_clean":"2024-05-09T09:53:18.190437+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:53:18.190437+0000","last_undegraded":"2024-05-09T09:53:18.190437+0000","last_fullsized":"2024-05-09T09:53:18.190437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.176880+0000","last_change":"2024-05-09T09:53:09.126958+0000","last_active":"2024-05-09T09:53:18.176880+0000","last_peered":"2024-05-09T09:53:18.176880+0000","last_clean":"2024-05-09T09:53:18.176880+0000","last_became_active":"2024-05-09T09:53:09.126577+0000","last_became_peered":"2024-05-09T09:53:09.126577+0000","last_unstale":"2024-05-09T09:53:18.176880+0000","last_undegraded":"2024-05-09T09:53:18.176880+0000","last_fullsized":"2024-05-09T09:53:18.176880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.161934+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:53:18.161934+0000","last_peered":"2024-05-09T09:53:18.161934+0000","last_clean":"2024-05-09T09:53:18.161934+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:53:18.161934+0000","last_undegraded":"2024-05-09T09:53:18.161934+0000","last_fullsized":"2024-05-09T09:53:18.161934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.187334+0000","last_change":"2024-05-09T09:53:09.136266+0000","last_active":"2024-05-09T09:53:18.187334+0000","last_peered":"2024-05-09T09:53:18.187334+0000","last_clean":"2024-05-09T09:53:18.187334+0000","last_became_active":"2024-05-09T09:53:09.135638+0000","last_became_peered":"2024-05-09T09:53:09.135638+0000","last_unstale":"2024-05-09T09:53:18.187334+0000","last_undegraded":"2024-05-09T09:53:18.187334+0000","last_fullsized":"2024-05-09T09:53:18.187334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.197612+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:53:18.197612+0000","last_peered":"2024-05-09T09:53:18.197612+0000","last_clean":"2024-05-09T09:53:18.197612+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:53:18.197612+0000","last_undegraded":"2024-05-09T09:53:18.197612+0000","last_fullsized":"2024-05-09T09:53:18.197612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.193996+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:53:18.193996+0000","last_peered":"2024-05-09T09:53:18.193996+0000","last_clean":"2024-05-09T09:53:18.193996+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:53:18.193996+0000","last_undegraded":"2024-05-09T09:53:18.193996+0000","last_fullsized":"2024-05-09T09:53:18.193996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.162038+0000","last_change":"2024-05-09T09:53:09.113504+0000","last_active":"2024-05-09T09:53:18.162038+0000","last_peered":"2024-05-09T09:53:18.162038+0000","last_clean":"2024-05-09T09:53:18.162038+0000","last_became_active":"2024-05-09T09:53:09.112750+0000","last_became_peered":"2024-05-09T09:53:09.112750+0000","last_unstale":"2024-05-09T09:53:18.162038+0000","last_undegraded":"2024-05-09T09:53:18.162038+0000","last_fullsized":"2024-05-09T09:53:18.162038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.174500+0000","last_change":"2024-05-09T09:53:07.112133+0000","last_active":"2024-05-09T09:53:18.174500+0000","last_peered":"2024-05-09T09:53:18.174500+0000","last_clean":"2024-05-09T09:53:18.174500+0000","last_became_active":"2024-05-09T09:53:07.111827+0000","last_became_peered":"2024-05-09T09:53:07.111827+0000","last_unstale":"2024-05-09T09:53:18.174500+0000","last_undegraded":"2024-05-09T09:53:18.174500+0000","last_fullsized":"2024-05-09T09:53:18.174500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-09T09:53:18.196622+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:53:18.196622+0000","last_peered":"2024-05-09T09:53:18.196622+0000","last_clean":"2024-05-09T09:53:18.196622+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:53:18.196622+0000","last_undegraded":"2024-05-09T09:53:18.196622+0000","last_fullsized":"2024-05-09T09:53:18.196622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":738721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":146700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":401408,"data_stored":147964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":147627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":147096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":146262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":146950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":737134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:53:25.492 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T09:53:25.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-05-09T09:53:25.849 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 30 2024-05-09T09:53:25.849 INFO:teuthology.orchestra.run.smithi032.stdout:fsid ab394f08-fac0-4b9b-8c5e-bce336e83e29 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-05-09T09:52:48.405333+0000 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-05-09T09:53:18.149689+0000 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:crush_version 5 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:full_ratio 0.95 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:backfillfull_ratio 0.9 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:nearfull_ratio 0.85 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:require_min_compat_client luminous 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:min_compat_client jewel 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:require_osd_release squid 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:stretch_mode_enabled false 2024-05-09T09:53:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:max_osd 8 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/396091358,v1:172.21.15.32:6801/396091358] [v2:172.21.15.32:6802/396091358,v1:172.21.15.32:6803/396091358] exists,up b6d1a399-da26-41fd-8eed-493a7286aa6c 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/3047693294,v1:172.21.15.32:6825/3047693294] [v2:172.21.15.32:6826/3047693294,v1:172.21.15.32:6827/3047693294] exists,up 6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 up in weight 1 up_from 14 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/2852540861,v1:172.21.15.32:6809/2852540861] [v2:172.21.15.32:6810/2852540861,v1:172.21.15.32:6811/2852540861] exists,up 097e00bf-5d58-4fe5-8909-8d453783b9e5 2024-05-09T09:53:25.851 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6816/1396699085,v1:172.21.15.32:6817/1396699085] [v2:172.21.15.32:6818/1396699085,v1:172.21.15.32:6819/1396699085] exists,up ef14f326-2a6d-4bbb-9cce-e984a09db334 2024-05-09T09:53:25.852 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6800/2270167873,v1:172.21.15.80:6801/2270167873] [v2:172.21.15.80:6802/2270167873,v1:172.21.15.80:6803/2270167873] exists,up b609b2b6-6fec-4d82-8126-4c109f53093d 2024-05-09T09:53:25.852 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6808/1502875008,v1:172.21.15.80:6809/1502875008] [v2:172.21.15.80:6810/1502875008,v1:172.21.15.80:6811/1502875008] exists,up a8f7aea9-0c6f-4c2e-9541-b8780d58ec01 2024-05-09T09:53:25.852 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6816/2011375001,v1:172.21.15.80:6817/2011375001] [v2:172.21.15.80:6818/2011375001,v1:172.21.15.80:6819/2011375001] exists,up ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3 2024-05-09T09:53:25.852 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6824/4069183898,v1:172.21.15.80:6825/4069183898] [v2:172.21.15.80:6826/4069183898,v1:172.21.15.80:6827/4069183898] exists,up 777809d6-0cf6-4020-8efb-9f9df7bcea08 2024-05-09T09:53:25.868 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/396091358,v1:172.21.15.32:6801/396091358] [v2:172.21.15.32:6802/396091358,v1:172.21.15.32:6803/396091358] exists,up b6d1a399-da26-41fd-8eed-493a7286aa6c', 'osd.1 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/3047693294,v1:172.21.15.32:6825/3047693294] [v2:172.21.15.32:6826/3047693294,v1:172.21.15.32:6827/3047693294] exists,up 6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e', 'osd.2 up in weight 1 up_from 14 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/2852540861,v1:172.21.15.32:6809/2852540861] [v2:172.21.15.32:6810/2852540861,v1:172.21.15.32:6811/2852540861] exists,up 097e00bf-5d58-4fe5-8909-8d453783b9e5', 'osd.3 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6816/1396699085,v1:172.21.15.32:6817/1396699085] [v2:172.21.15.32:6818/1396699085,v1:172.21.15.32:6819/1396699085] exists,up ef14f326-2a6d-4bbb-9cce-e984a09db334', 'osd.4 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6800/2270167873,v1:172.21.15.80:6801/2270167873] [v2:172.21.15.80:6802/2270167873,v1:172.21.15.80:6803/2270167873] exists,up b609b2b6-6fec-4d82-8126-4c109f53093d', 'osd.5 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6808/1502875008,v1:172.21.15.80:6809/1502875008] [v2:172.21.15.80:6810/1502875008,v1:172.21.15.80:6811/1502875008] exists,up a8f7aea9-0c6f-4c2e-9541-b8780d58ec01', 'osd.6 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6816/2011375001,v1:172.21.15.80:6817/2011375001] [v2:172.21.15.80:6818/2011375001,v1:172.21.15.80:6819/2011375001] exists,up ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3', 'osd.7 up in weight 1 up_from 14 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.80:6824/4069183898,v1:172.21.15.80:6825/4069183898] [v2:172.21.15.80:6826/4069183898,v1:172.21.15.80:6827/4069183898] exists,up 777809d6-0cf6-4020-8efb-9f9df7bcea08'] 2024-05-09T09:53:25.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-05-09T09:53:25.990 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "name": "mon.a", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster": "ceph", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "admin_socket_mode": "", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_client_required": "cephx, none", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_cluster_required": "cephx", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_debug": "true", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_service_required": "cephx", 2024-05-09T09:53:25.991 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_service_ticket_ttl": "240.000000", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_supported": "cephx", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio": "true", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_max_queue_depth": "1024", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_poll_ms": "250", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_reap_max": "16", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_async_discard_threads": "0", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_block_size": "4096", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio": "false", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-05-09T09:53:25.992 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_inflight_ios": "false", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_enable_discard": "false", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_flock_retry": "3", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_flock_retry_interval": "0.100000", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_inject_crash": "0", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_inject_crash_flush_delay": "2", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring": "false", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring_hipri": "false", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring_sqthread_poll": "false", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_read_buffer_alignment": "4096", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-05-09T09:53:25.993 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_type": "", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_alloc_size": "1048576", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_allocator": "hybrid", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_buffered_io": "true", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_for_zeros": "false", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_volume_selector_often": "false", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_compact_log_sync": "false", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_compact_min_size": "16777216", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_replay_check_allocations": "true", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_max_log_runway": "4194304", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_max_prefetch": "1048576", 2024-05-09T09:53:25.994 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_min_flush_size": "524288", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_min_log_runway": "1048576", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_replay_recovery": "false", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_shared_alloc_size": "65536", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_sync_write": "false", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_allocation_from_file": "true", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_allocator": "hybrid", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-05-09T09:53:25.995 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blobid_prealloc": "10240", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_create": "true", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_create": "false", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_path": "", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_size": "0", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_path": "", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_preallocate_file": "false", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_size": "107374182400", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_create": "false", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_path": "", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_size": "100663296", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs": "true", 2024-05-09T09:53:25.996 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_env_mirror": "false", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_autotune": "true", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-05-09T09:53:25.997 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size": "0", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_type": "2q", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_clone_cow": "true", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_algorithm": "snappy", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size": "0", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size": "0", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-05-09T09:53:25.998 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_mode": "none", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_csum_type": "crc32c", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_enforce_settings": "default", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_freelist": "false", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_fsck_abort": "false", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_read_err": "false", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_legacy_omap": "false", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-05-09T09:53:25.999 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_prefill": "0.000000", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_small_allocations": "0", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_default_buffered_read": "true", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_default_buffered_write": "false", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops": "0", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_elastic_shared_blobs": "true", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-05-09T09:53:26.000 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fail_eio": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mkfs": "true", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mount": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_umount": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-05-09T09:53:26.001 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_ignore_data_csum": "false", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_kvbackend": "rocksdb", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_op_age": "5.000000", 2024-05-09T09:53:26.002 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_alloc_size": "0", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size": "0", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_defer_interval": "3.000000", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_deferred_txc": "32", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size": "0", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_nid_prealloc": "1024", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size": "0", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_qfsck_on_mount": "true", 2024-05-09T09:53:26.003 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_retry_disk_reads": "3", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_cf": "true", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_options_annex": "", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_coremask": "0x1", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_io_sleep": "5", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_max_io_completion": "0", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_mem": "512", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_sync_submit_transaction": "false", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_bytes": "67108864", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io": "0", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-05-09T09:53:26.004 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_tracing": "false", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_reserved": "0", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_zero_block_detection": "false", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_action_update_interval": "2", 2024-05-09T09:53:26.005 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_mount_timeout": "10", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_cluster_require_signatures": "false", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_cluster_require_version": "2", 2024-05-09T09:53:26.006 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_require_signatures": "false", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_require_version": "2", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_service_require_signatures": "false", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_service_require_version": "2", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_sign_messages": "true", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "chdir": "", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_acl_type": "", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_asio_thread_count": "2", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_cache_mid": "0.750000", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_cache_size": "16384", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_caps_release_delay": "5", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_check_pool_perm": "true", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_collect_and_send_global_metrics": "false", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_force_sync_read": "false", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_getattr_caps": "false", 2024-05-09T09:53:26.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_inject_tick_delay": "0", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_die_on_failed_remount": "false", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_dirsize_rbytes": "true", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_force_lazyio": "false", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_fs": "", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_inject_fixed_oldest_tid": "false", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_inject_release_failure": "false", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_max_inline_size": "4096", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_max_retries_on_remount_failure": "5", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mds_namespace": "", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_metadata": "", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_gid": "-1", 2024-05-09T09:53:26.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_timeout": "300", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_uid": "-1", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mountpoint": "/", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_notify_timeout": "10", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc": "true", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_dirty": "104857600", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_dirty_age": "5.000000", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_objects": "1000", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_size": "209715200", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_target_dirty": "8388608", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_permissions": "true", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_quota": "true", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_quota_df": "true", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_max_bytes": "0", 2024-05-09T09:53:26.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_max_periods": "4", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_min": "131072", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_reconnect_stale": "false", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_shutdown_timeout": "30", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_snapdir": ".snap", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_tick_interval": "1", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_trace": "", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_try_dentry_invalidate": "false", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_use_faked_inos": "false", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_use_random_mds": "false", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog": "false", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog_port": "12201", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_monitors": "default=true", 2024-05-09T09:53:26.010 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog": "false", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog_level": "info", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "-", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_network": "", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_network_interface": "", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_isal": "false", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_level": "5", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_winsize": "-15", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zstd_level": "1", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_alien_op_num_threads": "6", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_alien_thread_cpu_cores": "", 2024-05-09T09:53:26.011 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_obc_lru_size": "512", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_stat_interval": "0", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_seastar_cpu_cores": "", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location": "", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location_hook": "", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location_hook_timeout": "10", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "daemonize": "false", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "daos_pool": "tank", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_db_name_prefix": "dbstore", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_alienstore": "0/5", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_allow_any_pool_priority": "false", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asok": "1/5", 2024-05-09T09:53:26.012 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asok_assert_abort": "false", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asserts_on_shutdown": "true", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_auth": "20/20", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bdev": "1/3", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bluefs": "1/5", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bluestore": "1/5", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_buffer": "0/1", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ceph_exporter": "1/5", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cephfs_mirror": "0/5", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cephsqlite": "0/5", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_client": "0/5", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_compressor": "1/5", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_context": "0/1", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crimson_interrupt": "0/5", 2024-05-09T09:53:26.013 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crush": "1/1", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crypto": "1/5", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cyanstore": "0/5", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_deliberately_leak_memory": "false", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_disable_randomized_ping": "false", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_dpdk": "1/5", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_eventtrace": "1/5", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_filer": "0/1", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_filestore": "1/3", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_finisher": "1/1", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_fuse": "1/5", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_heartbeat_testing_span": "0", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_heartbeatmap": "1/5", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_immutable_obj_cache": "0/5", 2024-05-09T09:53:26.014 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_javaclient": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_journal": "1/3", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_journaler": "0/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_kstore": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_lockdep": "0/1", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mclock": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_balancer": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_locker": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_log": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_log_expire": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_migrator": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_quiesce": "3/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_memstore": "1/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mgr": "2/5", 2024-05-09T09:53:26.015 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mgrc": "1/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mon": "20/20", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_monc": "0/10", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ms": "1/1", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_none": "0/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objclass": "0/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objectcacher": "0/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objecter": "0/1", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_optracker": "0/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_osd": "1/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_paxos": "20/20", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_perfcounter": "1/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_prioritycache": "1/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rados": "0/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd": "0/5", 2024-05-09T09:53:26.016 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_mirror": "0/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_pwl": "0/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_replay": "0/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_refs": "0/0", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_reserver": "1/1", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw": "1/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_access": "1/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_datacache": "1/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_dbstore": "1/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_flight": "1/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_lifecycle": "1/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_notification": "1/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_sync": "1/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rocksdb": "4/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore": "0/5", 2024-05-09T09:53:26.017 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_backref": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_cache": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_cleaner": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_device": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_epm": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_journal": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_lba": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_odata": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_omap": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_onode": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_t": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_tm": "0/5", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_striper": "0/1", 2024-05-09T09:53:26.018 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_test": "0/5", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_throttle": "1/1", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_timer": "0/1", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_tp": "0/5", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_trace": "1/5", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "device_failure_prediction_mode": "none", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_graylog": "false", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_journald": "false", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_stderr": "true", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_syslog": "false", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event_tracing": "false", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_addr": "0.0.0.0", 2024-05-09T09:53:26.019 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_http_port": "9926", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_prio_limit": "5", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_sort_metrics": "true", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_stats_period": "5", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "fake_statfs_for_testing": "0", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "fatal_signal_handlers": "true", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filer_max_purge_ops": "10", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filer_max_truncate_ops": "128", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_apply_finisher_threads": "1", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_blackhole": "false", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_btrfs_clone_range": "true", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_btrfs_snap": "true", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_caller_concurrency": "10", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_collect_device_partition_information": "true", 2024-05-09T09:53:26.020 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_commit_timeout": "600.000000", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_inject_read_err": "false", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_omap_check": "false", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_verify_split": "false", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_dump_file": "", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fadvise": "true", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fail_eio": "true", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fd_cache_shards": "16", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fd_cache_size": "128", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fiemap": "false", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fiemap_threshold": "4096", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_index_retry_probability": "0.000000", 2024-05-09T09:53:26.021 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_inject_stall": "0", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_parallel": "false", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_trailing": "false", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_writeahead": "false", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_kill_at": "0", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size": "0", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs": "0", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_other": "2", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-05-09T09:53:26.022 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_sync_interval": "5.000000", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size": "0", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_merge_threshold": "-10", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_min_sync_interval": "0.010000", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_odsync_write": "false", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_backend": "rocksdb", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_backend_path": "", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_header_cache_size": "1024", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_ondisk_finisher_threads": "1", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_thread_timeout": "60", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_threads": "2", 2024-05-09T09:53:26.023 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_punch_hole": "false", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_bytes": "104857600", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_ops": "50", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_seek_data_hole": "false", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_sloppy_crc": "false", 2024-05-09T09:53:26.024 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_splice": "false", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_split_multiple": "2", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_split_rand_factor": "20", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_update_to": "1000", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_enable": "true", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-05-09T09:53:26.025 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_xfs_extsize": "false", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_zfs_snap": "false", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fio_dir": "/tmp/fio", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fsid": "ab394f08-fac0-4b9b-8c5e-bce336e83e29", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_allow_other": "true", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_atomic_o_trunc": "true", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_big_writes": "true", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_debug": "false", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_default_permissions": "false", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_disable_pagecache": "false", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_max_write": "0", 2024-05-09T09:53:26.026 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_multithreaded": "true", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_require_active_mds": "true", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_set_user_groups": "true", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_move": "true", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_read": "true", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_write": "true", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_syncfs_on_mksnap": "true", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_use_invalidate_cb": "true", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "gss_target_name": "ceph", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_file": "", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_inject_failure": "0", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_interval": "5", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "host": "smithi032", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-05-09T09:53:26.027 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_max_size": "1073741824", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_watermark": "0.900000", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "inject_early_sigterm": "false", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "jaeger_agent_port": "6799", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "jaeger_tracing_enable": "false", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_aio": "true", 2024-05-09T09:53:26.028 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_align_min_size": "65536", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_block_align": "true", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_block_size": "4096", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_dio": "true", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_discard": "false", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_force_aio": "false", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_ignore_corruption": "false", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_max_write_bytes": "10485760", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_max_write_entries": "100", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_replay_from": "0", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_high_multiple": "0.000000", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_max_multiple": "0.000000", 2024-05-09T09:53:26.029 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_write_header_frequency": "0", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_zero_on_create": "false", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_prefetch_periods": "10", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_prezero_periods": "5", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_write_head_interval": "15", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "keyfile": "", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_backend": "rocksdb", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_default_stripe_size": "65536", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_fsck_on_mount": "false", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_fsck_on_mount_deep": "true", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_max_bytes": "67108864", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_max_ops": "512", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_nid_prealloc": "1024", 2024-05-09T09:53:26.030 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_onode_map_size": "1024", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_sync_submit_transaction": "false", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_sync_transaction": "false", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "librados_thread_count": "2", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "lockdep": "false", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "lockdep_force_backtrace": "false", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "log_coarse_timestamps": "true", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "log_flush_on_exit": "false", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "log_graylog_host": "127.0.0.1", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "log_graylog_port": "12201", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "log_max_new": "1000", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "log_max_recent": "10000", 2024-05-09T09:53:26.031 INFO:teuthology.orchestra.run.smithi032.stdout: "log_stderr_prefix": "", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "log_stop_at_utilization": "0.970000", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_file": "true", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_graylog": "false", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_journald": "false", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_stderr": "false", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_syslog": "false", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "max_rotating_auth_attempts": "10", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_action_on_write_error": "1", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_alternate_name_max": "8192", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_asio_thread_count": "2", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_export_pin": "true", 2024-05-09T09:53:26.032 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_dirs": "true", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_interval": "5", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_size_max": "100000", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_idle_threshold": "0.000000", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_interval": "10", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_max": "-1", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_max_until": "-1", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_merge_size": "50", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_midchunk": "0.300000", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_min_rebalance": "0.100000", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_min_start": "0.200000", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_minchunk": "0.001000", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_mode": "0", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_need_max": "1.200000", 2024-05-09T09:53:26.033 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_need_min": "0.800000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_overload_epochs": "2", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_sample_interval": "3.000000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_bits": "3", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_rd": "25000.000000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_size": "10000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_wr": "10000.000000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_target_decay": "10.000000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_grace": "15.000000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_interval": "4.000000", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_mon_down_grace": "60", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_memory_limit": "4294967296", 2024-05-09T09:53:26.034 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_mid": "0.700000", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_delay": "0", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_sleep": "200", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_splitauth": "true", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_threshold": "524288", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_release_free_interval": "10", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_reservation": "0.050000", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_interval": "1", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_threshold": "262144", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_delegate_inos_pct": "50", 2024-05-09T09:53:26.035 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_prealloc_inos": "1000", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_connect_bootstrapping": "false", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_damage_table_max_entries": "10000", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_auth_pins": "false", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_frag": "false", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_scatterstat": "false", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_subtrees": "false", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_decay_halflife": "5.000000", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_default_dir_hash": "2", 2024-05-09T09:53:26.036 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_defer_session_stale": "true", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_deny_all_reconnect": "false", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_keys_per_op": "16384", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_max_commit_size": "10", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_max_entries": "0", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_prefetch": "true", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dirstat_min_interval": "1.000000", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_after_rejoin": "false", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_on_map": "false", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_threshold_file": "0", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_early_reply": "true", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_enable_op_tracker": "true", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_enforce_unique_name": "true", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_distributed": "true", 2024-05-09T09:53:26.037 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_random": "true", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_forward_all_requests_to_auth": "false", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_health_cache_threshold": "1.500000", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_health_summarize_threshold": "10", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_heartbeat_grace": "15.000000", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_heartbeat_reset_grace": "1000", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_health_dummy": "false", 2024-05-09T09:53:26.038 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_migrator_session_race": "false", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_join_fs": "", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_journal_format": "1", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_create_at": "0", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_export_at": "0", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_import_at": "0", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_at": "0", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_expire_at": "0", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_replay_at": "0", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_link_at": "0", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_mdstable_at": "0", 2024-05-09T09:53:26.039 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_openc_at": "0", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_rename_at": "0", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_shutdown_at": "0", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_event_large_threshold": "524288", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_events_per_segment": "1024", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_major_segment_event_ratio": "12", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_max_events": "-1", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_max_segments": "128", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_pause": "false", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_segment_size": "0", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_skip_corrupt_events": "false", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_skip_unbounded_events": "false", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_threshold": "128", 2024-05-09T09:53:26.040 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_warn_factor": "2.000000", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_caps_per_client": "1048576", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_completed_flushes": "100000", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_completed_requests": "100000", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_export_size": "20971520", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_file_recover": "32", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_files": "64", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_ops": "8192", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_snaps_per_dir": "100", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_metrics_update_interval": "2", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_min_caps_per_client": "100", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_min_caps_working_set": "10000", 2024-05-09T09:53:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_numa_node": "-1", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_complaint_time": "30.000000", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_duration": "600", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_size": "20", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_slow_op_size": "20", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_slow_op_threshold": "10", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_log_threshold": "5", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_ping_grace": "15", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_ping_interval": "5", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_caps": "30000", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-05-09T09:53:26.042 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_decay_threshold": "131072", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_warning_threshold": "262144", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_reconnect_timeout": "45.000000", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_replay_interval": "1.000000", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_root_ino_gid": "0", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_root_ino_uid": "0", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_blocklist_on_evict": "true", 2024-05-09T09:53:26.043 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_blocklist_on_timeout": "true", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_metadata_threshold": "16777216", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_shutdown_check": "0", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_skip_ino": "0", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sleep_rank_change": "0.000000", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_max_uid": "4294967294", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_min_uid": "0", 2024-05-09T09:53:26.044 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_rstat": "false", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_standby_replay_damaged": "false", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_symlink_recovery": "true", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_task_status_update_interval": "2.000000", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_thrash_exports": "0", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_thrash_fragments": "0", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_tick_interval": "5.000000", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_valgrind_exit": "false", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_verify_backtrace": "1", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_verify_scatter": "false", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_wipe_ino_prealloc": "false", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_wipe_sessions": "false", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "mempool_debug": "false", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_debug_omit_block_device_write": "false", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_device_bytes": "1073741824", 2024-05-09T09:53:26.045 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_page_set": "false", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_page_size": "65536", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_bytes": "134217728", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_messages": "512", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_connect_retry_interval": "1.000000", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_disabled_modules": "", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_max_pg_creating": "1024", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_max_pg_num_change": "128", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mds_bytes": "134217728", 2024-05-09T09:53:26.046 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mds_messages": "128", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mon_bytes": "134217728", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mon_messages": "128", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_osd_bytes": "536870912", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_osd_messages": "8192", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_pool": "true", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_service_beacon_grace": "60.000000", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_standby_modules": "true", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_stats_period": "5", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_stats_threshold": "5", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_tick_period": "2", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_accept_timeout_factor": "2.000000", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_allow_pool_delete": "true", 2024-05-09T09:53:26.047 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_allow_pool_size_one": "true", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_auth_validate_all_caps": "true", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_bytes": "104857600", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_directed_command_retry": "2", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval": "3.000000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_parallel": "3", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_log_interval": "1.000000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_ping_interval": "10.000000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_ping_timeout": "30.000000", 2024-05-09T09:53:26.048 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_target_rank": "-1", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clock_drift_allowed": "1.000000", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_file_level": "debug", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_file": "true", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog": "false", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_journald": "false", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_stderr": "false", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_bootstrap": "false", 2024-05-09T09:53:26.049 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_start": "false", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_trim": "true", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_con_tracker_persist_interval": "10", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_con_tracker_score_halflife": "43200", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_config_key_max_entry_size": "65536", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cpu_threads": "4", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_crush_min_required_version": "hammer", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_daemon_bytes": "419430400", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_avail_crit": "5", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_avail_warn": "5", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_size_warn": "16106127360", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_block_osdmap_trim": "false", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-05-09T09:53:26.050 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_json": "false", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_transactions": "false", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_extra_checks": "false", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_reef": "false", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_squid": "false", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_delta_reset_interval": "10.000000", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_dns_srv_name": "ceph-mon", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_down_mkfs_grace": "120", 2024-05-09T09:53:26.051 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_down_uptime_grace": "60", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_election_default_strategy": "1", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_election_timeout": "5.000000", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ping_divisor": "2", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ping_timeout": "2.000000", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_enable_op_tracker": "true", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_fake_pool_delete": "false", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_force_quorum_join": "false", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_globalid_prealloc": "10000", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_detail_to_clog": "false", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_log_update_period": "5", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_max_detail": "50", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog": "true", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog_interval": "600", 2024-05-09T09:53:26.052 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_host": "172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790],172.21.15.80", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_host_override": "", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_initial_members": "", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_keyvaluedb": "rocksdb", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease": "5.000000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_full_interval": "50", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_max": "10000", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_max_summary": "50", 2024-05-09T09:53:26.053 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_log_entries_per_event": "4096", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_log_epochs": "500", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_mdsmap_epochs": "500", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_mgrmap_epochs": "500", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_osd": "10000", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_pg_per_osd": "10000", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_pool_pg_num": "65536", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_force_trim_to": "0", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_skip_sanity": "false", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_memory_autotune": "true", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_memory_target": "2147483648", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_beacon_grace": "30", 2024-05-09T09:53:26.054 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_digest_period": "5", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_inactive_grace": "60", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_mkfs_grace": "240", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_min_osdmap_epochs": "500", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_complaint_time": "30", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_duration": "600", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_size": "20", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_slow_op_size": "20", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_slow_op_threshold": "10", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_log_threshold": "5", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-05-09T09:53:26.055 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_in": "false", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_new_in": "true", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_cache_size": "500", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_cache_size_min": "134217728", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_crush_smoke_test": "true", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_destroyed_out_interval": "600", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_down_out_interval": "600", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_force_trim_to": "0", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_full_ratio": "0.950000", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-05-09T09:53:26.056 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_halflife": "3600", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_max_interval": "300", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_weight": "0.300000", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_max_initial_pgs": "1024", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_down_reporters": "2", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp": "true", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_report_timeout": "900", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-05-09T09:53:26.057 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_warn_num_repaired": "10", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_warn_op_age": "32.000000", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_interval": "10", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_min": "10000", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_stuck_threshold": "60", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_objects": "10000", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_per_osd": "0", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pool_quota_crit_threshold": "0", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pool_quota_warn_threshold": "0", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_probe_timeout": "2.000000", 2024-05-09T09:53:26.058 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_max_change": "0.050000", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_max_osds": "4", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_interval": "86400", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_max_keys": "100", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_timeout": "300", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_session_timeout": "300", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_smart_report_timeout": "5", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stat_smooth_intervals": "6", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_pool_min_size": "2", 2024-05-09T09:53:26.059 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_pool_size": "4", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_subscribe_interval": "86400.000000", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_debug": "false", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_max_payload_keys": "2000", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_max_payload_size": "1048576", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_provider_kill_at": "0", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_requester_kill_at": "0", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_timeout": "60.000000", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_target_pg_per_osd": "100", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_tick_interval": "5", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_timecheck_interval": "300.000000", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_use_min_delay_socket": "false", 2024-05-09T09:53:26.060 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_older_version_delay": "604800", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_filestore_osds": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_misplaced": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_older_version": "true", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_no_app": "true", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-05-09T09:53:26.061 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_too_few_osds": "false", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "monmap": "", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-05-09T09:53:26.062 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-05-09T09:53:26.066 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_tracing_enabled": "false", 2024-05-09T09:53:26.066 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_op_threads": "3", 2024-05-09T09:53:26.066 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_buffer_size": "131072", 2024-05-09T09:53:26.066 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_cm": "false", 2024-05-09T09:53:26.066 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_device_name": "", 2024-05-09T09:53:26.066 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_dscp": "96", 2024-05-09T09:53:26.066 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_gid_idx": "0", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_local_gid": "", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_polling_us": "1000", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_port_num": "1", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_roce_ver": "1", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_send_buffers": "1024", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_sl": "3", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_support_srq": "true", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_type": "ib", 2024-05-09T09:53:26.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_reap_threshold": "5", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_before_connect": "false", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_ipv4": "true", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_ipv6": "false", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_msgr1": "true", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_msgr2": "true", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_port_max": "7568", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_port_min": "6800", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_prefer_ipv4": "false", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_retry_count": "3", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_retry_delay": "5", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_client": "false", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mds": "false", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mgr": "false", 2024-05-09T09:53:26.068 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mon": "false", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_osd": "false", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_client_mode": "crc secure", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_cluster_mode": "crc secure", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_cluster_type": "", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_compress_secure": "false", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_connection_idle_timeout": "900", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_connection_ready_timeout": "10", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_crc_data": "true", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_crc_header": "true", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_bad_msg": "false", 2024-05-09T09:53:26.069 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_bug": "true", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_old_message": "true", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_skipped_message": "false", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_unhandled_msg": "false", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_coremask": "0xF", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_devs_allowlist": "", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_enable_tso": "true", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-05-09T09:53:26.070 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hugepages": "", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hw_flow_control": "true", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_lro": "true", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_memory_channel": "4", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_pmd": "", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_port_id": "0", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dump_corrupt_message_level": "1", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dump_on_send": "false", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_initial_backoff": "0.200000", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_max": "1.000000", 2024-05-09T09:53:26.071 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_probability": "0.000000", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_type": "", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_internal_delays": "0.000000", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_network_congestion": "0", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_socket_failures": "0", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_learn_addr_from_peer": "true", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_max_accept_failures": "4", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_max_backoff": "15.000000", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_client_mode": "secure crc", 2024-05-09T09:53:26.072 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_cluster_mode": "secure crc", 2024-05-09T09:53:26.073 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_service_mode": "secure crc", 2024-05-09T09:53:26.073 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compress_min_size": "1024", 2024-05-09T09:53:26.073 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compress_mode": "none", 2024-05-09T09:53:26.073 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compression_algorithm": "snappy", 2024-05-09T09:53:26.073 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-05-09T09:53:26.073 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_pq_min_cost": "65536", 2024-05-09T09:53:26.073 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_public_type": "", 2024-05-09T09:53:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_service_mode": "crc secure", 2024-05-09T09:53:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_listen_backlog": "512", 2024-05-09T09:53:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_nodelay": "true", 2024-05-09T09:53:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-05-09T09:53:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_rcvbuf": "0", 2024-05-09T09:53:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_type": "async+posix", 2024-05-09T09:53:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: "no_config_file": "false", 2024-05-09T09:53:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_completion_locks_per_session": "32", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_debug_inject_relock_delay": "false", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inflight_op_bytes": "104857600", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inflight_ops": "1024", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inject_no_watch_ping": "false", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_tick_interval": "5.000000", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_timeout": "10.000000", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objectstore_blackhole": "false", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "openssl_engine_opts": "", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_delay_time": "5.000000", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_hist_halflife": "1000", 2024-05-09T09:53:26.075 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_max_low_ops": "2", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_max_ops": "4", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_quantize_effort": "0.100000", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_slop": "0.020000", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_allow_recovery_below_min_size": "true", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_asio_thread_count": "2", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_async_recovery_min_cost": "100", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_auto_mark_unfound_lost": "false", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_retry_interval": "30.000000", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_scan_max": "512", 2024-05-09T09:53:26.076 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_scan_min": "64", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_degraded": "false", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_peering": "false", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_unfound": "true", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_beacon_report_interval": "300", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_duration": "30", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_max_block_size": "67108864", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_small_size_max_iops": "100", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_blkin_trace_all": "false", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_blocked_scrub_grace_period": "120", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-05-09T09:53:26.077 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_check_for_log_corruption": "false", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_update_on_start": "true", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_message_cap": "256", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_message_size_cap": "524288000", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_op_priority": "63", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_watch_timeout": "30", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_command_max_records": "256", 2024-05-09T09:53:26.078 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_compact_on_start": "false", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_chooseleaf_type": "0", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_initial_weight": "-1.000000", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_update_on_start": "true", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_update_weight_set": "true", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-05-09T09:53:26.079 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_drop_ping_duration": "0", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_feed_pullee": "-1", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_misdirected_ops": "false", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_no_acting_change": "false", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_no_purge_strays": "false", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_op_order": "false", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_pg_log_writeout": "false", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_pretend_recovery_active": "false", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-05-09T09:53:26.080 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_shutdown": "false", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_trim_objects": "false", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_cached_snaps": "false", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_missing_on_start": "false", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_snaps": "false", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-05-09T09:53:26.081 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_keys": "1024", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_stride": "524288", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_default_data_pool_replay_window": "5", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_default_notify_timeout": "30", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep": "0.000000", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-05-09T09:53:26.082 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_discard_disconnected_ops": "true", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_enable_op_tracker": "true", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_extblkdev_plugins": "vdo", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_info": "true", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown": "true", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-05-09T09:53:26.083 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown_timeout": "15", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_function_tracing": "false", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_grace": "20", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_interval": "6", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_peers": "10", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_size": "2000", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_stale": "600", 2024-05-09T09:53:26.084 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_max_size": "100000", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_min_size": "1000", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal_flush_on_shutdown": "true", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal_size": "5120", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_kill_backfill_at": "0", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_loop_before_reset_tphandle": "64", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_cache_size": "50", 2024-05-09T09:53:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_dedup": "true", 2024-05-09T09:53:26.086 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_message_max": "40", 2024-05-09T09:53:26.086 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_message_max_bytes": "10485760", 2024-05-09T09:53:26.086 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_share_max_epochs": "40", 2024-05-09T09:53:26.086 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_attr_name_len": "100", 2024-05-09T09:53:26.086 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_attr_size": "0", 2024-05-09T09:53:26.086 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_backfills": "1", 2024-05-09T09:53:26.086 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_markdown_count": "5", 2024-05-09T09:53:26.086 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_markdown_period": "600", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_name_len": "2048", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_namespace_len": "256", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_size": "134217728", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_omap_entries_per_request": "1024", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_blocked_by": "16", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_log_entries": "10000", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pgls": "1024", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_push_cost": "8388608", 2024-05-09T09:53:26.087 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_push_objects": "10", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_scrubs": "3", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_trimming_pgs": "2", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_write_op_reply_len": "64", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_write_size": "90", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-05-09T09:53:26.088 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_override_recovery_settings": "false", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_profile": "balanced", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-05-09T09:53:26.089 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_skip_benchmark": "false", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_base": "805306368", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_cache_min": "134217728", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-05-09T09:53:26.090 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target": "4294967296", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target_autotune": "false", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_min_pg_log_entries": "250", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_min_recovery_priority": "0", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_heartbeat_interval": "30", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_report_interval": "5", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_report_max_in_flight": "2", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_num_cache_shards": "32", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_num_op_tracker_shard": "32", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_auto_affinity": "true", 2024-05-09T09:53:26.091 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_node": "-1", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_prefer_iface": "true", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objecter_finishers": "1", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore": "bluestore", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_fuse": "false", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_tracing": "false", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_complaint_time": "30.000000", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_duration": "600", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_size": "20", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_slow_op_size": "20", 2024-05-09T09:53:26.092 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_log_threshold": "5", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards": "0", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards_hdd": "5", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards_ssd": "8", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard": "0", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_pq_min_cost": "65536", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_queue": "mclock_scheduler", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_queue_cut_off": "high", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_thread_suicide_timeout": "150", 2024-05-09T09:53:26.093 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_thread_timeout": "15", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_open_classes_on_start": "true", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_os_flags": "0", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_peering_op_priority": "255", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_delete_cost": "1048576", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_delete_priority": "5", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_dups_tracked": "3000", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_trim_max": "10000", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_trim_min": "100", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-05-09T09:53:26.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_object_context_cache_count": "64", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_crimson": "false", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_crush_rule": "-1", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_ec_fast_read": "false", 2024-05-09T09:53:26.095 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_bulk": "false", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nodelete": "false", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flags": "0", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_min_size": "0", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pg_num": "32", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pgp_num": "0", 2024-05-09T09:53:26.096 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_read_ratio": "70", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_size": "2", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_type": "replicated", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_use_gmt_hitset": "true", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_push_per_object_cost": "1000", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_read_ec_check_for_errors": "false", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recover_clone_overlap": "true", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recover_clone_overlap_limit": "10", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_cost": "20971520", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_delay_start": "0.000000", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active": "0", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active_hdd": "3", 2024-05-09T09:53:26.097 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active_ssd": "10", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_chunk": "8388608", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_single_start": "1", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_op_priority": "3", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_op_warn_multiple": "16", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_priority": "5", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_retry_interval": "30.000000", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep": "0.000000", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-05-09T09:53:26.098 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_repair_during_recovery": "false", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_requested_scrub_priority": "120", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_rollback_to_cluster_snap": "", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_auto_repair": "false", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_begin_hour": "0", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_begin_week_day": "0", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_chunk_max": "25", 2024-05-09T09:53:26.099 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_chunk_min": "5", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_cost": "52428800", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_during_recovery": "false", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_end_hour": "0", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_end_week_day": "0", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_event_cost": "4096", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-05-09T09:53:26.100 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_invalid_stats": "true", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_load_threshold": "0.500000", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_max_interval": "604800.000000", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_max_preemptions": "5", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_min_interval": "86400.000000", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_priority": "5", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_reservation_timeout": "300000", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_sleep": "0.000000", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shutdown_pgref_assert": "false", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_skip_data_digest": "false", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_smart_report_timeout": "5", 2024-05-09T09:53:26.101 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_cost": "1048576", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_priority": "5", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep": "0.000000", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_stats_update_period_scrubbing": "15", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_target_transaction_size": "30", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-05-09T09:53:26.102 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_mode": "writeback", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tracing": "false", 2024-05-09T09:53:26.103 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_use_stale_snap": "false", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "osdc_blkin_trace_all": "false", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_kill_at": "0", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_max_join_drift": "10", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_min": "500", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_min_wait": "0.050000", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_propose_interval": "1.000000", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_max": "500", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_max_multiplier": "20", 2024-05-09T09:53:26.104 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_min": "250", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_stash_full_interval": "25", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_trim_max": "500", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_trim_min": "250", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "perf": "true", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin_dir": "/usr/lib/ceph", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "-", 2024-05-09T09:53:26.105 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrv": "", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "public_bind_addr": "-", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "public_network": "", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "public_network_interface": "", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_enabled": "false", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_session_max_number": "256", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_mon_op_timeout": "0", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_osd_op_timeout": "0", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_tracing": "false", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_atime_update_interval": "60", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_balance_parent_reads": "false", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_balance_snap_reads": "false", 2024-05-09T09:53:26.106 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blkin_trace_all": "false", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blocklist_expire_seconds": "0", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blocklist_on_break_lock": "true", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache": "true", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_block_writes_upfront": "false", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty": "25165824", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty_object": "0", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_policy": "writearound", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_size": "33554432", 2024-05-09T09:53:26.107 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_target_dirty": "16777216", 2024-05-09T09:53:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-05-09T09:53:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_clone_copy_on_read": "false", 2024-05-09T09:53:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_compression_hint": "none", 2024-05-09T09:53:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_concurrent_management_ops": "10", 2024-05-09T09:53:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-05-09T09:53:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_clone_format": "auto", 2024-05-09T09:53:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_data_pool": "", 2024-05-09T09:53:26.108 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_features": "61", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_format": "2", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_map_options": "", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_order": "22", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_pool": "rbd", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_stripe_count": "0", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_stripe_unit": "0", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_disable_zero_copy_writes": "true", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_discard_granularity_bytes": "65536", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_enable_alloc_hint": "true", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_io_scheduler": "simple", 2024-05-09T09:53:26.109 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_commit_age": "5.000000", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_interval": "0", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_order": "24", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_pool": "", 2024-05-09T09:53:26.110 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_splay_width": "4", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_localize_parent_reads": "false", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_localize_snap_reads": "false", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-05-09T09:53:26.111 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_type": "simple", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_autotune": "true", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_base": "805306368", 2024-05-09T09:53:26.112 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_target": "4294967296", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_delete_delay": "0", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-05-09T09:53:26.113 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_replay_delay": "0", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_to_trash_on_remove": "false", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mtime_update_interval": "60", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_non_blocking_aio": "true", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_op_thread_timeout": "60", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_op_threads": "1", 2024-05-09T09:53:26.114 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_parent_cache_enabled": "false", 2024-05-09T09:53:26.115 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_mode": "disabled", 2024-05-09T09:53:26.115 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_path": "/tmp", 2024-05-09T09:53:26.115 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_size": "1073741824", 2024-05-09T09:53:26.115 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_plugins": "", 2024-05-09T09:53:26.115 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_burst": "0", 2024-05-09T09:53:26.115 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-05-09T09:53:26.115 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_limit": "0", 2024-05-09T09:53:26.115 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_exclude_ops": "0", 2024-05-09T09:53:26.116 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_burst": "0", 2024-05-09T09:53:26.116 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-05-09T09:53:26.116 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_limit": "0", 2024-05-09T09:53:26.116 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_burst": "0", 2024-05-09T09:53:26.116 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-05-09T09:53:26.116 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_limit": "0", 2024-05-09T09:53:26.116 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_burst": "0", 2024-05-09T09:53:26.117 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-05-09T09:53:26.117 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_limit": "0", 2024-05-09T09:53:26.117 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_schedule_tick_min": "50", 2024-05-09T09:53:26.117 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_burst": "0", 2024-05-09T09:53:26.117 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-05-09T09:53:26.117 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_limit": "0", 2024-05-09T09:53:26.117 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_burst": "0", 2024-05-09T09:53:26.117 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-05-09T09:53:26.118 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_limit": "0", 2024-05-09T09:53:26.118 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_quiesce_notification_attempts": "10", 2024-05-09T09:53:26.118 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_read_from_replica_policy": "default", 2024-05-09T09:53:26.118 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-05-09T09:53:26.118 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_max_bytes": "524288", 2024-05-09T09:53:26.118 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_trigger_requests": "10", 2024-05-09T09:53:26.118 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_request_timed_out_seconds": "30", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_skip_partial_discard": "true", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_tracing": "false", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_validate_names": "true", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_validate_pool": "true", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "restapi_base_url": "", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "restapi_log_level": "", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_acl_grants_max_num": "100", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_admin_entry": "admin", 2024-05-09T09:53:26.119 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_backend_store": "rados", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_barbican_url": "", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_beast_enable_async": "true", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_counters_cache": "false", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_index_max_aio": "128", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_quota_ttl": "600", 2024-05-09T09:53:26.120 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_enabled": "true", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_expiry_interval": "900", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_lru_size": "10000", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_config_store": "rados", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_content_length_compat": "false", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_copy_obj_progress": "true", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cors_rules_max_num": "100", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cross_domain_policy": "", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_default_encryption_key": "", 2024-05-09T09:53:26.121 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_addr": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_ca_path": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_client_cert": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_client_key": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_password": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_username": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_require_ssl": "true", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-05-09T09:53:26.122 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_suppress_logs": "true", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_addr": "", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_auth": "token", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_namespace": "", 2024-05-09T09:53:26.123 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_prefix": "", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_token_file": "", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_buffersize": "524288", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_low_speed_limit": "1024", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_low_speed_time": "300", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_tcp_keepalive": "0", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-05-09T09:53:26.124 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_fadvise": "4", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_host": "127.0.0.1", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_fadvise": "4", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-05-09T09:53:26.125 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_port": "6379", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_changes_size": "1000", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_num_shards": "128", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_window": "30", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_notify_interval_msec": "0", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_sync_poll_interval": "20", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_sync_spawn_window": "20", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-05-09T09:53:26.126 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_data_log_backing": "fifo", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_region_info_oid": "default.region", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_defer_to_bucket_acls": "", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-05-09T09:53:26.127 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_res": "500.000000", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dns_name": "", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dns_s3website_name": "", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dynamic_resharding": "true", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_gc_threads": "true", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_lc_threads": "true", 2024-05-09T09:53:26.128 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_ops_log": "false", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_quota_threads": "true", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_static_website": "false", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_usage_log": "false", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enforce_swift_acls": "true", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_exit_timeout_secs": "120", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_expose_bucket": "false", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_extended_http_attrs": "", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_filter": "none", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_frontends": "beast port=7480", 2024-05-09T09:53:26.129 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_concurrent_io": "10", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_deferred": "50", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_objs": "32", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_queue_size": "134213632", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_trim_chunk": "16", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_obj_min_wait": "7200", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_processor_max_time": "3600", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_processor_period": "3600", 2024-05-09T09:53:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_get_obj_window_size": "16777216", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_healthcheck_disabling_path": "", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ignore_get_invalid_range": "false", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_init_timeout": "300", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_connection_idle": "300", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_message_timeout": "5000", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_sleep_timeout": "10", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-05-09T09:53:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_domain": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_password": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_password_path": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_project": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_tenant": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_token": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_token_path": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_user": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_api_version": "2", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_domain": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_password": "", 2024-05-09T09:53:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_project": "", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_tenant": "", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_user": "", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_implicit_tenants": "false", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_service_token_enabled": "false", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_token_cache_size": "10000", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_url": "", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_verify_ssl": "true", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_debug_interval": "-1", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_lock_max_time": "90", 2024-05-09T09:53:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_objs": "32", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_rules": "1000", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_worker": "3", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_wp_worker": "3", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_thread_delay": "0", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_dnattr": "uid", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_searchfilter": "", 2024-05-09T09:53:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_uri": "", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lfuda_sync_frequency": "60", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_http_headers": "", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_nonexistent_bucket": "false", 2024-05-09T09:53:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-05-09T09:53:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_object_name_utc": "false", 2024-05-09T09:53:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-05-09T09:53:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-05-09T09:53:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attr_name_len": "0", 2024-05-09T09:53:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attr_size": "0", 2024-05-09T09:53:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attrs_num_in_req": "0", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_chunk_size": "4194304", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_concurrent_requests": "1024", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_dynamic_shards": "1999", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_listing_results": "1000", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_notify_retries": "10", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_objs_per_shard": "100000", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_put_param_size": "1048576", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_put_size": "5368709120", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_slo_entries": "1000", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_md_log_max_shards": "64", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_md_notify_interval_msec": "200", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_meta_sync_poll_interval": "20", 2024-05-09T09:53:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_meta_sync_spawn_window": "20", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_mp_lock_max_time": "600", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multipart_min_part_size": "5242880", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_fhcache_size": "2017", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_lru_lanes": "5", 2024-05-09T09:53:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_max_gc": "300", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_gc_threads": "false", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_lc_threads": "false", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_quota_threads": "false", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_sync_thread": "false", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_num_async_rados_threads": "32", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_num_control_oids": "8", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_numa_node": "-1", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_obj_stripe_size": "4194304", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-05-09T09:53:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_chunk_size": "100", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_gc_interval": "600", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_hints_num_shards": "127", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_thread_timeout": "600", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_tracing": "false", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_token": "", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_url": "", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_verify_ssl": "true", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_rados": "false", 2024-05-09T09:53:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_socket_path": "", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_push_interval": "2.000000", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_push_interval_max": "30.000000", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_root_pool": ".rgw.root", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_lanes": "3", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_max_buckets": "100", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_partitions": "3", 2024-05-09T09:53:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_print_continue": "true", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_print_prohibited_content_length": "false", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_tracing": "false", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm": "", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm_id": "", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_region": "", 2024-05-09T09:53:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_region_root_pool": ".rgw.root", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_relaxed_region_enforcement": "false", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_request_uri": "", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_batch_size": "64", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_max_aio": "128", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_num_logs": "16", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_thread_interval": "600", 2024-05-09T09:53:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_resolve_cname": "false", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rest_getusage_op_compat": "false", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_run_sync_thread": "true", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_keystone": "false", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_ldap": "false", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_rados": "true", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_sts": "false", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-05-09T09:53:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_success_create_obj_status": "0", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_scheduler_type": "throttler", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_script_uri": "", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_service_provider_name": "", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_client_id": "", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_client_secret": "", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_entry": "sts", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_key": "sts", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_max_session_duration": "43200", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_min_session_duration": "900", 2024-05-09T09:53:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_token_introspection_url": "", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_account_in_url": "false", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_auth_entry": "auth", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_auth_url": "", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_custom_header": "", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_enforce_content_length": "false", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_need_stats": "true", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_tenant_name": "", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_token_expiration": "86400", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_url": "", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_url_prefix": "swift", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_versioning_enabled": "false", 2024-05-09T09:53:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_lease_period": "120", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_interval": "1200", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_obj_etag_verify": "false", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_history_size": "4096", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-05-09T09:53:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_thread_pool_size": "512", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_max_retries": "0", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_require_publish_policy": "false", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_comment": "", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_createby": "", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_encoding": "", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_flag": "false", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_max_size": "5368709120", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_origin": "", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_sha_unit": "524288", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_tracker": "", 2024-05-09T09:53:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_trust_forwarded_https": "false", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_log_tick_interval": "30", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_max_shards": "32", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_max_user_shards": "1", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_use_opa_authz": "false", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_counters_cache": "false", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_counters_cache_size": "10000", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_default_quota_max_size": "-1", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_max_buckets": "1000", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_policies_max_num": "100", 2024-05-09T09:53:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_interval": "86400", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_unique_email": "true", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_verify_ssl": "true", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_website_routing_rules_max_num": "50", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone": "", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone_id": "", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-05-09T09:53:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup": "", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup_id": "", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rgwlc_auto_session_clear": "true", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rgwlc_skip_bucket_step": "false", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_block_size": "4096", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_shard_bits": "4", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_size": "536870912", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_type": "binned_lru", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-05-09T09:53:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_compaction_stats": "false", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_extended_stats": "false", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_memory_stats": "false", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_index_type": "binary_search", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_log_to_ceph_log": "true", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_metadata_block_size": "4096", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_partition_filters": "false", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_perf": "false", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-05-09T09:53:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "rotating_keys_renewal_timeout": "10", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "run_dir": "/var/run/ceph", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_block_create": "true", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_cache_lru_size": "67108864", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_cbjournal_size": "5368709120", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_data_delta_based_overwrite": "0", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_default_max_object_size": "16777216", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_device_size": "53687091200", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_capacity": "16", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_iodepth_limit": "5", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_main_device_type": "SSD", 2024-05-09T09:53:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_max_concurrent_transactions": "8", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_segment_size": "67108864", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "set_keepcaps": "false", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "setgroup": "", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "setuser": "", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "setuser_match_path": "", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_misplaced_ratio": "0.050000", 2024-05-09T09:53:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "thp": "false", 2024-05-09T09:53:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "threadpool_default_timeout": "60", 2024-05-09T09:53:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "threadpool_empty_queue_max_wait": "2", 2024-05-09T09:53:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "throttler_perf_counter": "true" 2024-05-09T09:53:26.155 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:26.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-05-09T09:53:26.310 INFO:teuthology.orchestra.run.smithi032.stdout:mon.a: {} 2024-05-09T09:53:26.310 INFO:teuthology.orchestra.run.smithi032.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-09T09:53:26.323 INFO:teuthology.orchestra.run.smithi032.stdout:mon.b: {} 2024-05-09T09:53:26.323 INFO:teuthology.orchestra.run.smithi032.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-09T09:53:26.335 INFO:teuthology.orchestra.run.smithi032.stdout:mon.c: {} 2024-05-09T09:53:26.336 INFO:teuthology.orchestra.run.smithi032.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-09T09:53:26.350 DEBUG:teuthology.orchestra.run.smithi080:> type ceph-objectstore-tool 2024-05-09T09:53:26.362 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-09T09:53:26.363 DEBUG:teuthology.orchestra.run.smithi032:> type ceph-objectstore-tool 2024-05-09T09:53:26.376 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-09T09:53:26.377 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T09:53:26.408 INFO:tasks.workunit:Pulling workunits from ref 2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:53:26.408 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T09:53:26.409 DEBUG:teuthology.orchestra.run.smithi032:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T09:53:26.410 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-05-09T09:53:26.410 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-09T09:53:26.410 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-09T09:53:26.410 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-09T09:53:26.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-05-09T09:53:26.411 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-05-09T09:53:26.411 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-05-09T09:53:26.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:53:26.412 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-05-09T09:53:26.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:53:26.412 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-05-09T09:53:26.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:53:26.413 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:26.412+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:26.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:53:26.438 INFO:teuthology.orchestra.run.smithi032.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-09T09:53:26.439 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-09T09:53:26.489 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-09T09:53:26.489 DEBUG:teuthology.orchestra.run.smithi032:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-09T09:53:26.514 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:26.512+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:26.543 INFO:tasks.workunit:timeout=3h 2024-05-09T09:53:26.544 INFO:tasks.workunit:cleanup=True 2024-05-09T09:53:26.544 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:53:26.553 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:26.554 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:26.554 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:26.554 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:26.559 INFO:tasks.workunit.client.0.smithi032.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T09:53:26.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:53:26.577 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:26.577 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:26.595 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:26.595 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:26.614 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:26.613+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:26.629 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:26.629 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:26.661 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:26.661 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:26.697 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:26.697 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:26.697 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:26.698 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:26.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:53:26.734 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:26.735 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:26.735 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:26.733+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:26.756 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:26.756 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:26.777 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:26.777 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:26.792 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-05-09T09:53:26.789+0000 7fcc70e52640 -1 mon.a@0(leader).osd e30 definitely_dead 0 2024-05-09T09:53:26.817 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:26.816+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:26.862 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:26.863 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:26.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:53:26.918 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:26.919+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:26.992 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:26.992 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:27.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:53:27.019 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:27.019+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:27.120 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:27.117+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:27.133 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:27.133 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:27.146 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:53:27.234 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:27.233+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:27.314 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:27.314 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:27.322 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:27.321+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:27.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:53:27.423 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:27.423+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:27.490 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:27.490 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:27.504 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:53:27.524 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:27.523+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:27.625 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:27.623+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:27.633 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:27.633 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:27.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:53:27.712 INFO:teuthology.orchestra.run.smithi032.stderr:marked out osd.4. 2024-05-09T09:53:27.719 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:53:27.730 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:27.727+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:27.783 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:27.783 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:27.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:53:27.842 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:27.841+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:27.930 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:27.927+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:27.967 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:27.967 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:27.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:53:28.028 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:28.027+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:28.108 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:28.108 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:28.122 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:53:28.166 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:28.165+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:28.230 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:28.227+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:28.243 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:28.243 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:28.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:53:28.331 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:28.329+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:28.392 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:28.393 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:28.406 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:53:28.432 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:28.433+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:28.524 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:28.524 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:28.532 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:28.531+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:28.538 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:53:28.632 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:28.631+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:28.704 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:28.704 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:28.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:53:28.754 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:28.733+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:28.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:53:28.835 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:28.835+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:28.891 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:28.891 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:28.905 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:53:28.942 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:28.943 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:28.948 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:28.947+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:28.959 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:28.959 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:28.976 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:28.976 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:28.993 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:28.993 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:29.011 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:29.012 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:29.031 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:29.038 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:29.037+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:29.050 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:29.068 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:29.069 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:29.069 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:53:29.069 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:53:29.069 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:29.070 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:29.071 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:29.083 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:53:29.138 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:29.137+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:29.208 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:29.208 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:53:29.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:53:29.208 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:53:29.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.208 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:53:29.208 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.163802+0000", 2024-05-09T09:53:29.208 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.043835454, 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037921919999999998, 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 205 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163802+0000", 2024-05-09T09:53:29.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163802+0000", 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163806+0000", 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.05e-06 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163822+0000", 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6693000000000001e-05 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163856+0000", 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4199000000000002e-05 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163875+0000", 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9037000000000001e-05 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.164016+0000", 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014050400000000001 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.164281+0000", 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000265235 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.164708+0000", 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042678799999999999 2024-05-09T09:53:29.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.166381+0000", 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00167341 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.167431+0000", 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010500100000000001 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.167523+0000", 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1393999999999999e-05 2024-05-09T09:53:29.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.167595+0000", 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1872000000000006e-05 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:208 6.4 e30/24 6:2166d8e1:gc::gc.3:head v 30'3, mlcod=27'1)", 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.187937+0000", 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.019700563000001, 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034467550000000001, 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.214 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187937+0000", 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187937+0000", 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187939+0000", 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4130000000000001e-06 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187949+0000", 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0703000000000001e-05 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187990+0000", 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0105999999999999e-05 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.188009+0000", 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9585999999999998e-05 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.188283+0000", 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027405499999999999 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.188337+0000", 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3538999999999997e-05 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.191305+0000", 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029679849999999998 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.191384+0000", 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9368000000000003e-05 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.218 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.234399+0000", 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.973238669000001, 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003636285, 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 220 2024-05-09T09:53:29.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234399+0000", 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234399+0000", 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234402+0000", 2024-05-09T09:53:29.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3860000000000001e-06 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234412+0000", 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0553999999999999e-05 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234439+0000", 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7146000000000001e-05 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234459+0000", 2024-05-09T09:53:29.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9989000000000001e-05 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234619+0000", 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015993100000000001 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234823+0000", 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000204129 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:29.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.235206+0000", 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038309200000000002 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.236598+0000", 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013912830000000001 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.237892+0000", 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012940740000000001 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.237972+0000", 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0025999999999996e-05 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.238036+0000", 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3675000000000003e-05 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.252580+0000", 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.955058300999999, 2024-05-09T09:53:29.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035035700000000001, 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 225 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252580+0000", 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252580+0000", 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252581+0000", 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.64e-06 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252589+0000", 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8699999999999992e-06 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252614+0000", 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4383e-05 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252632+0000", 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8726e-05 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252783+0000", 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015036100000000001 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252994+0000", 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021187199999999999 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.253408+0000", 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041345500000000002 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.254766+0000", 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001357586 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.255932+0000", 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011661499999999999 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256020+0000", 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8225000000000003e-05 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256083+0000", 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3301999999999998e-05 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.229 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.256491+0000", 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.951147114999999, 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003134305, 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226 2024-05-09T09:53:29.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256491+0000", 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256491+0000", 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256492+0000", 2024-05-09T09:53:29.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6729999999999999e-06 2024-05-09T09:53:29.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256501+0000", 2024-05-09T09:53:29.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5769999999999994e-06 2024-05-09T09:53:29.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256526+0000", 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4788999999999999e-05 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256544+0000", 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8110000000000001e-05 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256681+0000", 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013663999999999999 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256912+0000", 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023169299999999999 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.257331+0000", 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000418315 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.259053+0000", 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017228320000000001 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.259480+0000", 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042617499999999999 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.259562+0000", 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2582000000000003e-05 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.259625+0000", 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2918999999999998e-05 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.285517+0000", 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.922121317, 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034583679999999999, 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.236 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 234 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285517+0000", 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285517+0000", 2024-05-09T09:53:29.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285519+0000", 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4030000000000001e-06 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285531+0000", 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1497e-05 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285562+0000", 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1439000000000002e-05 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285577+0000", 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4589999999999999e-05 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285761+0000", 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018437600000000001 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285980+0000", 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021893600000000001 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.286400+0000", 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041973500000000002 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.287812+0000", 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001412155 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.288820+0000", 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010084339999999999 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.288907+0000", 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7242000000000003e-05 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.288975+0000", 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7560999999999999e-05 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:371 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.321253+0000", 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.886385390999999, 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034533379999999998, 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 371 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321253+0000", 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321253+0000", 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321255+0000", 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4430000000000002e-06 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321282+0000", 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6806000000000001e-05 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321317+0000", 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5666e-05 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321365+0000", 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7411999999999999e-05 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321490+0000", 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012506799999999999 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321752+0000", 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026243499999999999 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322120+0000", 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000367532 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323435+0000", 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001314768 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324483+0000", 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001048149 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324625+0000", 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014206700000000001 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324706+0000", 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0992e-05 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:427 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.350781+0000", 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.856857386, 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034929649999999998, 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.248 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 427 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350781+0000", 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350781+0000", 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350782+0000", 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.237e-06 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350788+0000", 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7050000000000002e-06 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350802+0000", 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.382e-05 2024-05-09T09:53:29.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350811+0000", 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6859999999999995e-06 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350908+0000", 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7198e-05 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351125+0000", 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000216407 2024-05-09T09:53:29.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351473+0000", 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034830700000000001 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353992+0000", 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025194570000000001 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.354144+0000", 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015172800000000001 2024-05-09T09:53:29.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.354220+0000", 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5456000000000004e-05 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.354274+0000", 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3964e-05 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.253 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:431 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.353395+0000", 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.854242629, 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041234790000000002, 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 431 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353395+0000", 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353395+0000", 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353397+0000", 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5400000000000001e-06 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353404+0000", 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4109999999999999e-06 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353422+0000", 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199999999999999e-05 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353432+0000", 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0569999999999999e-06 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353654+0000", 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022289400000000001 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353874+0000", 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021933200000000001 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.354358+0000", 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048414399999999999 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355441+0000", 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00108307 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357365+0000", 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001923721 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357454+0000", 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9438000000000007e-05 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357519+0000", 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4671999999999993e-05 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:434 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.355034+0000", 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.852603578, 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043073540000000002, 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 434 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355034+0000", 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355034+0000", 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355036+0000", 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.751e-06 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355046+0000", 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7229999999999999e-06 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355067+0000", 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1619000000000001e-05 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355083+0000", 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5696999999999999e-05 2024-05-09T09:53:29.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355184+0000", 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100649 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355287+0000", 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103361 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355587+0000", 2024-05-09T09:53:29.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00029994599999999999 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357862+0000", 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022752380000000002 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359117+0000", 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001254935 2024-05-09T09:53:29.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359240+0000", 2024-05-09T09:53:29.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012276 2024-05-09T09:53:29.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359342+0000", 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101675 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:437 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.84913399, 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056446969999999997, 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.266 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 437 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358506+0000", 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7060000000000001e-06 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358516+0000", 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8600000000000005e-06 2024-05-09T09:53:29.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358536+0000", 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0231e-05 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358552+0000", 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6141999999999999e-05 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359405+0000", 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085275200000000002 2024-05-09T09:53:29.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359539+0000", 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426000000000001 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359975+0000", 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043652300000000002 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363582+0000", 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036068459999999999 2024-05-09T09:53:29.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364013+0000", 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043084500000000001 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364091+0000", 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7816000000000002e-05 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364149+0000", 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7716000000000001e-05 2024-05-09T09:53:29.271 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:440 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.846054937, 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073055910000000002, 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.272 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 440 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361584+0000", 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.486e-06 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361591+0000", 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9829999999999999e-06 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361611+0000", 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9925e-05 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361622+0000", 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0297e-05 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361730+0000", 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010856100000000001 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361848+0000", 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117909 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:29.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362099+0000", 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025122099999999999 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368320+0000", 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062206800000000001 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368752+0000", 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431629 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368831+0000", 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9369999999999994e-05 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368889+0000", 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.753e-05 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:447 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.367049+0000", 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.840589141000001, 2024-05-09T09:53:29.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047844200000000002, 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 447 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367049+0000", 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367049+0000", 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367055+0000", 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9109999999999998e-06 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367062+0000", 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4460000000000004e-06 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367081+0000", 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8371000000000001e-05 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367091+0000", 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9879999999999999e-06 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.280 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367164+0000", 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3900999999999996e-05 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367278+0000", 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113435 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367546+0000", 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026797099999999999 2024-05-09T09:53:29.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371044+0000", 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034983150000000001 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371696+0000", 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065214199999999998 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371771+0000", 2024-05-09T09:53:29.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4935e-05 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371833+0000", 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2005e-05 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:633 6.1a e30/24 6:5ae4284b:::obj_delete_at_hint.0000000032:head v 30'7, mlcod=30'5)", 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.724561166000001, 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007079526, 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.283 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483078+0000", 2024-05-09T09:53:29.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.703e-06 2024-05-09T09:53:29.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483093+0000", 2024-05-09T09:53:29.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4589999999999999e-05 2024-05-09T09:53:29.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483120+0000", 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7172999999999999e-05 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483134+0000", 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3559e-05 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483241+0000", 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010755399999999999 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483272+0000", 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0933999999999999e-05 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490066+0000", 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067936860000000002 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490156+0000", 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0327000000000004e-05 2024-05-09T09:53:29.287 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.665298+0000", 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.542340152, 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003752816, 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 763 2024-05-09T09:53:29.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665298+0000", 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665298+0000", 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665300+0000", 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2299999999999998e-06 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665311+0000", 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1269e-05 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665343+0000", 2024-05-09T09:53:29.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1683000000000001e-05 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665357+0000", 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4493e-05 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665531+0000", 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017319300000000001 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665754+0000", 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022297300000000001 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.666064+0000", 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031020400000000001 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.667915+0000", 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001851103 2024-05-09T09:53:29.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.668895+0000", 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00098046099999999996 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.668986+0000", 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0988000000000004e-05 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.669051+0000", 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.293 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.810979+0000", 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.396659309, 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003764543, 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.294 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 825 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.810979+0000", 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.810979+0000", 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.810980+0000", 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2899999999999999e-06 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.810986+0000", 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5300000000000002e-06 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811005+0000", 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8335999999999999e-05 2024-05-09T09:53:29.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811015+0000", 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7839999999999998e-06 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811128+0000", 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113854 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811346+0000", 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021784500000000001 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811825+0000", 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047905099999999998 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.813506+0000", 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016806869999999999 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.814591+0000", 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010850359999999999 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.814668+0000", 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6551000000000006e-05 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.814743+0000", 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5579000000000003e-05 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.299 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.835394+0000", 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.372244037, 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034723390000000001, 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 835 2024-05-09T09:53:29.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835394+0000", 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835394+0000", 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835396+0000", 2024-05-09T09:53:29.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835408+0000", 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1447000000000001e-05 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835438+0000", 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0559000000000003e-05 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835453+0000", 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4466e-05 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835604+0000", 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151404 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835975+0000", 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037109000000000003 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.836525+0000", 2024-05-09T09:53:29.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00055013900000000005 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.837875+0000", 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013496339999999999 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.838595+0000", 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00072041900000000003 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.838753+0000", 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015748300000000001 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.838866+0000", 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113428 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.885564+0000", 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.322073773, 2024-05-09T09:53:29.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033792380000000001, 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 856 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885564+0000", 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885564+0000", 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885567+0000", 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4140000000000001e-06 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885580+0000", 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3295999999999999e-05 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885612+0000", 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1973e-05 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885627+0000", 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4776e-05 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885783+0000", 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015667099999999999 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.886144+0000", 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000360949 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.886718+0000", 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057373899999999998 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.888008+0000", 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001289838 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.888720+0000", 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00071207599999999996 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.888826+0000", 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106591 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.888943+0000", 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116915 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.041331+0000", 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.166306597, 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003291642, 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.311 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 922 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041331+0000", 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041331+0000", 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041334+0000", 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6199999999999999e-06 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041346+0000", 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2113000000000001e-05 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041378+0000", 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1508999999999999e-05 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041392+0000", 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4446e-05 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041545+0000", 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015279099999999999 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041896+0000", 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035107299999999998 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.042437+0000", 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054111299999999997 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.043623+0000", 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001186133 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.044355+0000", 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073215499999999996 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.044506+0000", 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015090700000000001 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.044623+0000", 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011678199999999999 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.316 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.046089+0000", 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.161549121, 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033164150000000001, 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 924 2024-05-09T09:53:29.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046089+0000", 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046089+0000", 2024-05-09T09:53:29.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046091+0000", 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.323e-06 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046103+0000", 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1634000000000001e-05 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046136+0000", 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3225000000000001e-05 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046155+0000", 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-05 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046277+0000", 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122028 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046498+0000", 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022132200000000001 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046952+0000", 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045405800000000002 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.048286+0000", 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013334239999999999 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.049137+0000", 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085153300000000002 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.049292+0000", 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154427 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.049405+0000", 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011364100000000001 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.322 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.323 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.323 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.323 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:29.324 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:53:29.325 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:29.320+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:29.425 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:29.424+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:29.452 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:29.452 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:29.453 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:53:29.453 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:29.467 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:53:29.526 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:29.523+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:29.590 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:53:29.590 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:53:29.590 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:29.604 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:53:29.647 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:29.647+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:29.729 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:29.724+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:29.758 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:53:29.773 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.623984482999999, 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.774 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:53:29.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:53:29.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94540191530800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.182236+0000", 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.589899837000001, 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027487309999999999, 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.781 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 47 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182236+0000", 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182236+0000", 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182238+0000", 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1150000000000001e-06 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182246+0000", 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7519999999999996e-06 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182272+0000", 2024-05-09T09:53:29.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6624000000000001e-05 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182292+0000", 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9491999999999999e-05 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182385+0000", 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3597000000000005e-05 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182549+0000", 2024-05-09T09:53:29.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000163821 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182878+0000", 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032844100000000001 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.184206+0000", 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00132836 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.184691+0000", 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048464999999999999 2024-05-09T09:53:29.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.184832+0000", 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014086 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.184985+0000", 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015301900000000001 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.192854+0000", 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.579281282, 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025003349999999998, 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 54 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192854+0000", 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192854+0000", 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192857+0000", 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2460000000000002e-06 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192868+0000", 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1643e-05 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192898+0000", 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9717e-05 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192913+0000", 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4499e-05 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.193056+0000", 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014307 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.193244+0000", 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018819299999999999 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.193499+0000", 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255515 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.194777+0000", 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001278054 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195213+0000", 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043614700000000001 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195284+0000", 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0128000000000003e-05 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195355+0000", 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1123000000000003e-05 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94540191545856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.195548+0000", 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.576587868000001, 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00238639, 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.792 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 55 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195548+0000", 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195548+0000", 2024-05-09T09:53:29.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195549+0000", 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6300000000000001e-06 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195557+0000", 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0029999999999994e-06 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195586+0000", 2024-05-09T09:53:29.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8572999999999999e-05 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195620+0000", 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4056000000000001e-05 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195736+0000", 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116081 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195862+0000", 2024-05-09T09:53:29.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012581699999999999 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.196078+0000", 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021651600000000001 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.196840+0000", 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076190299999999997 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.197746+0000", 2024-05-09T09:53:29.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000905572 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.197831+0000", 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4858000000000006e-05 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.197934+0000", 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010338100000000001 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.797 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.286371+0000", 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.485765163, 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002000099, 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286371+0000", 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286371+0000", 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286372+0000", 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286384+0000", 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.207e-05 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286412+0000", 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7475999999999999e-05 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286431+0000", 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.861e-05 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286588+0000", 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015792599999999999 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286644+0000", 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5933000000000001e-05 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.288269+0000", 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016247290000000001 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.288371+0000", 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101475 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.193965+0000", 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.578170836, 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834979999999998, 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.193965+0000", 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.193965+0000", 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.193966+0000", 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.193977+0000", 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1573000000000001e-05 2024-05-09T09:53:29.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.194032+0000", 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4786e-05 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.194054+0000", 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2446000000000002e-05 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.194287+0000", 2024-05-09T09:53:29.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023203899999999999 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.194334+0000", 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7475999999999997e-05 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.196834+0000", 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025003069999999998 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.196948+0000", 2024-05-09T09:53:29.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114048 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:221 6.3 e30/24 6:c623b173:gc::gc.16:head v 30'3, mlcod=30'1)", 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.239526+0000", 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.532609461, 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001824397, 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239526+0000", 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239526+0000", 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239528+0000", 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0930000000000001e-06 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239543+0000", 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4543e-05 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239580+0000", 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6763e-05 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239600+0000", 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0112e-05 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239742+0000", 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000142001 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239803+0000", 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1519000000000005e-05 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.241272+0000", 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001468561 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.241351+0000", 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8805000000000002e-05 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:319 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.311901+0000", 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.460234655000001, 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038388879999999999, 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.810 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311901+0000", 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311901+0000", 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311902+0000", 2024-05-09T09:53:29.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7000000000000004e-07 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311913+0000", 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0910000000000001e-05 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311938+0000", 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4992999999999999e-05 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311955+0000", 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7649e-05 2024-05-09T09:53:29.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.312132+0000", 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017628699999999999 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.312175+0000", 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3272000000000002e-05 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.315612+0000", 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003437056 2024-05-09T09:53:29.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.315740+0000", 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012795100000000001 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:374 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.322882+0000", 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.449253218000001, 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019242529999999999, 2024-05-09T09:53:29.814 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322882+0000", 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322882+0000", 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322884+0000", 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9039999999999999e-06 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322899+0000", 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4185999999999999e-05 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322934+0000", 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5892999999999997e-05 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322954+0000", 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9436000000000002e-05 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323107+0000", 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015337 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323179+0000", 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2115999999999999e-05 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324618+0000", 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014384210000000001 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324807+0000", 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000188927 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:376 6.3 e30/24 6:c623b173:gc::gc.16:head v 30'5, mlcod=30'3)", 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.323493+0000", 2024-05-09T09:53:29.818 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.448642212999999, 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020762390000000001, 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323493+0000", 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323493+0000", 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323495+0000", 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.773e-06 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323511+0000", 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6209999999999999e-05 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323540+0000", 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8396000000000001e-05 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323553+0000", 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3169999999999999e-05 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323689+0000", 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013552700000000001 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323754+0000", 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5172000000000006e-05 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325468+0000", 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001713836 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325570+0000", 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102155 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.822 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:427 6.a e30/24 6:50d64734:::obj_delete_at_hint.0000000009:head v 30'2, mlcod=0'0)", 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.351615+0000", 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.420520905, 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002302709, 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351615+0000", 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351615+0000", 2024-05-09T09:53:29.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351617+0000", 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9539999999999998e-06 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351630+0000", 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3519999999999999e-05 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351660+0000", 2024-05-09T09:53:29.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9839e-05 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351677+0000", 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6923e-05 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351846+0000", 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168748 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351905+0000", 2024-05-09T09:53:29.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8967e-05 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353814+0000", 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019090769999999999 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353917+0000", 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103681 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:434 6.a e30/24 6:50d64734:::obj_delete_at_hint.0000000009:head v 30'3, mlcod=30'1)", 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.355779+0000", 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.416356421, 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017471590000000001, 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355779+0000", 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355779+0000", 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355781+0000", 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.928e-06 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355794+0000", 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3016999999999999e-05 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355826+0000", 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2153999999999997e-05 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355843+0000", 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6976000000000001e-05 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355971+0000", 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012727600000000001 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.356008+0000", 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7499000000000001e-05 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357441+0000", 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014330479999999999 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357526+0000", 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5260999999999996e-05 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.830 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:437 6.a e30/24 6:5127e642:gc::gc.21:head v 30'5, mlcod=30'2)", 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.360187+0000", 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.411948260000001, 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003571818, 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360187+0000", 2024-05-09T09:53:29.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360187+0000", 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360189+0000", 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5e-06 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360199+0000", 2024-05-09T09:53:29.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0097e-05 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360225+0000", 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5724999999999998e-05 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360243+0000", 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8408000000000001e-05 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360388+0000", 2024-05-09T09:53:29.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000145074 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360422+0000", 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4193999999999998e-05 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363672+0000", 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032500129999999999 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363759+0000", 2024-05-09T09:53:29.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6806999999999997e-05 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:440 6.a e30/24 6:55b0279d:reshard::reshard.0000000009:head v 30'6, mlcod=30'3)", 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.362231+0000", 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.409905089, 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062617339999999997, 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362231+0000", 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362231+0000", 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362232+0000", 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.48e-06 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362245+0000", 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2721999999999999e-05 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362268+0000", 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3485999999999998e-05 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362285+0000", 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6534000000000001e-05 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362409+0000", 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012427400000000001 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362452+0000", 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3313999999999999e-05 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368388+0000", 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059357630000000002 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368492+0000", 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010416099999999999 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:447 6.a e30/24 6:5127e642:gc::gc.21:head v 30'7, mlcod=30'4)", 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.367707+0000", 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.404428337000001, 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037289519999999998, 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.839 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367707+0000", 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367707+0000", 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367709+0000", 2024-05-09T09:53:29.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9309999999999998e-06 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367723+0000", 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3295000000000001e-05 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367756+0000", 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3247000000000002e-05 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367774+0000", 2024-05-09T09:53:29.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7734e-05 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367907+0000", 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013296099999999999 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367940+0000", 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3698999999999997e-05 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371342+0000", 2024-05-09T09:53:29.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003402136 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371436+0000", 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3949000000000005e-05 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:465 6.5 e30/24 6:a7f90313:reshard::reshard.0000000012:head v 30'5, mlcod=30'2)", 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.377896+0000", 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.39423953, 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021422939999999999, 2024-05-09T09:53:29.843 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377896+0000", 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377896+0000", 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377897+0000", 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.294e-06 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377908+0000", 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0974e-05 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377929+0000", 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0939999999999999e-05 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377941+0000", 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1405e-05 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.378087+0000", 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014667599999999999 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.378143+0000", 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5318999999999997e-05 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.379942+0000", 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017988539999999999 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.380038+0000", 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6831999999999997e-05 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:474 6.5 e30/24 6:a7f90313:reshard::reshard.0000000012:head v 30'7, mlcod=30'5)", 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.382930+0000", 2024-05-09T09:53:29.847 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.389205641, 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021862890000000001, 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382930+0000", 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382930+0000", 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382931+0000", 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4249999999999999e-06 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382941+0000", 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7340000000000003e-06 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382965+0000", 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4230999999999999e-05 2024-05-09T09:53:29.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382983+0000", 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7079999999999999e-05 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.383106+0000", 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012309199999999999 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.383152+0000", 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6555999999999999e-05 2024-05-09T09:53:29.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.384973+0000", 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018209490000000001 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.385116+0000", 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014322200000000001 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:609 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'11, mlcod=30'9)", 2024-05-09T09:53:29.851 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.464972+0000", 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.307163464, 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003577893, 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.464972+0000", 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.464972+0000", 2024-05-09T09:53:29.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.464974+0000", 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6929999999999999e-06 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.464987+0000", 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3575e-05 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.465006+0000", 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8649000000000001e-05 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.465019+0000", 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.465174+0000", 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155179 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.465227+0000", 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2833000000000001e-05 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.468461+0000", 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032344499999999998 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.468550+0000", 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9104000000000006e-05 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:612 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'6, mlcod=30'4)", 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.467268+0000", 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.304868072, 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001923522, 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467268+0000", 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467268+0000", 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467269+0000", 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.463e-06 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467281+0000", 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1569999999999999e-05 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467307+0000", 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6696e-05 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467323+0000", 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5679999999999999e-05 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467452+0000", 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012939399999999999 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467489+0000", 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6232999999999997e-05 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.469081+0000", 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015919479999999999 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.469191+0000", 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110538 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.859 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:709 6.1e e30/24 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 30'1, mlcod=0'0)", 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.552993+0000", 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.219142482000001, 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020933480000000001, 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552993+0000", 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552993+0000", 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552994+0000", 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6000000000000003e-07 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553001+0000", 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4359999999999996e-06 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553024+0000", 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2246e-05 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553037+0000", 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2989999999999999e-05 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553131+0000", 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4143999999999999e-05 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553177+0000", 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5853000000000003e-05 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555008+0000", 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001831088 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555087+0000", 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8930999999999994e-05 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.863 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:29.864 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:29.864 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:29.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:53:29.866 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:29.863+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:29.966 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:29.967+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:30.036 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:30.037 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:30.037 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:53:30.037 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:30.050 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:53:30.095 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:30.095+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:30.168 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:30.164+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:30.216 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:30.216 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:30.216 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:53:30.216 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:53:30.216 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:30.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:53:30.269 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:30.268+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:30.356 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.245847010999999, 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01177042, 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.357 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 34 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1999999999999999e-07 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108403+0000", 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0270000000000003e-06 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108413+0000", 2024-05-09T09:53:30.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108420+0000", 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3459999999999996e-06 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115125+0000", 2024-05-09T09:53:30.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067043570000000002 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115354+0000", 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022952399999999999 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115725+0000", 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000371085 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118381+0000", 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026558110000000001 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120045+0000", 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016640069999999999 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120112+0000", 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6544999999999994e-05 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120168+0000", 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6354999999999998e-05 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.245812655000002, 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011861454, 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.363 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 35 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108433+0000", 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108520+0000", 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7187000000000004e-05 2024-05-09T09:53:30.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108532+0000", 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1826e-05 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108540+0000", 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.977e-06 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116666+0000", 2024-05-09T09:53:30.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081267839999999997 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116854+0000", 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000187858 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.117057+0000", 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000203298 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.367 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120017+0000", 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002959925 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120181+0000", 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000163688 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120242+0000", 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0952000000000002e-05 2024-05-09T09:53:30.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120293+0000", 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1341999999999997e-05 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.369 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.245691324999999, 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014433260999999999, 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 36 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.370 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108554+0000", 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8000000000000005e-07 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108560+0000", 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7100000000000004e-06 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108570+0000", 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9320000000000008e-06 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108577+0000", 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4970000000000004e-06 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118920+0000", 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010342374999999999 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119063+0000", 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143549 2024-05-09T09:53:30.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119275+0000", 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021153799999999999 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121299+0000", 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00202388 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122657+0000", 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001358646 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122809+0000", 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000152232 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122987+0000", 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017712199999999999 2024-05-09T09:53:30.375 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.245655892999999, 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014725665000000001, 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.376 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 37 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108595+0000", 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5029999999999997e-06 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108605+0000", 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6760000000000002e-06 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108613+0000", 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0399999999999993e-06 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120347+0000", 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011734751 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120510+0000", 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016299500000000001 2024-05-09T09:53:30.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120747+0000", 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023618599999999999 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121801+0000", 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001054073 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123074+0000", 2024-05-09T09:53:30.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012731820000000001 2024-05-09T09:53:30.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123210+0000", 2024-05-09T09:53:30.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013588599999999999 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123314+0000", 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104693 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.383 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.058309950999998, 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011610934999999999, 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 107 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295936+0000", 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.33e-06 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295944+0000", 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7270000000000007e-06 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295958+0000", 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4396000000000001e-05 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295967+0000", 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5189999999999992e-06 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301367+0000", 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054005399999999997 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301606+0000", 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023853000000000001 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301974+0000", 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036834200000000002 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304354+0000", 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023801859999999998 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307278+0000", 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029238129999999999 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307420+0000", 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014152199999999999 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307546+0000", 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012603000000000001 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.058247216000002, 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011972679999999999, 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.389 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 108 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295998+0000", 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.133e-06 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296010+0000", 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1347e-05 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296029+0000", 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9082000000000001e-05 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296042+0000", 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3077e-05 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303214+0000", 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071718399999999996 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303367+0000", 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015363200000000001 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303586+0000", 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021871400000000001 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307666+0000", 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040799879999999997 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307707+0000", 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0371999999999999e-05 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307862+0000", 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155365 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307970+0000", 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010813 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.394 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.058170225000001, 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01220095, 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 109 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:30.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296075+0000", 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296226+0000", 2024-05-09T09:53:30.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150192 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296242+0000", 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-05 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296251+0000", 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9930000000000001e-06 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304458+0000", 2024-05-09T09:53:30.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082062200000000002 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304592+0000", 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134189 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304850+0000", 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000258049 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307991+0000", 2024-05-09T09:53:30.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031414289999999998 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308112+0000", 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121044 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308206+0000", 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3239999999999995e-05 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308275+0000", 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9680999999999999e-05 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.057975127999999, 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012485019, 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 110 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296270+0000", 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7400000000000002e-07 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296276+0000", 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7259999999999999e-06 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296286+0000", 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296294+0000", 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8830000000000006e-06 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.305820+0000", 2024-05-09T09:53:30.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095260510000000007 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306073+0000", 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025283199999999998 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306440+0000", 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036732600000000001 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308450+0000", 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020098730000000001 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308488+0000", 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7953000000000001e-05 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308626+0000", 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013755899999999999 2024-05-09T09:53:30.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308754+0000", 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012882900000000001 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.057938659000001, 2024-05-09T09:53:30.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017360891, 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 111 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296307+0000", 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6000000000000003e-07 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296312+0000", 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2270000000000001e-06 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296331+0000", 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9021999999999998e-05 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296338+0000", 2024-05-09T09:53:30.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3499999999999999e-06 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308837+0000", 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012499212000000001 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308974+0000", 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013678200000000001 2024-05-09T09:53:30.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309174+0000", 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019962100000000001 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313341+0000", 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041673029999999998 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313387+0000", 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6335000000000003e-05 2024-05-09T09:53:30.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313545+0000", 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000157396 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313667+0000", 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121983 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.412 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.057894390000001, 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017863329000000001, 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.413 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 112 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:30.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296351+0000", 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296450+0000", 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9403999999999999e-05 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296468+0000", 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7286e-05 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296477+0000", 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3160000000000003e-06 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309891+0000", 2024-05-09T09:53:30.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013414188000000001 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310132+0000", 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024091600000000001 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310523+0000", 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039117200000000001 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313774+0000", 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032510299999999998 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313968+0000", 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019364800000000001 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314101+0000", 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013338900000000001 2024-05-09T09:53:30.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314214+0000", 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011230000000000001 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:30.419 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.057751434, 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020963909999999999, 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 113 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296494+0000", 2024-05-09T09:53:30.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7599999999999996e-07 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296499+0000", 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296509+0000", 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026e-05 2024-05-09T09:53:30.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296517+0000", 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2760000000000003e-06 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.311889+0000", 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015371839999999999 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312137+0000", 2024-05-09T09:53:30.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024836900000000002 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312559+0000", 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042197099999999999 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313929+0000", 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013705659999999999 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317187+0000", 2024-05-09T09:53:30.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00325743 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317332+0000", 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014464499999999999 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317457+0000", 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.425 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.057716189000001, 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:53:30.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.057682035999999, 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.431 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:30.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.057561513, 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.437 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:30.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:53:30.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:53:30.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:53:30.443 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.057525986999998, 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.444 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:53:30.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.852833707999999, 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011186751, 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.450 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 137 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.91e-07 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501474+0000", 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2438000000000001e-05 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501481+0000", 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1729999999999998e-06 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501486+0000", 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8829999999999997e-06 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508163+0000", 2024-05-09T09:53:30.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066771729999999998 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508216+0000", 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2713999999999997e-05 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508313+0000", 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7361999999999994e-05 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510117+0000", 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018037859999999999 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512542+0000", 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002425431 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512574+0000", 2024-05-09T09:53:30.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1520000000000003e-05 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512598+0000", 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3980000000000001e-05 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.852747408999999, 2024-05-09T09:53:30.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011159946, 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 138 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:30.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501498+0000", 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0800000000000004e-07 2024-05-09T09:53:30.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501503+0000", 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9300000000000002e-06 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501510+0000", 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3409999999999997e-06 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501514+0000", 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6370000000000001e-06 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509072+0000", 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075585929999999997 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509131+0000", 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9033000000000002e-05 2024-05-09T09:53:30.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509224+0000", 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2602999999999994e-05 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510147+0000", 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092332099999999995 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512604+0000", 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024564140000000001 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512634+0000", 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9842e-05 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512657+0000", 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3524e-05 2024-05-09T09:53:30.462 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.852721704, 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011196616, 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 139 2024-05-09T09:53:30.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:30.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.63e-07 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501528+0000", 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7609999999999998e-06 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501538+0000", 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5140000000000007e-06 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501544+0000", 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5429999999999999e-06 2024-05-09T09:53:30.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509598+0000", 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080541220000000004 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509654+0000", 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6190000000000002e-05 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509746+0000", 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1917999999999996e-05 2024-05-09T09:53:30.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512143+0000", 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023969059999999999 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512663+0000", 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00051997499999999999 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512693+0000", 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0190000000000001e-05 2024-05-09T09:53:30.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512719+0000", 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6033999999999998e-05 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.852689718000001, 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011246727999999999, 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 140 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4600000000000005e-07 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501626+0000", 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0950000000000003e-05 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501637+0000", 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0166000000000001e-05 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501645+0000", 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0439999999999996e-06 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510173+0000", 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085285970000000006 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510227+0000", 2024-05-09T09:53:30.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.393e-05 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510328+0000", 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101041 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512207+0000", 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001879241 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512741+0000", 2024-05-09T09:53:30.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053346999999999997 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512775+0000", 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4119000000000003e-05 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512802+0000", 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6624000000000001e-05 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.473 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.852584910000001, 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011248421, 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 141 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501661+0000", 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6899999999999996e-07 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:30.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501669+0000", 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2849999999999995e-06 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501678+0000", 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7839999999999992e-06 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501686+0000", 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6559999999999998e-06 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511265+0000", 2024-05-09T09:53:30.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095784100000000007 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511381+0000", 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116153 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511548+0000", 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000167178 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512836+0000", 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012884509999999999 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512850+0000", 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3558e-05 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512882+0000", 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2175999999999998e-05 2024-05-09T09:53:30.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512908+0000", 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5901000000000002e-05 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:30.479 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:30.481 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:30.479+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:30.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:53:30.581 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:30.579+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:30.616 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:30.616 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:30.616 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:30.616 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:30.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:53:30.682 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:30.683+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:30.730 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:53:30.770 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:30.771 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:30.771 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:30.771 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:30.771 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:30.783 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:30.783+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:30.785 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:53:30.884 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:30.883+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:30.961 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:30.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:30.961 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.757953049999999, 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.962 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.790942988999999, 2024-05-09T09:53:30.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:53:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:53:30.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:53:30.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:53:30.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.760844505, 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:30.973 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:30.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:53:30.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:53:30.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:53:30.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.731192053000001, 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:30.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:53:30.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:53:30.984 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.716621663, 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:30.985 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.990 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.688271305000001, 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:30.991 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:53:30.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.992 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:30.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:30.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:30.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:53:30.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:53:30.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:30.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:53:30.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.669547313000001, 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:53:30.998 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:30.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.632682235000001, 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:53:31.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:421 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:31.009 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.611028353, 2024-05-09T09:53:31.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023115050000000002, 2024-05-09T09:53:31.010 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.010 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.010 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.010 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 421 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6099999999999999e-07 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347530+0000", 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5390000000000001e-06 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347542+0000", 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2172e-05 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347549+0000", 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.199e-06 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347600+0000", 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0612999999999998e-05 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347654+0000", 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3690000000000003e-05 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347772+0000", 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118337 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.348435+0000", 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000662493 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349772+0000", 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013372029999999999 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349806+0000", 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4557999999999997e-05 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349836+0000", 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9839999999999999e-05 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.567498885999999, 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:53:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:53:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.021 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.564646611000001, 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.022 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:31.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:53:31.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:53:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:53:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:53:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.561507427, 2024-05-09T09:53:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:53:31.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.436601185000001, 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:31.040 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.43159204, 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:53:31.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:53:31.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:53:31.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:53:31.045 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.236959632, 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.046 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:53:31.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:53:31.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.232785936999999, 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.052 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.180898880000001, 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.063 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.176304671, 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:53:31.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:53:31.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:53:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:53:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:53:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:53:31.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:53:31.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:53:31.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 11.995009384999999, 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 11.991320634999999, 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:31.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:53:31.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:53:31.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:53:31.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.081 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:31.083 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:31.083 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:31.084 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:53:31.085 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:31.083+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:31.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:53:31.185 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:31.183+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:31.219 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:31.219 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:31.236 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:53:31.281 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:31.281 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:31.287 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:31.287+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:31.300 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:31.300 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:31.317 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:31.317 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:31.334 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:31.334 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:31.355 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:31.355 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:31.357 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:31.357 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:31.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:53:31.377 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:31.378 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:31.398 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:31.398 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:31.399 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:31.396+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:31.419 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:31.419 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:31.488 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:31.484+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:31.496 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:31.496 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:31.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:53:31.598 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:31.596+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:31.684 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:31.684 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:31.690 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:31.687+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:31.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:53:31.791 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:31.788+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:31.868 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:31.868 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:31.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:53:31.930 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:31.928+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:31.993 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:31.991+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:32.070 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:32.070 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:32.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:53:32.094 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:32.091+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:32.194 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:32.192+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:32.215 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:32.215 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:32.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:53:32.296 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:32.295+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:32.397 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:32.392+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:32.408 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:32.408 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:32.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:53:32.498 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:32.495+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:32.599 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:32.599+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:32.605 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:32.605 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:32.620 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:53:32.699 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:32.696+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:32.754 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:32.754 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:32.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:53:32.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:53:32.806 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:32.804+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:32.889 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:32.889 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:32.902 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:32.903+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:32.903 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:53:33.004 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:33.000+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:33.070 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:33.070 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:33.084 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:53:33.130 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:33.131+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:33.140 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:53:33.205 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:33.205 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:33.205 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:33.203+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:33.220 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:53:33.306 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:33.304+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:33.384 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:33.384 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:33.400 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:53:33.408 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:33.404+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:33.438 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:53:33.508 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:33.504+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:33.518 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:33.518 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:33.534 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:53:33.601 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:33.602 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:33.609 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:33.604+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:33.619 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:33.619 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:33.637 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:33.637 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:33.656 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:33.656 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:33.656 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:33.657 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:33.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:53:33.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:33.689 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:33.710 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:33.708+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:33.715 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:33.733 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:33.734 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:33.752 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:33.753 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:33.794 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:53:33.794 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:53:33.794 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:33.809 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:53:33.810 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:33.807+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:33.911 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:33.908+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:33.931 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.782105966, 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:33.932 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:53:33.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:53:33.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:53:33.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:53:33.939 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94540191530800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.182236+0000", 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.748021319999999, 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027487309999999999, 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:33.940 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 47 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182236+0000", 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182236+0000", 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182238+0000", 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1150000000000001e-06 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182246+0000", 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7519999999999996e-06 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182272+0000", 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6624000000000001e-05 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182292+0000", 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9491999999999999e-05 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182385+0000", 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3597000000000005e-05 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182549+0000", 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000163821 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.182878+0000", 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032844100000000001 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.184206+0000", 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00132836 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.184691+0000", 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048464999999999999 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.184832+0000", 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014086 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.184985+0000", 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015301900000000001 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.192854+0000", 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.737402764999999, 2024-05-09T09:53:33.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025003349999999998, 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 54 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192854+0000", 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192854+0000", 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192857+0000", 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2460000000000002e-06 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192868+0000", 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1643e-05 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192898+0000", 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9717e-05 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.192913+0000", 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4499e-05 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.193056+0000", 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014307 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.193244+0000", 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018819299999999999 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.193499+0000", 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255515 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.194777+0000", 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001278054 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195213+0000", 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043614700000000001 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195284+0000", 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0128000000000003e-05 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195355+0000", 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1123000000000003e-05 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94540191545856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.195548+0000", 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.734709350999999, 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00238639, 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:33.951 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 55 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195548+0000", 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195548+0000", 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195549+0000", 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6300000000000001e-06 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195557+0000", 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0029999999999994e-06 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195586+0000", 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8572999999999999e-05 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195620+0000", 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4056000000000001e-05 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195736+0000", 2024-05-09T09:53:33.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116081 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.195862+0000", 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012581699999999999 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.196078+0000", 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021651600000000001 2024-05-09T09:53:33.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.196840+0000", 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00076190299999999997 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.197746+0000", 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000905572 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.197831+0000", 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4858000000000006e-05 2024-05-09T09:53:33.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.197934+0000", 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010338100000000001 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:191 6.5 e27/24 6:a2ace8b3:::data_log.0:head v 27'1, mlcod=0'0)", 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.286371+0000", 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.643886645999999, 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002000099, 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.957 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286371+0000", 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286371+0000", 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286372+0000", 2024-05-09T09:53:33.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-06 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286384+0000", 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.207e-05 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286412+0000", 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7475999999999999e-05 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286431+0000", 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.861e-05 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286588+0000", 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015792599999999999 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.286644+0000", 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5933000000000001e-05 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.288269+0000", 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016247290000000001 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.288371+0000", 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101475 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.961 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:209 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'1, mlcod=0'0)", 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.193965+0000", 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.736292319, 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029834979999999998, 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.193965+0000", 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.193965+0000", 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.193966+0000", 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.23e-07 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.193977+0000", 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1573000000000001e-05 2024-05-09T09:53:33.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.194032+0000", 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4786e-05 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.194054+0000", 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2446000000000002e-05 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.194287+0000", 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023203899999999999 2024-05-09T09:53:33.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.194334+0000", 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7475999999999997e-05 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.196834+0000", 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025003069999999998 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.196948+0000", 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000114048 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.965 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:221 6.3 e30/24 6:c623b173:gc::gc.16:head v 30'3, mlcod=30'1)", 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.239526+0000", 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.690730944, 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001824397, 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.966 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239526+0000", 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239526+0000", 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239528+0000", 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0930000000000001e-06 2024-05-09T09:53:33.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239543+0000", 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4543e-05 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239580+0000", 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6763e-05 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239600+0000", 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0112e-05 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239742+0000", 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000142001 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.239803+0000", 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1519000000000005e-05 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.241272+0000", 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001468561 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.241351+0000", 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8805000000000002e-05 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:319 6.1 e30/24 6:856b9b26:reshard::reshard.0000000002:head v 30'1, mlcod=0'0)", 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.311901+0000", 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.618356137999999, 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038388879999999999, 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.970 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311901+0000", 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311901+0000", 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311902+0000", 2024-05-09T09:53:33.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7000000000000004e-07 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311913+0000", 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0910000000000001e-05 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311938+0000", 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4992999999999999e-05 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.311955+0000", 2024-05-09T09:53:33.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7649e-05 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.312132+0000", 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017628699999999999 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.312175+0000", 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3272000000000002e-05 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.315612+0000", 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003437056 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.315740+0000", 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012795100000000001 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:374 6.5 e30/24 6:a60f9269:lc::lua_package_allowlist:head v 30'2, mlcod=0'0)", 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.322882+0000", 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.607374700999999, 2024-05-09T09:53:33.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019242529999999999, 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322882+0000", 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322882+0000", 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322884+0000", 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9039999999999999e-06 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322899+0000", 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4185999999999999e-05 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322934+0000", 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5892999999999997e-05 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322954+0000", 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9436000000000002e-05 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323107+0000", 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015337 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323179+0000", 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2115999999999999e-05 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324618+0000", 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014384210000000001 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324807+0000", 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000188927 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:376 6.3 e30/24 6:c623b173:gc::gc.16:head v 30'5, mlcod=30'3)", 2024-05-09T09:53:33.978 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.323493+0000", 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.606763696, 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020762390000000001, 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323493+0000", 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323493+0000", 2024-05-09T09:53:33.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323495+0000", 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.773e-06 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323511+0000", 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6209999999999999e-05 2024-05-09T09:53:33.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323540+0000", 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8396000000000001e-05 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323553+0000", 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3169999999999999e-05 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323689+0000", 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013552700000000001 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323754+0000", 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5172000000000006e-05 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325468+0000", 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001713836 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325570+0000", 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102155 2024-05-09T09:53:33.982 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:427 6.a e30/24 6:50d64734:::obj_delete_at_hint.0000000009:head v 30'2, mlcod=0'0)", 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.351615+0000", 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.578642388, 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002302709, 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.983 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351615+0000", 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351615+0000", 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351617+0000", 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9539999999999998e-06 2024-05-09T09:53:33.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351630+0000", 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3519999999999999e-05 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351660+0000", 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9839e-05 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351677+0000", 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6923e-05 2024-05-09T09:53:33.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351846+0000", 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000168748 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351905+0000", 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8967e-05 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353814+0000", 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019090769999999999 2024-05-09T09:53:33.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353917+0000", 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103681 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:434 6.a e30/24 6:50d64734:::obj_delete_at_hint.0000000009:head v 30'3, mlcod=30'1)", 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.355779+0000", 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.574477904, 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017471590000000001, 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.987 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355779+0000", 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355779+0000", 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355781+0000", 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.928e-06 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355794+0000", 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3016999999999999e-05 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355826+0000", 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2153999999999997e-05 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355843+0000", 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6976000000000001e-05 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355971+0000", 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012727600000000001 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.356008+0000", 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7499000000000001e-05 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357441+0000", 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014330479999999999 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357526+0000", 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5260999999999996e-05 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:437 6.a e30/24 6:5127e642:gc::gc.21:head v 30'5, mlcod=30'2)", 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.360187+0000", 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.570069742999999, 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003571818, 2024-05-09T09:53:33.991 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360187+0000", 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360187+0000", 2024-05-09T09:53:33.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360189+0000", 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5e-06 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360199+0000", 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0097e-05 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360225+0000", 2024-05-09T09:53:33.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5724999999999998e-05 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360243+0000", 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8408000000000001e-05 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360388+0000", 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000145074 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360422+0000", 2024-05-09T09:53:33.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4193999999999998e-05 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363672+0000", 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032500129999999999 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363759+0000", 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6806999999999997e-05 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.995 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:440 6.a e30/24 6:55b0279d:reshard::reshard.0000000009:head v 30'6, mlcod=30'3)", 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.362231+0000", 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.568026572000001, 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062617339999999997, 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362231+0000", 2024-05-09T09:53:33.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362231+0000", 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362232+0000", 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.48e-06 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362245+0000", 2024-05-09T09:53:33.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2721999999999999e-05 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362268+0000", 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3485999999999998e-05 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362285+0000", 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6534000000000001e-05 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362409+0000", 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012427400000000001 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362452+0000", 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3313999999999999e-05 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368388+0000", 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059357630000000002 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:33.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368492+0000", 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010416099999999999 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:447 6.a e30/24 6:5127e642:gc::gc.21:head v 30'7, mlcod=30'4)", 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.367707+0000", 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.562549819999999, 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037289519999999998, 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367707+0000", 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367707+0000", 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367709+0000", 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9309999999999998e-06 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367723+0000", 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3295000000000001e-05 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367756+0000", 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3247000000000002e-05 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367774+0000", 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7734e-05 2024-05-09T09:53:34.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367907+0000", 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013296099999999999 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367940+0000", 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3698999999999997e-05 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371342+0000", 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003402136 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371436+0000", 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3949000000000005e-05 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:465 6.5 e30/24 6:a7f90313:reshard::reshard.0000000012:head v 30'5, mlcod=30'2)", 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.377896+0000", 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.552361013000001, 2024-05-09T09:53:34.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021422939999999999, 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377896+0000", 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377896+0000", 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377897+0000", 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.294e-06 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377908+0000", 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0974e-05 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377929+0000", 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0939999999999999e-05 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.377941+0000", 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1405e-05 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.378087+0000", 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014667599999999999 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.378143+0000", 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5318999999999997e-05 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.379942+0000", 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017988539999999999 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.380038+0000", 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6831999999999997e-05 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:474 6.5 e30/24 6:a7f90313:reshard::reshard.0000000012:head v 30'7, mlcod=30'5)", 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.382930+0000", 2024-05-09T09:53:34.008 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.547327124000001, 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021862890000000001, 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382930+0000", 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382930+0000", 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382931+0000", 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4249999999999999e-06 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382941+0000", 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7340000000000003e-06 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382965+0000", 2024-05-09T09:53:34.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4230999999999999e-05 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.382983+0000", 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7079999999999999e-05 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.383106+0000", 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012309199999999999 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.383152+0000", 2024-05-09T09:53:34.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6555999999999999e-05 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.384973+0000", 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018209490000000001 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.385116+0000", 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014322200000000001 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.012 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:609 6.3 e30/24 6:c60da066:gc::gc.4:head v 30'11, mlcod=30'9)", 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.464972+0000", 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.465284947000001, 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003577893, 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.464972+0000", 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.464972+0000", 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.464974+0000", 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6929999999999999e-06 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.464987+0000", 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3575e-05 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.465006+0000", 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8649000000000001e-05 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.465019+0000", 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.241e-05 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.465174+0000", 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155179 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.465227+0000", 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2833000000000001e-05 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.468461+0000", 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032344499999999998 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.468550+0000", 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9104000000000006e-05 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:612 6.c e30/24 6:36abfd60:::obj_delete_at_hint.0000000029:head v 30'6, mlcod=30'4)", 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.467268+0000", 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.462989555, 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001923522, 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467268+0000", 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467268+0000", 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467269+0000", 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.463e-06 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467281+0000", 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1569999999999999e-05 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467307+0000", 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6696e-05 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467323+0000", 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5679999999999999e-05 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467452+0000", 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012939399999999999 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.467489+0000", 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6232999999999997e-05 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.469081+0000", 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015919479999999999 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.469191+0000", 2024-05-09T09:53:34.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110538 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:709 6.1e e30/24 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 30'1, mlcod=0'0)", 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.552993+0000", 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.377263964999999, 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020933480000000001, 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552993+0000", 2024-05-09T09:53:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552993+0000", 2024-05-09T09:53:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552994+0000", 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6000000000000003e-07 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553001+0000", 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4359999999999996e-06 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553024+0000", 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2246e-05 2024-05-09T09:53:34.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553037+0000", 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2989999999999999e-05 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553131+0000", 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4143999999999999e-05 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.553177+0000", 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5853000000000003e-05 2024-05-09T09:53:34.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555008+0000", 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001831088 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555087+0000", 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8930999999999994e-05 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.025 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.026 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.026 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:34.027 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:53:34.028 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:34.027+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:34.128 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:34.124+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:34.197 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:34.197 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:53:34.198 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:34.211 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:53:34.259 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:34.259+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:34.330 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:34.328+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:34.335 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:34.335 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:53:34.336 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:53:34.336 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:34.350 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:53:34.435 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:34.435+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:34.517 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:34.517 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:53:34.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:53:34.517 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:53:34.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.517 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.517 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.406699627999998, 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01177042, 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 34 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1999999999999999e-07 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108403+0000", 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0270000000000003e-06 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108413+0000", 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108420+0000", 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3459999999999996e-06 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115125+0000", 2024-05-09T09:53:34.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067043570000000002 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115354+0000", 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022952399999999999 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115725+0000", 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000371085 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118381+0000", 2024-05-09T09:53:34.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026558110000000001 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120045+0000", 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016640069999999999 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120112+0000", 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6544999999999994e-05 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120168+0000", 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6354999999999998e-05 2024-05-09T09:53:34.522 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.406665271999998, 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011861454, 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.523 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 35 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108433+0000", 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108520+0000", 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7187000000000004e-05 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108532+0000", 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1826e-05 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108540+0000", 2024-05-09T09:53:34.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.977e-06 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116666+0000", 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081267839999999997 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116854+0000", 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000187858 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.117057+0000", 2024-05-09T09:53:34.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000203298 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120017+0000", 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002959925 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120181+0000", 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000163688 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120242+0000", 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0952000000000002e-05 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120293+0000", 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1341999999999997e-05 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.528 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.406543941999999, 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014433260999999999, 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.529 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 36 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108554+0000", 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8000000000000005e-07 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108560+0000", 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7100000000000004e-06 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108570+0000", 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9320000000000008e-06 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108577+0000", 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4970000000000004e-06 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118920+0000", 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010342374999999999 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119063+0000", 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143549 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119275+0000", 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021153799999999999 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121299+0000", 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00202388 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122657+0000", 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001358646 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122809+0000", 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000152232 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122987+0000", 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017712199999999999 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.406508510000002, 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014725665000000001, 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.535 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 37 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:34.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108595+0000", 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5029999999999997e-06 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108605+0000", 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6760000000000002e-06 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108613+0000", 2024-05-09T09:53:34.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0399999999999993e-06 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120347+0000", 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011734751 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120510+0000", 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016299500000000001 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120747+0000", 2024-05-09T09:53:34.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023618599999999999 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121801+0000", 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001054073 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123074+0000", 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012731820000000001 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123210+0000", 2024-05-09T09:53:34.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013588599999999999 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123314+0000", 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104693 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.219162568000002, 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011610934999999999, 2024-05-09T09:53:34.540 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 107 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295936+0000", 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.33e-06 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295944+0000", 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7270000000000007e-06 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295958+0000", 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4396000000000001e-05 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295967+0000", 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5189999999999992e-06 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301367+0000", 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054005399999999997 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301606+0000", 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023853000000000001 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301974+0000", 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036834200000000002 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304354+0000", 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023801859999999998 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307278+0000", 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029238129999999999 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307420+0000", 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014152199999999999 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307546+0000", 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012603000000000001 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.545 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.219099833000001, 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011972679999999999, 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.546 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 108 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295998+0000", 2024-05-09T09:53:34.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.133e-06 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296010+0000", 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1347e-05 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296029+0000", 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9082000000000001e-05 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296042+0000", 2024-05-09T09:53:34.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3077e-05 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303214+0000", 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071718399999999996 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303367+0000", 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015363200000000001 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303586+0000", 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021871400000000001 2024-05-09T09:53:34.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307666+0000", 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040799879999999997 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307707+0000", 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0371999999999999e-05 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307862+0000", 2024-05-09T09:53:34.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155365 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307970+0000", 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010813 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.219022842000001, 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01220095, 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 109 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296075+0000", 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296226+0000", 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150192 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296242+0000", 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-05 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296251+0000", 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9930000000000001e-06 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304458+0000", 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082062200000000002 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304592+0000", 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134189 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304850+0000", 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000258049 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307991+0000", 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031414289999999998 2024-05-09T09:53:34.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308112+0000", 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121044 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308206+0000", 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3239999999999995e-05 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308275+0000", 2024-05-09T09:53:34.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9680999999999999e-05 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.218827744999999, 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012485019, 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 110 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296270+0000", 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7400000000000002e-07 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296276+0000", 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7259999999999999e-06 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296286+0000", 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296294+0000", 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8830000000000006e-06 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.305820+0000", 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095260510000000007 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306073+0000", 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025283199999999998 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306440+0000", 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036732600000000001 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308450+0000", 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020098730000000001 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308488+0000", 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7953000000000001e-05 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308626+0000", 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013755899999999999 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308754+0000", 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012882900000000001 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.218791275999997, 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017360891, 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 111 2024-05-09T09:53:34.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296307+0000", 2024-05-09T09:53:34.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6000000000000003e-07 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296312+0000", 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2270000000000001e-06 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296331+0000", 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9021999999999998e-05 2024-05-09T09:53:34.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296338+0000", 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3499999999999999e-06 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308837+0000", 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012499212000000001 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308974+0000", 2024-05-09T09:53:34.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013678200000000001 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309174+0000", 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019962100000000001 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313341+0000", 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041673029999999998 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313387+0000", 2024-05-09T09:53:34.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6335000000000003e-05 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313545+0000", 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000157396 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313667+0000", 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121983 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.568 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.218747006999997, 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017863329000000001, 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 112 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296351+0000", 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296450+0000", 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9403999999999999e-05 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296468+0000", 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7286e-05 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296477+0000", 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3160000000000003e-06 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309891+0000", 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013414188000000001 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310132+0000", 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024091600000000001 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310523+0000", 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039117200000000001 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313774+0000", 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032510299999999998 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313968+0000", 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019364800000000001 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314101+0000", 2024-05-09T09:53:34.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013338900000000001 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314214+0000", 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011230000000000001 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.218604051, 2024-05-09T09:53:34.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020963909999999999, 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 113 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296494+0000", 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7599999999999996e-07 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296499+0000", 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296509+0000", 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026e-05 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296517+0000", 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2760000000000003e-06 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.311889+0000", 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015371839999999999 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312137+0000", 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024836900000000002 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312559+0000", 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042197099999999999 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313929+0000", 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013705659999999999 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317187+0000", 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00325743 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317332+0000", 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014464499999999999 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317457+0000", 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.580 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.218568806, 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:53:34.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:53:34.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:53:34.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.218534652999999, 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:53:34.586 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:34.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.218414129999999, 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.592 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:53:34.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:53:34.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.218378604000002, 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:34.603 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.013686325000002, 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011186751, 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 137 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.91e-07 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501474+0000", 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2438000000000001e-05 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501481+0000", 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1729999999999998e-06 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501486+0000", 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8829999999999997e-06 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508163+0000", 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066771729999999998 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508216+0000", 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2713999999999997e-05 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508313+0000", 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7361999999999994e-05 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510117+0000", 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018037859999999999 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512542+0000", 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002425431 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512574+0000", 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1520000000000003e-05 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512598+0000", 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3980000000000001e-05 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.013600025999999, 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011159946, 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.609 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 138 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501498+0000", 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0800000000000004e-07 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501503+0000", 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9300000000000002e-06 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501510+0000", 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3409999999999997e-06 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501514+0000", 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6370000000000001e-06 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509072+0000", 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075585929999999997 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509131+0000", 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9033000000000002e-05 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509224+0000", 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2602999999999994e-05 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510147+0000", 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092332099999999995 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512604+0000", 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024564140000000001 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512634+0000", 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9842e-05 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512657+0000", 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3524e-05 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.614 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.013574321, 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011196616, 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 139 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.63e-07 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501528+0000", 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7609999999999998e-06 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501538+0000", 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5140000000000007e-06 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501544+0000", 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5429999999999999e-06 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509598+0000", 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080541220000000004 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509654+0000", 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6190000000000002e-05 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509746+0000", 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1917999999999996e-05 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512143+0000", 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023969059999999999 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512663+0000", 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00051997499999999999 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512693+0000", 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0190000000000001e-05 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512719+0000", 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6033999999999998e-05 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.013542334999997, 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011246727999999999, 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 140 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4600000000000005e-07 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501626+0000", 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0950000000000003e-05 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501637+0000", 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0166000000000001e-05 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501645+0000", 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0439999999999996e-06 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510173+0000", 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085285970000000006 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510227+0000", 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.393e-05 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510328+0000", 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101041 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512207+0000", 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001879241 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512741+0000", 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053346999999999997 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512775+0000", 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4119000000000003e-05 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512802+0000", 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6624000000000001e-05 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.013437527000001, 2024-05-09T09:53:34.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011248421, 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 141 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:34.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501661+0000", 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6899999999999996e-07 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501669+0000", 2024-05-09T09:53:34.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2849999999999995e-06 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501678+0000", 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7839999999999992e-06 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501686+0000", 2024-05-09T09:53:34.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6559999999999998e-06 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511265+0000", 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095784100000000007 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511381+0000", 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116153 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511548+0000", 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000167178 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512836+0000", 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012884509999999999 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512850+0000", 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3558e-05 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512882+0000", 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2175999999999998e-05 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512908+0000", 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5901000000000002e-05 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:34.631 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:34.633 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:34.631+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:34.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:53:34.734 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:34.732+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:34.750 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:34.750 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:34.751 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:34.751 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:34.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:53:34.835 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:34.835+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:34.927 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:34.928 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:34.928 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:34.928 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:34.928 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:34.937 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:34.935+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:34.940 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:53:35.037 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:35.032+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:35.057 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:35.057 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:35.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:35.057 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.853758040999999, 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.058 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:53:35.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:53:35.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:35.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.886747979999999, 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:53:35.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:53:35.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:53:35.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:53:35.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.856649495999999, 2024-05-09T09:53:35.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:53:35.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:53:35.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.826997043999999, 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:53:35.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:53:35.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:53:35.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:53:35.081 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.812426653999999, 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.082 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:53:35.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.784076295999999, 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.089 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.094 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.765352304, 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:53:35.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:53:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:53:35.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:53:35.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.728487225999999, 2024-05-09T09:53:35.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:53:35.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:53:35.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:53:35.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:53:35.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:421 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.706833344, 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023115050000000002, 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 421 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6099999999999999e-07 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347530+0000", 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5390000000000001e-06 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347542+0000", 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2172e-05 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347549+0000", 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.199e-06 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347600+0000", 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0612999999999998e-05 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347654+0000", 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3690000000000003e-05 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347772+0000", 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118337 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.348435+0000", 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000662493 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349772+0000", 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013372029999999999 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349806+0000", 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4557999999999997e-05 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349836+0000", 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9839999999999999e-05 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:35.111 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.663303877000001, 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:35.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:53:35.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.660451601999998, 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:35.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:53:35.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:53:35.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.657312418, 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:53:35.123 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:53:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:53:35.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:53:35.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.129 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.532406175999999, 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.130 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:53:35.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.527397031, 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.136 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:53:35.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:53:35.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:53:35.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.141 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.332764622999999, 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:53:35.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:53:35.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:53:35.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:53:35.147 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.328590928000001, 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.148 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:53:35.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.154 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.276703870999999, 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:53:35.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:53:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:53:35.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.272109661999998, 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.161 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:53:35.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:53:35.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:53:35.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.167 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.090814376000001, 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:53:35.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:53:35.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:53:35.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.087125625999999, 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:35.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.179 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:35.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:53:35.181 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:35.179+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:35.182 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:53:35.282 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:35.280+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:35.354 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:35.354 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:35.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:53:35.384 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:35.383+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:35.486 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:35.483+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:35.539 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:35.540 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:35.540 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:35.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:53:35.598 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:35.596+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:35.691 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:35.687+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.580275715999999, 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.693 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:35.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:53:35.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:53:35.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.398918876, 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:53:35.698 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.703 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.395587353, 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.704 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:53:35.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:53:35.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:53:35.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:53:35.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.503271380000001, 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.709 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:53:35.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:53:35.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.483317522, 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.458560283000001, 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:53:35.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:53:35.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.726 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.440201494, 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:35.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:53:35.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:53:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:53:35.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:53:35.731 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.408249650999998, 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.732 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:35.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:53:35.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:53:35.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:53:35.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.737 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.37829859, 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:53:35.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:53:35.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.320849482, 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:53:35.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:53:35.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.274019030000002, 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:53:35.749 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.206970127999998, 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.755 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.201391321999999, 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:53:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:53:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.981246434999999, 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:53:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:53:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:53:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.861122687000002, 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.697744449999998, 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:53:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.662665177000001, 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:53:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:53:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:53:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:53:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.658818563000001, 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.625545989999999, 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:53:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.590999826000001, 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:53:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:53:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:35.804 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:35.804 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:53:35.806 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:53:35.806 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:35.804+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:35.907 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:35.904+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:35.978 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:35.978 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:35.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:53:36.008 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:36.007+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:36.018 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:36.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:36.037 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:36.037 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:36.054 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:36.054 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:36.071 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:36.071 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:36.093 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:36.093 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:36.109 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:36.104+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:36.117 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:36.117 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:36.139 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:36.139 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:36.150 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:36.150 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:36.160 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:36.160 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:36.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:53:36.223 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:36.220+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:36.310 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:36.308+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:36.341 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:53:36.366 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:36.366 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:36.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:53:36.413 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:36.411+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:36.513 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:36.508+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:36.543 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:36.543 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:36.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:53:36.642 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:36.640+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:36.716 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:36.712+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:36.723 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:36.723 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:36.739 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:53:36.826 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:36.824+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:36.903 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:36.903 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:36.918 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:53:36.919 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:36.916+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:37.019 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:37.019+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:37.051 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:37.051 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:37.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:53:37.150 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:37.151+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:37.220 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:37.219+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:37.231 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:37.232 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:37.245 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:53:37.331 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:37.331+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:37.411 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:37.411 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:37.422 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:37.419+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:37.425 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:53:37.522 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:37.519+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:37.589 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:37.589 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:37.603 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:53:37.623 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:37.620+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:37.724 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:37.723+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:37.769 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:37.769 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:37.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:53:37.827 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:37.827+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:37.926 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:37.923+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:37.944 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:37.945 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:37.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:53:38.028 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:38.024+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:38.128 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:38.129 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:38.129 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:38.127+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:38.143 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:53:38.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:53:38.230 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:38.228+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:38.310 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:38.310 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:38.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:53:38.331 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:38.328+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:38.354 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:38.354 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:38.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:53:38.373 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:38.373 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:38.393 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:38.394 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:38.411 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:38.411 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:38.431 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:38.431 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:38.432 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:38.431+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:38.447 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:38.447 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:38.453 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:38.462 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:53:38.472 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:38.472 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:38.490 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:38.490 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:38.554 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:38.552+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:38.632 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:38.632 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:53:38.632 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:38.633 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:38.631+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:38.646 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:53:38.734 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:38.735+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:38.810 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:53:38.810 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:53:38.810 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:38.825 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:53:38.836 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:38.832+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:38.937 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:38.935+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:38.992 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:53:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:53:38.992 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.883415276999997, 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01177042, 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 34 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.993 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1999999999999999e-07 2024-05-09T09:53:38.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108403+0000", 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0270000000000003e-06 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108413+0000", 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108420+0000", 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3459999999999996e-06 2024-05-09T09:53:38.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115125+0000", 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067043570000000002 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115354+0000", 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022952399999999999 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115725+0000", 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000371085 2024-05-09T09:53:38.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118381+0000", 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026558110000000001 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120045+0000", 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016640069999999999 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120112+0000", 2024-05-09T09:53:38.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6544999999999994e-05 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120168+0000", 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6354999999999998e-05 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.883380920999997, 2024-05-09T09:53:38.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011861454, 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 35 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:38.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108433+0000", 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108520+0000", 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7187000000000004e-05 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108532+0000", 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1826e-05 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108540+0000", 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.977e-06 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116666+0000", 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081267839999999997 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116854+0000", 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000187858 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.117057+0000", 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000203298 2024-05-09T09:53:39.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120017+0000", 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002959925 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120181+0000", 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000163688 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120242+0000", 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0952000000000002e-05 2024-05-09T09:53:39.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120293+0000", 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1341999999999997e-05 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.004 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.883259590999998, 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014433260999999999, 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 36 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108554+0000", 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8000000000000005e-07 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108560+0000", 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7100000000000004e-06 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108570+0000", 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9320000000000008e-06 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108577+0000", 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4970000000000004e-06 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118920+0000", 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010342374999999999 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119063+0000", 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143549 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119275+0000", 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021153799999999999 2024-05-09T09:53:39.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121299+0000", 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00202388 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122657+0000", 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001358646 2024-05-09T09:53:39.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122809+0000", 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000152232 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122987+0000", 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017712199999999999 2024-05-09T09:53:39.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.883224159000001, 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014725665000000001, 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 37 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:39.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108595+0000", 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5029999999999997e-06 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108605+0000", 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6760000000000002e-06 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108613+0000", 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0399999999999993e-06 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120347+0000", 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011734751 2024-05-09T09:53:39.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120510+0000", 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016299500000000001 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120747+0000", 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023618599999999999 2024-05-09T09:53:39.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121801+0000", 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001054073 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123074+0000", 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012731820000000001 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123210+0000", 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013588599999999999 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123314+0000", 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104693 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.018 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695878217000001, 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011610934999999999, 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.019 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 107 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:39.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295936+0000", 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.33e-06 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295944+0000", 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7270000000000007e-06 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295958+0000", 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4396000000000001e-05 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295967+0000", 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5189999999999992e-06 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301367+0000", 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054005399999999997 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301606+0000", 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023853000000000001 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301974+0000", 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036834200000000002 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304354+0000", 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023801859999999998 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307278+0000", 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029238129999999999 2024-05-09T09:53:39.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307420+0000", 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014152199999999999 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307546+0000", 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012603000000000001 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.025 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695815482, 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011972679999999999, 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.026 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 108 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295998+0000", 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.133e-06 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296010+0000", 2024-05-09T09:53:39.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1347e-05 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296029+0000", 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9082000000000001e-05 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296042+0000", 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3077e-05 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303214+0000", 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071718399999999996 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303367+0000", 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015363200000000001 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303586+0000", 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021871400000000001 2024-05-09T09:53:39.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307666+0000", 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040799879999999997 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307707+0000", 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0371999999999999e-05 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307862+0000", 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155365 2024-05-09T09:53:39.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307970+0000", 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010813 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695738491, 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01220095, 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.032 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 109 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296075+0000", 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296226+0000", 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150192 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296242+0000", 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-05 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296251+0000", 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9930000000000001e-06 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304458+0000", 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082062200000000002 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304592+0000", 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134189 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304850+0000", 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000258049 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307991+0000", 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031414289999999998 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308112+0000", 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121044 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308206+0000", 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3239999999999995e-05 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308275+0000", 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9680999999999999e-05 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695543393999998, 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012485019, 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 110 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:39.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296270+0000", 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7400000000000002e-07 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296276+0000", 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7259999999999999e-06 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296286+0000", 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296294+0000", 2024-05-09T09:53:39.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8830000000000006e-06 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.305820+0000", 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095260510000000007 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306073+0000", 2024-05-09T09:53:39.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025283199999999998 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306440+0000", 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036732600000000001 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308450+0000", 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020098730000000001 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308488+0000", 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7953000000000001e-05 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308626+0000", 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013755899999999999 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308754+0000", 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012882900000000001 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695506924999997, 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017360891, 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.045 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 111 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:39.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296307+0000", 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6000000000000003e-07 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296312+0000", 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2270000000000001e-06 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296331+0000", 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9021999999999998e-05 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296338+0000", 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3499999999999999e-06 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308837+0000", 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012499212000000001 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308974+0000", 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013678200000000001 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309174+0000", 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019962100000000001 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313341+0000", 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041673029999999998 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313387+0000", 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6335000000000003e-05 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313545+0000", 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000157396 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313667+0000", 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121983 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.051 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695462655999997, 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017863329000000001, 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.052 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 112 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296351+0000", 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296450+0000", 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9403999999999999e-05 2024-05-09T09:53:39.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296468+0000", 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7286e-05 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296477+0000", 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3160000000000003e-06 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309891+0000", 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013414188000000001 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310132+0000", 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024091600000000001 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310523+0000", 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039117200000000001 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313774+0000", 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032510299999999998 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313968+0000", 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019364800000000001 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314101+0000", 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013338900000000001 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314214+0000", 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011230000000000001 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.058 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695319699999999, 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020963909999999999, 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 113 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:39.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296494+0000", 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7599999999999996e-07 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296499+0000", 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296509+0000", 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026e-05 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296517+0000", 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2760000000000003e-06 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.311889+0000", 2024-05-09T09:53:39.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015371839999999999 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312137+0000", 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024836900000000002 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312559+0000", 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042197099999999999 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313929+0000", 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013705659999999999 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317187+0000", 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00325743 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317332+0000", 2024-05-09T09:53:39.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014464499999999999 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317457+0000", 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:39.065 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695284454999999, 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:53:39.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:53:39.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695250301999998, 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:53:39.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:53:39.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695129778999998, 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.077 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:39.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:53:39.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:53:39.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:53:39.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.695094253000001, 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.490401974000001, 2024-05-09T09:53:39.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011186751, 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 137 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.91e-07 2024-05-09T09:53:39.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501474+0000", 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2438000000000001e-05 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501481+0000", 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1729999999999998e-06 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501486+0000", 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8829999999999997e-06 2024-05-09T09:53:39.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508163+0000", 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066771729999999998 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508216+0000", 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2713999999999997e-05 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508313+0000", 2024-05-09T09:53:39.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7361999999999994e-05 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510117+0000", 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018037859999999999 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512542+0000", 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002425431 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512574+0000", 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1520000000000003e-05 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512598+0000", 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3980000000000001e-05 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.490315674999998, 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011159946, 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 138 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501498+0000", 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0800000000000004e-07 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501503+0000", 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9300000000000002e-06 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501510+0000", 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3409999999999997e-06 2024-05-09T09:53:39.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501514+0000", 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6370000000000001e-06 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509072+0000", 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075585929999999997 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509131+0000", 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9033000000000002e-05 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509224+0000", 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2602999999999994e-05 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510147+0000", 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092332099999999995 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512604+0000", 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024564140000000001 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512634+0000", 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9842e-05 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512657+0000", 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3524e-05 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.490289969999999, 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011196616, 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.101 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 139 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:39.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.63e-07 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501528+0000", 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7609999999999998e-06 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501538+0000", 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5140000000000007e-06 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501544+0000", 2024-05-09T09:53:39.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5429999999999999e-06 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509598+0000", 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080541220000000004 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509654+0000", 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6190000000000002e-05 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509746+0000", 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1917999999999996e-05 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512143+0000", 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023969059999999999 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512663+0000", 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00051997499999999999 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512693+0000", 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0190000000000001e-05 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512719+0000", 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6033999999999998e-05 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.490257984000003, 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011246727999999999, 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 140 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4600000000000005e-07 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501626+0000", 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0950000000000003e-05 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501637+0000", 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0166000000000001e-05 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501645+0000", 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0439999999999996e-06 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510173+0000", 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085285970000000006 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510227+0000", 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.393e-05 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510328+0000", 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101041 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512207+0000", 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001879241 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512741+0000", 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053346999999999997 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512775+0000", 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4119000000000003e-05 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512802+0000", 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6624000000000001e-05 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.113 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.490153176, 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011248421, 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:39.114 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 141 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501661+0000", 2024-05-09T09:53:39.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6899999999999996e-07 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501669+0000", 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2849999999999995e-06 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501678+0000", 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7839999999999992e-06 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501686+0000", 2024-05-09T09:53:39.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6559999999999998e-06 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511265+0000", 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095784100000000007 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511381+0000", 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116153 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511548+0000", 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000167178 2024-05-09T09:53:39.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512836+0000", 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012884509999999999 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512850+0000", 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3558e-05 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512882+0000", 2024-05-09T09:53:39.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2175999999999998e-05 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512908+0000", 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5901000000000002e-05 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:39.119 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:39.121 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:39.119+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:39.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:53:39.221 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:39.216+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:39.292 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:39.292 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:39.292 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:39.293 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:39.311 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:53:39.322 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:39.319+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:39.381 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:53:39.423 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:39.423+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:39.485 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:39.485 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:39.485 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:39.485 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:39.485 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:39.500 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:53:39.524 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:39.523+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:39.625 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:39.623+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:39.628 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:39.628 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:39.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:39.628 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:39.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.628 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:39.628 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.426990079999999, 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:39.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:53:39.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:53:39.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:53:39.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:53:39.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:53:39.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:53:39.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:53:39.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:53:39.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:39.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:53:39.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:53:39.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:53:39.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:53:39.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:53:39.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.638 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:53:39.638 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:39.638 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.459980019, 2024-05-09T09:53:39.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:53:39.638 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.639 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.639 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:53:39.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:39.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:53:39.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:53:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:39.647 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.429881535, 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:53:39.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:39.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:39.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:53:39.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:53:39.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:53:39.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:53:39.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:53:39.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.400229082999999, 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.656 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.657 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:53:39.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.657 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:53:39.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:53:39.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:53:39.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:53:39.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:53:39.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:53:39.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:53:39.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:53:39.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:53:39.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:53:39.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:53:39.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:53:39.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.385658693, 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:39.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:53:39.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:53:39.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:53:39.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:53:39.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:53:39.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:53:39.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:53:39.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:53:39.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:53:39.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:53:39.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:53:39.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:53:39.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:39.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:53:39.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:53:39.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:53:39.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:53:39.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:53:39.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:53:39.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:53:39.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:53:39.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:53:39.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:53:39.676 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.676 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.676 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.357308334999999, 2024-05-09T09:53:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:53:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.677 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.678 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:53:39.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.678 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:53:39.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:53:39.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:53:39.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:53:39.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:53:39.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:53:39.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:53:39.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:53:39.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:53:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:53:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:53:39.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:53:39.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:39.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:53:39.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:53:39.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:53:39.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:53:39.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:53:39.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:53:39.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:53:39.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:53:39.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:53:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:53:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.688 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.688 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:39.688 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.338584343000001, 2024-05-09T09:53:39.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:53:39.688 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.688 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.688 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:53:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:53:39.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.301719264999999, 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:53:39.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:53:39.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.700 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:421 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.280065383, 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023115050000000002, 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 421 2024-05-09T09:53:39.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:39.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6099999999999999e-07 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347530+0000", 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5390000000000001e-06 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347542+0000", 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2172e-05 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347549+0000", 2024-05-09T09:53:39.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.199e-06 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347600+0000", 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0612999999999998e-05 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347654+0000", 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3690000000000003e-05 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347772+0000", 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118337 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.348435+0000", 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000662493 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349772+0000", 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013372029999999999 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349806+0000", 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4557999999999997e-05 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349836+0000", 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9839999999999999e-05 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.236535916000001, 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:53:39.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.712 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.233683640999999, 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:53:39.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:53:39.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:53:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.230544457000001, 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.718 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:53:39.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:53:39.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:53:39.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.105638214999999, 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:53:39.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.729 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.10062907, 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:39.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:53:39.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.735 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.905996662, 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:39.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:53:39.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:53:39.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.901822967000001, 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.742 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:53:39.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.742 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:39.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:53:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:53:39.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:53:39.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:53:39.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.849935909999999, 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.747 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.752 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.845341700999999, 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.753 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:53:39.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:53:39.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:53:39.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.664046415000001, 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.758 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:39.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:53:39.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:53:39.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:53:39.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.660357664999999, 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:39.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:39.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:39.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:53:39.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:53:39.769 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.769 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.769 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.769 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:39.769 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:39.769 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:39.770 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:53:39.771 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:39.768+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:39.871 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:39.868+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:39.958 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:39.959 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:39.959 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:39.972 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:39.971+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:39.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:53:40.073 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:40.068+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:40.141 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:40.141 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:40.141 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:40.141 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:40.141 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:40.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:53:40.202 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:40.200+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:40.275 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:40.275+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:40.333 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:40.333 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:40.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:40.333 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:40.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.221237461000001, 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:40.334 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:53:40.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:53:40.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:53:40.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:53:40.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.039880620999998, 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:53:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:53:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:53:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:53:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:53:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.036549097999998, 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:53:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:53:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:53:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:53:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:53:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:53:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:53:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.144233125, 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:53:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:53:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.124279266999999, 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:53:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:53:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.099522027999999, 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:53:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:53:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:53:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.081163238999999, 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:53:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.049211396, 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:53:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:53:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.019260334999998, 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:53:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.961811226999998, 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:53:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:53:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:53:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:53:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.914980775, 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:53:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:53:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:53:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.847931873, 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:53:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:53:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.842353067000001, 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:53:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:53:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:53:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:53:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:53:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:53:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.622208180000001, 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.502084432, 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:53:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:53:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:53:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.338706195, 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:53:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.303626921999999, 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:53:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:53:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:53:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:53:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.299780307999999, 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:53:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.266507735000001, 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:53:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:53:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:53:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:53:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.231961570999999, 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:40.462 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:40.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:53:40.464 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:40.463+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:40.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:53:40.564 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:40.560+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:40.601 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:40.602 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:40.602 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:40.602 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:40.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:53:40.659 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:40.660 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:40.678 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:40.679 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:40.676+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:40.695 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:40.695 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:40.712 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:40.712 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:40.732 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:40.733 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:40.754 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:40.755 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:40.766 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:40.767+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:40.775 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:40.775 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:40.796 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:40.796 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:40.807 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:40.808 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:40.826 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:53:40.870 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:40.868+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:40.968 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:40.964+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:41.001 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:41.001 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:41.017 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:53:41.110 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:41.108+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:41.170 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:41.168+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:41.198 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:41.198 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:41.218 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:53:41.271 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:41.271+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:41.371 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:41.368+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:41.388 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:41.388 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:41.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:53:41.408 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:53:41.490 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:41.488+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:41.572 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:41.572 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:41.573 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:41.568+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:41.595 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:53:41.675 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:41.672+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:41.726 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:41.727 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:41.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:53:41.778 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:41.772+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:41.858 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:41.858 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:41.872 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:53:41.878 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:41.876+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:41.979 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:41.979+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:41.992 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:41.992 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:42.006 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:53:42.080 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:42.076+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:42.173 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:42.173 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:42.181 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:42.179+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:42.187 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:53:42.282 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:42.279+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:42.351 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:42.352 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:42.366 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:53:42.386 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:53:42.407 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:42.407+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:42.484 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:42.480+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:42.530 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:42.531 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:42.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:53:42.591 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:42.591+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:42.667 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:42.668 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:42.683 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:53:42.727 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:42.727+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:42.787 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:42.787+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:42.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:53:42.851 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:42.851 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:42.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:53:42.888 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:42.884+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:42.969 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:42.969 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:42.987 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:42.987 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:42.989 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:42.987+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:43.004 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:43.005 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:43.021 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:43.022 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:43.031 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:43.031 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:43.043 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:43.043 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:43.046 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:53:43.062 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:43.062 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:43.082 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:43.082 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:43.091 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:43.091+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:43.101 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:43.102 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:43.191 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:43.191+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:43.218 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:43.219 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:43.219 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:53:43.219 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:43.232 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:53:43.291 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:43.288+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:43.392 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:43.391+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:43.395 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:53:43.395 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:53:43.395 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:43.410 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:53:43.499 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:43.499+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:43.579 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:43.580 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:53:43.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:53:43.580 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:53:43.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.580 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.580 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:43.580 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.466228018000002, 2024-05-09T09:53:43.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01177042, 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 34 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.581 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:43.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1999999999999999e-07 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108403+0000", 2024-05-09T09:53:43.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0270000000000003e-06 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108413+0000", 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108420+0000", 2024-05-09T09:53:43.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3459999999999996e-06 2024-05-09T09:53:43.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115125+0000", 2024-05-09T09:53:43.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067043570000000002 2024-05-09T09:53:43.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115354+0000", 2024-05-09T09:53:43.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022952399999999999 2024-05-09T09:53:43.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115725+0000", 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000371085 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118381+0000", 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026558110000000001 2024-05-09T09:53:43.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120045+0000", 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016640069999999999 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120112+0000", 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6544999999999994e-05 2024-05-09T09:53:43.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120168+0000", 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6354999999999998e-05 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.466193662000002, 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011861454, 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 35 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108433+0000", 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108520+0000", 2024-05-09T09:53:43.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7187000000000004e-05 2024-05-09T09:53:43.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108532+0000", 2024-05-09T09:53:43.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1826e-05 2024-05-09T09:53:43.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108540+0000", 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.977e-06 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116666+0000", 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081267839999999997 2024-05-09T09:53:43.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116854+0000", 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000187858 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.117057+0000", 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000203298 2024-05-09T09:53:43.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120017+0000", 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002959925 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120181+0000", 2024-05-09T09:53:43.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000163688 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120242+0000", 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0952000000000002e-05 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120293+0000", 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1341999999999997e-05 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:43.598 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.466072332000003, 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014433260999999999, 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 36 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.599 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:43.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108554+0000", 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8000000000000005e-07 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108560+0000", 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7100000000000004e-06 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108570+0000", 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9320000000000008e-06 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108577+0000", 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4970000000000004e-06 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118920+0000", 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010342374999999999 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119063+0000", 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143549 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119275+0000", 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021153799999999999 2024-05-09T09:53:43.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121299+0000", 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00202388 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122657+0000", 2024-05-09T09:53:43.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001358646 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122809+0000", 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000152232 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122987+0000", 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017712199999999999 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.466036899999999, 2024-05-09T09:53:43.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014725665000000001, 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 37 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.608 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:43.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:43.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108595+0000", 2024-05-09T09:53:43.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5029999999999997e-06 2024-05-09T09:53:43.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108605+0000", 2024-05-09T09:53:43.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6760000000000002e-06 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108613+0000", 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0399999999999993e-06 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120347+0000", 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011734751 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120510+0000", 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016299500000000001 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120747+0000", 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023618599999999999 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121801+0000", 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001054073 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123074+0000", 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012731820000000001 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123210+0000", 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013588599999999999 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123314+0000", 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104693 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.616 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:43.617 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278690957999999, 2024-05-09T09:53:43.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011610934999999999, 2024-05-09T09:53:43.617 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.617 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.617 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.617 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.617 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.617 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 107 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295936+0000", 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.33e-06 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295944+0000", 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7270000000000007e-06 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295958+0000", 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4396000000000001e-05 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295967+0000", 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5189999999999992e-06 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301367+0000", 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054005399999999997 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301606+0000", 2024-05-09T09:53:43.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023853000000000001 2024-05-09T09:53:43.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301974+0000", 2024-05-09T09:53:43.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036834200000000002 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304354+0000", 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023801859999999998 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307278+0000", 2024-05-09T09:53:43.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029238129999999999 2024-05-09T09:53:43.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307420+0000", 2024-05-09T09:53:43.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014152199999999999 2024-05-09T09:53:43.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307546+0000", 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012603000000000001 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.625 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:43.626 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278628222999998, 2024-05-09T09:53:43.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011972679999999999, 2024-05-09T09:53:43.626 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.626 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.626 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.626 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.626 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.627 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.627 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 108 2024-05-09T09:53:43.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.627 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:43.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:43.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295998+0000", 2024-05-09T09:53:43.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.133e-06 2024-05-09T09:53:43.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296010+0000", 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1347e-05 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296029+0000", 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9082000000000001e-05 2024-05-09T09:53:43.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296042+0000", 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3077e-05 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303214+0000", 2024-05-09T09:53:43.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071718399999999996 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303367+0000", 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015363200000000001 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303586+0000", 2024-05-09T09:53:43.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021871400000000001 2024-05-09T09:53:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307666+0000", 2024-05-09T09:53:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040799879999999997 2024-05-09T09:53:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307707+0000", 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0371999999999999e-05 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307862+0000", 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155365 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307970+0000", 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010813 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278551231999998, 2024-05-09T09:53:43.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01220095, 2024-05-09T09:53:43.636 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.636 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.636 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.636 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.636 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.636 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 109 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:43.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296075+0000", 2024-05-09T09:53:43.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-09T09:53:43.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296226+0000", 2024-05-09T09:53:43.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150192 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296242+0000", 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-05 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296251+0000", 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9930000000000001e-06 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304458+0000", 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082062200000000002 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304592+0000", 2024-05-09T09:53:43.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134189 2024-05-09T09:53:43.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304850+0000", 2024-05-09T09:53:43.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000258049 2024-05-09T09:53:43.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307991+0000", 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031414289999999998 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308112+0000", 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121044 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308206+0000", 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3239999999999995e-05 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308275+0000", 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9680999999999999e-05 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.645 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.646 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.646 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.646 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:43.646 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278356135000003, 2024-05-09T09:53:43.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012485019, 2024-05-09T09:53:43.646 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 110 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296270+0000", 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7400000000000002e-07 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296276+0000", 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7259999999999999e-06 2024-05-09T09:53:43.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296286+0000", 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296294+0000", 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8830000000000006e-06 2024-05-09T09:53:43.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.305820+0000", 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095260510000000007 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306073+0000", 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025283199999999998 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306440+0000", 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036732600000000001 2024-05-09T09:53:43.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308450+0000", 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020098730000000001 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308488+0000", 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7953000000000001e-05 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308626+0000", 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013755899999999999 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308754+0000", 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012882900000000001 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.653 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278319666000002, 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017360891, 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 111 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296307+0000", 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6000000000000003e-07 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296312+0000", 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2270000000000001e-06 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296331+0000", 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9021999999999998e-05 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296338+0000", 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3499999999999999e-06 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308837+0000", 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012499212000000001 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308974+0000", 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013678200000000001 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309174+0000", 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019962100000000001 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313341+0000", 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041673029999999998 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313387+0000", 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6335000000000003e-05 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313545+0000", 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000157396 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313667+0000", 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121983 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278275397000002, 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017863329000000001, 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.659 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 112 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296351+0000", 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296450+0000", 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9403999999999999e-05 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296468+0000", 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7286e-05 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296477+0000", 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3160000000000003e-06 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309891+0000", 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013414188000000001 2024-05-09T09:53:43.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310132+0000", 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024091600000000001 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310523+0000", 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039117200000000001 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313774+0000", 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032510299999999998 2024-05-09T09:53:43.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313968+0000", 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019364800000000001 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314101+0000", 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013338900000000001 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314214+0000", 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011230000000000001 2024-05-09T09:53:43.664 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278132440999997, 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020963909999999999, 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.665 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 113 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296494+0000", 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7599999999999996e-07 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296499+0000", 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296509+0000", 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026e-05 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296517+0000", 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2760000000000003e-06 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.311889+0000", 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015371839999999999 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312137+0000", 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024836900000000002 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312559+0000", 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042197099999999999 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313929+0000", 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013705659999999999 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317187+0000", 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00325743 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317332+0000", 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014464499999999999 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317457+0000", 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:43.670 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278097195999997, 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:53:43.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:53:43.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:53:43.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:53:43.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:53:43.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.676 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.677 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.677 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:43.677 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.278063043000003, 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:53:43.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:53:43.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:53:43.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:53:43.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.277942520000003, 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.688 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.277906993999999, 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:43.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.073214714999999, 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011186751, 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.694 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 137 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.91e-07 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501474+0000", 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2438000000000001e-05 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501481+0000", 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1729999999999998e-06 2024-05-09T09:53:43.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501486+0000", 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8829999999999997e-06 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508163+0000", 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066771729999999998 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508216+0000", 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2713999999999997e-05 2024-05-09T09:53:43.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508313+0000", 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7361999999999994e-05 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510117+0000", 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018037859999999999 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512542+0000", 2024-05-09T09:53:43.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002425431 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512574+0000", 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1520000000000003e-05 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512598+0000", 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3980000000000001e-05 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.073128416000003, 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011159946, 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 138 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501498+0000", 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0800000000000004e-07 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501503+0000", 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9300000000000002e-06 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501510+0000", 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3409999999999997e-06 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501514+0000", 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6370000000000001e-06 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509072+0000", 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075585929999999997 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509131+0000", 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9033000000000002e-05 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509224+0000", 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2602999999999994e-05 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510147+0000", 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092332099999999995 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512604+0000", 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024564140000000001 2024-05-09T09:53:43.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512634+0000", 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9842e-05 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512657+0000", 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3524e-05 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.073102710999997, 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011196616, 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 139 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.63e-07 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501528+0000", 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7609999999999998e-06 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501538+0000", 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5140000000000007e-06 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501544+0000", 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5429999999999999e-06 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509598+0000", 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080541220000000004 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509654+0000", 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6190000000000002e-05 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509746+0000", 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1917999999999996e-05 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512143+0000", 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023969059999999999 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512663+0000", 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00051997499999999999 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512693+0000", 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0190000000000001e-05 2024-05-09T09:53:43.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512719+0000", 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6033999999999998e-05 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.073070725000001, 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011246727999999999, 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.711 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 140 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4600000000000005e-07 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501626+0000", 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0950000000000003e-05 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501637+0000", 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0166000000000001e-05 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501645+0000", 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0439999999999996e-06 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510173+0000", 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085285970000000006 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510227+0000", 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.393e-05 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510328+0000", 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101041 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512207+0000", 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001879241 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512741+0000", 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053346999999999997 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512775+0000", 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4119000000000003e-05 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512802+0000", 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6624000000000001e-05 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.716 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.072965916999998, 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011248421, 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 141 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.717 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501661+0000", 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6899999999999996e-07 2024-05-09T09:53:43.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501669+0000", 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2849999999999995e-06 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501678+0000", 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7839999999999992e-06 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501686+0000", 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6559999999999998e-06 2024-05-09T09:53:43.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511265+0000", 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095784100000000007 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511381+0000", 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116153 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511548+0000", 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000167178 2024-05-09T09:53:43.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512836+0000", 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012884509999999999 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512850+0000", 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3558e-05 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512882+0000", 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2175999999999998e-05 2024-05-09T09:53:43.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512908+0000", 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5901000000000002e-05 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:43.722 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:43.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:53:43.724 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:43.720+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:43.824 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:43.820+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:43.855 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:43.855 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:43.855 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:43.856 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:43.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:53:43.925 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:43.923+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:44.026 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:44.023+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:44.045 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:44.045 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:44.045 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:44.045 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:44.046 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:44.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:53:44.127 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:44.127+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:44.193 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 28.989451139, 2024-05-09T09:53:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:53:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:53:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:53:44.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.199 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.022441078, 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:53:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:53:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:53:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.992342594, 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:53:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.962690142, 2024-05-09T09:53:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:53:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.948119752, 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:53:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:53:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.919769393999999, 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:53:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:53:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:53:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:53:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.901045402000001, 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:53:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.864180323999999, 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:53:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:421 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.842526442, 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023115050000000002, 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 421 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347525+0000", 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6099999999999999e-07 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347530+0000", 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5390000000000001e-06 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347542+0000", 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2172e-05 2024-05-09T09:53:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347549+0000", 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.199e-06 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347600+0000", 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0612999999999998e-05 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347654+0000", 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3690000000000003e-05 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.347772+0000", 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118337 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.348435+0000", 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000662493 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349772+0000", 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013372029999999999 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349806+0000", 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4557999999999997e-05 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.349836+0000", 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9839999999999999e-05 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.798996975000001, 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:53:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:53:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.796144699999999, 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:53:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.793005516000001, 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:53:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.668099273999999, 2024-05-09T09:53:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:53:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:53:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:53:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:53:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:53:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.663090129, 2024-05-09T09:53:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:53:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:53:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.468457721, 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:53:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:53:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:53:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:53:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.464284026000001, 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:53:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.412396969, 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.407802759999999, 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.226507474000002, 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:44.311 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.222818724, 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.317 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.317 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.317 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:44.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:53:44.319 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:44.319+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:44.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:53:44.418 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:44.419+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:44.458 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:44.458 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:44.458 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:44.458 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:44.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:53:44.519 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:44.519+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:44.620 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:44.616+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:44.638 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:44.638 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:44.638 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:44.639 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:44.639 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:44.658 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:53:44.746 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:44.744+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:44.822 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:44.819+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:44.834 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:44.834 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:44.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:44.834 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:44.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.725007165000001, 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:53:44.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.543650325000002, 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:53:44.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.540318802000002, 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.845 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:53:44.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.648002828999999, 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:53:44.850 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:53:44.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:53:44.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.628048970999998, 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:53:44.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:53:44.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:53:44.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:53:44.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.603291731999999, 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.861 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:53:44.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:53:44.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:53:44.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.584932942999998, 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.866 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:44.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:53:44.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:44.871 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.5529811, 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.523030038999998, 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.877 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:44.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:53:44.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:53:44.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.882 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.465580931000002, 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:44.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:53:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:53:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.418750479, 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:53:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:53:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:53:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:53:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:53:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:53:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.351701577, 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:53:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:53:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.346122771000001, 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:53:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.125977884000001, 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:53:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:53:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:53:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:53:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:53:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:53:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:53:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:53:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.005854136, 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:53:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:53:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.842475899, 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:53:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:53:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.807396625999999, 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:53:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:53:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.803550011999999, 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:53:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.770277439000001, 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:53:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:53:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:53:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.735731274999999, 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:53:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:53:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:44.952 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:44.953 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:53:44.954 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:44.951+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:45.054 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:45.051+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:45.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:53:45.131 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:45.131 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:45.131 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:45.131 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:45.150 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:53:45.154 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:45.151+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:45.255 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:45.255+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:45.281 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:45.282 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:45.301 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:45.301 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:45.321 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:45.321 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:45.353 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:45.353 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:45.356 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:45.355+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:45.363 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:45.363 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:45.383 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:53:45.387 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:45.388 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:45.409 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:53:45.410 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:45.410 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:45.446 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:45.447 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:45.457 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:45.452+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:45.473 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:45.521 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:45.521 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:45.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:53:45.558 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:45.555+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:45.659 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:45.656+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:45.708 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:45.708 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:45.723 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:53:45.760 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:45.759+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:45.860 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:45.856+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:45.887 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:45.888 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:45.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:53:45.962 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:45.959+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:46.062 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:46.063+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:46.079 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:46.080 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:46.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:53:46.163 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:46.160+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:46.227 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:46.227 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:46.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:53:46.265 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:46.260+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:46.365 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:46.366 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:46.366 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:46.363+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:46.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:53:46.467 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:46.467+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:46.547 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:46.547 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:46.561 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:53:46.603 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:46.603+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:46.670 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:46.668+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:46.726 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:46.727 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:46.740 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:53:46.787 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:46.787+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:46.862 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:46.863 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:46.873 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:46.871+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:46.877 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:53:46.973 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:46.968+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:47.040 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:47.041 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:47.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:53:47.099 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:47.099+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:47.175 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:47.172+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:47.177 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:47.178 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:47.191 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:53:47.279 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:47.279+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:47.358 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:47.359 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:47.373 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:53:47.415 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:47.415+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:47.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:53:47.476 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:47.475+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:47.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:53:47.541 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:47.542 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:47.556 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:53:47.599 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:47.599+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:47.678 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:47.679+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:47.681 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:47.681 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:47.699 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:47.699 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:47.716 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:47.723 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:47.723 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:47.737 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:47.737 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:47.738 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:53:47.754 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:47.755 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:47.778 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:47.778 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:47.779 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:47.776+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:47.795 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:47.796 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:47.814 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:47.815 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:47.880 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:47.876+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:47.902 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:47.902 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:53:47.902 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:53:47.902 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:53:47.902 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:47.916 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:53:47.981 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:47.976+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:48.043 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:53:48.043 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.932517185000002, 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01177042, 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 34 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108398+0000", 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1999999999999999e-07 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108403+0000", 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0270000000000003e-06 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108413+0000", 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108420+0000", 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3459999999999996e-06 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115125+0000", 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067043570000000002 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115354+0000", 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022952399999999999 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.115725+0000", 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000371085 2024-05-09T09:53:48.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118381+0000", 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026558110000000001 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120045+0000", 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016640069999999999 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120112+0000", 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6544999999999994e-05 2024-05-09T09:53:48.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120168+0000", 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6354999999999998e-05 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.932482829000001, 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011861454, 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 35 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108432+0000", 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108433+0000", 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108520+0000", 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7187000000000004e-05 2024-05-09T09:53:48.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108532+0000", 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1826e-05 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108540+0000", 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.977e-06 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116666+0000", 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0081267839999999997 2024-05-09T09:53:48.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.116854+0000", 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000187858 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.117057+0000", 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000203298 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120017+0000", 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002959925 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120181+0000", 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000163688 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120242+0000", 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0952000000000002e-05 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120293+0000", 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1341999999999997e-05 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.932361499000002, 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014433260999999999, 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 36 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108553+0000", 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108554+0000", 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8000000000000005e-07 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108560+0000", 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7100000000000004e-06 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108570+0000", 2024-05-09T09:53:48.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9320000000000008e-06 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108577+0000", 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4970000000000004e-06 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.118920+0000", 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010342374999999999 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119063+0000", 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000143549 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.119275+0000", 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021153799999999999 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121299+0000", 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00202388 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122657+0000", 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001358646 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122809+0000", 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000152232 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.122987+0000", 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017712199999999999 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.932326066999998, 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014725665000000001, 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 37 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108589+0000", 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108595+0000", 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5029999999999997e-06 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108605+0000", 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6760000000000002e-06 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.108613+0000", 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0399999999999993e-06 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120347+0000", 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011734751 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120510+0000", 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016299500000000001 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.120747+0000", 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023618599999999999 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.121801+0000", 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001054073 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123074+0000", 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012731820000000001 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123210+0000", 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013588599999999999 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.123314+0000", 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104693 2024-05-09T09:53:48.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744980124999998, 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011610934999999999, 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 107 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295935+0000", 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295936+0000", 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.33e-06 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295944+0000", 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7270000000000007e-06 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295958+0000", 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4396000000000001e-05 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295967+0000", 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5189999999999992e-06 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301367+0000", 2024-05-09T09:53:48.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054005399999999997 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301606+0000", 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023853000000000001 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.301974+0000", 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036834200000000002 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304354+0000", 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023801859999999998 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307278+0000", 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029238129999999999 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307420+0000", 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014152199999999999 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307546+0000", 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012603000000000001 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:48.074 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744917389999998, 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011972679999999999, 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 108 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295997+0000", 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.295998+0000", 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.133e-06 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296010+0000", 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1347e-05 2024-05-09T09:53:48.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296029+0000", 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9082000000000001e-05 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296042+0000", 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3077e-05 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303214+0000", 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071718399999999996 2024-05-09T09:53:48.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303367+0000", 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015363200000000001 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.303586+0000", 2024-05-09T09:53:48.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021871400000000001 2024-05-09T09:53:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307666+0000", 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040799879999999997 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307707+0000", 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0371999999999999e-05 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307862+0000", 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000155365 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307970+0000", 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010813 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744840398999997, 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01220095, 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.081 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 109 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296074+0000", 2024-05-09T09:53:48.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296075+0000", 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1429999999999999e-06 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296226+0000", 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150192 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296242+0000", 2024-05-09T09:53:48.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-05 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296251+0000", 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9930000000000001e-06 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304458+0000", 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082062200000000002 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304592+0000", 2024-05-09T09:53:48.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134189 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.304850+0000", 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000258049 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.307991+0000", 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031414289999999998 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308112+0000", 2024-05-09T09:53:48.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121044 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308206+0000", 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3239999999999995e-05 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308275+0000", 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9680999999999999e-05 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744645302000002, 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012485019, 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 110 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296269+0000", 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296270+0000", 2024-05-09T09:53:48.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7400000000000002e-07 2024-05-09T09:53:48.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296276+0000", 2024-05-09T09:53:48.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7259999999999999e-06 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296286+0000", 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0113e-05 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296294+0000", 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8830000000000006e-06 2024-05-09T09:53:48.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.305820+0000", 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095260510000000007 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306073+0000", 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025283199999999998 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.306440+0000", 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036732600000000001 2024-05-09T09:53:48.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308450+0000", 2024-05-09T09:53:48.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020098730000000001 2024-05-09T09:53:48.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308488+0000", 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7953000000000001e-05 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308626+0000", 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013755899999999999 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308754+0000", 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012882900000000001 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.093 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744608833000001, 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017360891, 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 111 2024-05-09T09:53:48.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296306+0000", 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296307+0000", 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6000000000000003e-07 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296312+0000", 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2270000000000001e-06 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296331+0000", 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9021999999999998e-05 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296338+0000", 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3499999999999999e-06 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308837+0000", 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012499212000000001 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.308974+0000", 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013678200000000001 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309174+0000", 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019962100000000001 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313341+0000", 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041673029999999998 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313387+0000", 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6335000000000003e-05 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313545+0000", 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000157396 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313667+0000", 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121983 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744564564000001, 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017863329000000001, 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 112 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296350+0000", 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296351+0000", 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7999999999999995e-07 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296450+0000", 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9403999999999999e-05 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296468+0000", 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7286e-05 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296477+0000", 2024-05-09T09:53:48.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3160000000000003e-06 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.309891+0000", 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013414188000000001 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310132+0000", 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024091600000000001 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.310523+0000", 2024-05-09T09:53:48.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039117200000000001 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313774+0000", 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032510299999999998 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313968+0000", 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019364800000000001 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314101+0000", 2024-05-09T09:53:48.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013338900000000001 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314214+0000", 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011230000000000001 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744421608000003, 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020963909999999999, 2024-05-09T09:53:48.105 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.106 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.106 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.106 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.106 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 113 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296494+0000", 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7599999999999996e-07 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296499+0000", 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296509+0000", 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026e-05 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296517+0000", 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2760000000000003e-06 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.311889+0000", 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015371839999999999 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312137+0000", 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024836900000000002 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312559+0000", 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042197099999999999 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313929+0000", 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013705659999999999 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317187+0000", 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00325743 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317332+0000", 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014464499999999999 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317457+0000", 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744386362999997, 2024-05-09T09:53:48.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:53:48.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:53:48.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744352210000002, 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.117 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:53:48.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:53:48.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:53:48.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744231687000003, 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.123 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:53:48.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.744196160999998, 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.129 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.539503881999998, 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011186751, 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 137 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501411+0000", 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.91e-07 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501474+0000", 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2438000000000001e-05 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501481+0000", 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1729999999999998e-06 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501486+0000", 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8829999999999997e-06 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508163+0000", 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066771729999999998 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508216+0000", 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2713999999999997e-05 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.508313+0000", 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7361999999999994e-05 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510117+0000", 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018037859999999999 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512542+0000", 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002425431 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512574+0000", 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1520000000000003e-05 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512598+0000", 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3980000000000001e-05 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.539417583000002, 2024-05-09T09:53:48.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011159946, 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 138 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501497+0000", 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501498+0000", 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0800000000000004e-07 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501503+0000", 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9300000000000002e-06 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501510+0000", 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3409999999999997e-06 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501514+0000", 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6370000000000001e-06 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509072+0000", 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0075585929999999997 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509131+0000", 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9033000000000002e-05 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509224+0000", 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2602999999999994e-05 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510147+0000", 2024-05-09T09:53:48.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092332099999999995 2024-05-09T09:53:48.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512604+0000", 2024-05-09T09:53:48.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0024564140000000001 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512634+0000", 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9842e-05 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512657+0000", 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3524e-05 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.146 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.539391878000004, 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011196616, 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.147 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 139 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501523+0000", 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.63e-07 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501528+0000", 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7609999999999998e-06 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501538+0000", 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5140000000000007e-06 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501544+0000", 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5429999999999999e-06 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509598+0000", 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0080541220000000004 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509654+0000", 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6190000000000002e-05 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.509746+0000", 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1917999999999996e-05 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512143+0000", 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023969059999999999 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512663+0000", 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00051997499999999999 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512693+0000", 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0190000000000001e-05 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512719+0000", 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6033999999999998e-05 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.152 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.539359892, 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011246727999999999, 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.153 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 140 2024-05-09T09:53:48.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.154 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:48.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501555+0000", 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4600000000000005e-07 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501626+0000", 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0950000000000003e-05 2024-05-09T09:53:48.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501637+0000", 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0166000000000001e-05 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501645+0000", 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0439999999999996e-06 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510173+0000", 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085285970000000006 2024-05-09T09:53:48.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510227+0000", 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.393e-05 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.510328+0000", 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101041 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512207+0000", 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001879241 2024-05-09T09:53:48.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512741+0000", 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053346999999999997 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512775+0000", 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4119000000000003e-05 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512802+0000", 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6624000000000001e-05 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.158 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 46.539255083999997, 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011248421, 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:53:48.159 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 141 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501660+0000", 2024-05-09T09:53:48.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501661+0000", 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6899999999999996e-07 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501669+0000", 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2849999999999995e-06 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:53:48.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501678+0000", 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7839999999999992e-06 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.501686+0000", 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6559999999999998e-06 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511265+0000", 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095784100000000007 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:53:48.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511381+0000", 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116153 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.511548+0000", 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000167178 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512836+0000", 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012884509999999999 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:53:48.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512850+0000", 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3558e-05 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512882+0000", 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2175999999999998e-05 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.512908+0000", 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5901000000000002e-05 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:53:48.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:53:48.165 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:53:48.167 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:48.163+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:48.168 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:53:48.267 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:48.267+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:48.312 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:48.312 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:48.312 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:48.312 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:48.327 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:53:48.369 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:48.367+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:48.416 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:53:48.454 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:48.454 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:48.454 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:48.454 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:48.455 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:48.469 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:48.467+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:48.471 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:53:48.570 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:48.564+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:48.649 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:48.649 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:48.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:48.649 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:48.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.4461941, 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:53:48.655 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.479184039, 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:48.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:53:48.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:53:48.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:53:48.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.449085555, 2024-05-09T09:53:48.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:53:48.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.419433102999999, 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.667 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:48.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:53:48.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:53:48.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:53:48.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.672 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.404862713, 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:48.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.679 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.376512354999999, 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:48.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:53:48.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:53:48.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:53:48.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:53:48.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.357788363000001, 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.685 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:53:48.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.320923284999999, 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.696 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.255739936000001, 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:48.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:48.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:53:48.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:53:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:53:48.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.252887660999999, 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.249748477000001, 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:53:48.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.713 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.124842234999999, 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.11983309, 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:48.724 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.925200682, 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:53:48.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:53:48.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.921026987000001, 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:53:48.730 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.869139929999999, 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:53:48.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.741 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.864545720999999, 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:53:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:53:48.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:53:48.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.683250435000001, 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:53:48.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.679561684999999, 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:53:48.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:53:48.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:53:48.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:53:48.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:53:48.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1021 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.34737148899999998, 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032568440000000001, 2024-05-09T09:53:48.759 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1021 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:48.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299425+0000", 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9560000000000002e-06 2024-05-09T09:53:48.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299441+0000", 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.539e-05 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299477+0000", 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5735999999999998e-05 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299494+0000", 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7195999999999999e-05 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299653+0000", 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015902900000000001 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299889+0000", 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023567799999999999 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.300250+0000", 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000361527 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.301419+0000", 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011689370000000001 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302515+0000", 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001096138 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302607+0000", 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2329000000000003e-05 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302679+0000", 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1928000000000007e-05 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:48.765 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:48.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:53:48.767 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:48.767+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:48.868 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:48.864+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:48.943 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:48.943 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:48.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:53:48.998 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:48.996+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:49.069 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:49.064+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:49.111 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:49.111 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:49.111 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:49.111 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:49.111 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:49.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:53:49.170 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:49.167+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:49.271 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:49.271+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.215427448, 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.326 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:49.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:53:49.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.331 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.034070608, 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:53:49.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:53:49.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:53:49.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.030739085, 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.337 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.138423112000002, 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:53:49.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.118469254000001, 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.349 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:53:49.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:53:49.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.354 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.093712015000001, 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:53:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:53:49.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:53:49.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.075353226000001, 2024-05-09T09:53:49.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:53:49.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:53:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.043401382999999, 2024-05-09T09:53:49.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:53:49.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.013450322000001, 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:53:49.372 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:49.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.956001214, 2024-05-09T09:53:49.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.909170761999999, 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.384 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:49.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:53:49.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:53:49.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:53:49.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:53:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.842121859999999, 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:53:49.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:53:49.395 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.836543054, 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.396 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:53:49.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:53:49.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:53:49.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:53:49.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.616398167, 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:53:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:53:49.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.496274418999999, 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.332896181999999, 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.297816909000002, 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:53:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:53:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:53:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.293970295000001, 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.260697722, 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.226151558000002, 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:49.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:53:49.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:53:49.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:53:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:53:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:53:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.443 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.443 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:49.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:53:49.445 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:49.443+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:49.545 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:49.547+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:49.615 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:49.615 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:49.615 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:49.615 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:49.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:53:49.647 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:49.647+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:49.745 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:49.745 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:49.746 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:49.746 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:49.746 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:49.747 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:49.747+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:49.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:53:49.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:53:49.849 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:49.847+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:49.894 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.714706921000001, 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:49.895 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:49.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:53:49.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:53:49.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.901 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.700190462999998, 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.599487127, 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.908 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:49.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:53:49.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.587629712999998, 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.915 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.916 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:53:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:49.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.234440125999999, 2024-05-09T09:53:49.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:53:49.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:53:49.927 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.230508628999999, 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.928 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.933 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.100346420000001, 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.934 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:49.939 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.096396827, 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.042172677, 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:53:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:53:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.038540559000001, 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:53:49.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:53:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:53:49.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:53:49.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:53:49.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.028045192, 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:53:49.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.024212184, 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.977350631, 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.969 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:49.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:53:49.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:53:49.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:53:49.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:53:49.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.975 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.973663816999998, 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:53:49.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:53:49.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:53:49.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:53:49.980 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.887013712000002, 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.981 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:53:49.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.982 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:49.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.986 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.883156077999999, 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.987 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:49.993 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.787871137, 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:49.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:53:49.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:53:49.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:53:49.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:53:49.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.783430490000001, 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:49.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:53:50.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:50.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.772990415999999, 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:50.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:53:50.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:53:50.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.010 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.769035207000002, 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:50.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:53:50.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:53:50.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:50.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:50.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:50.016 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:50.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:53:50.018 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:50.018 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:50.019 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:50.019 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:50.020 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:50.015+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:50.039 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:50.040 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:50.072 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:50.072 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:50.106 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:50.107 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:50.118 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:50.115+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:50.142 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:50.143 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:50.176 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:50.177 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:50.182 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:50.182 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:50.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:53:50.208 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:50.209 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:50.228 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:50.224+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:50.320 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:50.319+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:50.326 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:50.326 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:50.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:53:50.421 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:50.419+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:50.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:53:50.507 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:50.507 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:50.522 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:50.523+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:50.525 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:53:50.624 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:50.623+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:50.656 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:50.657 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:50.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:53:50.724 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:50.720+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:50.825 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:50.820+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:50.833 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:50.834 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:50.849 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:53:50.926 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:50.924+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:50.973 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:50.973 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:50.987 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:53:51.035 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:51.035+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:51.112 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:51.112 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:51.127 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:53:51.171 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:51.171+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:51.229 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:51.227+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:51.298 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:51.298 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:51.312 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:53:51.355 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:51.355+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:51.430 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:51.426+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:51.433 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:53:51.481 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:51.481 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:51.496 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:53:51.539 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:51.538+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:51.632 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:51.630+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:51.663 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:51.663 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:51.678 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:53:51.733 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:51.728+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:51.834 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:51.828+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:51.843 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:51.843 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:51.857 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:53:51.935 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:51.934+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:51.982 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:51.982 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:51.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:53:52.036 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:52.032+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:52.138 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:52.132+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:52.161 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:52.162 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:52.176 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:53:52.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:53:52.238 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:52.234+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:52.298 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:52.299 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:52.313 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:53:52.355 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:52.354+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:52.427 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:52.427 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:52.439 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:52.436+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:52.458 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:52.458 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:52.477 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:52.477 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:52.488 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:52.488 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:52.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:53:52.518 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:52.519 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:52.540 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:52.538+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:52.550 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:52.550 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:52.583 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:52.584 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:52.616 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:52.617 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:52.641 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:52.638+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:52.650 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:52.650 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:52.661 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:52.662 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:52.662 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:52.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:53:52.770 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:52.768+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:52.843 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:52.840+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:52.844 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:52.844 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:52.845 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:52.845 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:52.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:53:52.944 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:52.942+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:53.020 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:53.020 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:53.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:53.020 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:53.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.020 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:53.020 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:53.020 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.818169155, 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:53.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:53:53.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:53:53.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:53:53.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:53:53.025 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.851159094000003, 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.026 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:53.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.821060610000004, 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:53:53.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:53:53.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:53:53.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:53:53.037 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.791408158000003, 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.038 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:53:53.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:53:53.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.776837768, 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.044 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:53:53.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:53:53.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:53:53.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.748487410000003, 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:53:53.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:53:53.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:53:53.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:53:53.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:53:53.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.729763417999997, 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:53:53.055 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:53:53.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.692898339999999, 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:53:53.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.627714990999998, 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:53.071 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.624862716000003, 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:53:53.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:53:53.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.076 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.621723531999997, 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:53:53.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:53:53.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:53:53.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:53:53.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.496817290000003, 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.082 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:53:53.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:53:53.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:53:53.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.491808145, 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:53:53.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:53:53.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.297175737000003, 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.093 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:53:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:53:53.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:53:53.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.293002041999998, 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.100 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:53:53.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:53:53.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:53:53.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.105 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.241114985000003, 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:53:53.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:53:53.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:53:53.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:53:53.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.236520775999999, 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:53:53.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:53:53.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:53:53.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:53:53.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:53:53.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.055225489999998, 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.116 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:53:53.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.051536740000003, 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.122 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:53:53.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.127 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1021 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.7193465440000004, 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032568440000000001, 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1021 2024-05-09T09:53:53.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299425+0000", 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9560000000000002e-06 2024-05-09T09:53:53.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299441+0000", 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.539e-05 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299477+0000", 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5735999999999998e-05 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299494+0000", 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7195999999999999e-05 2024-05-09T09:53:53.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299653+0000", 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015902900000000001 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299889+0000", 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023567799999999999 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.300250+0000", 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000361527 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.301419+0000", 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011689370000000001 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302515+0000", 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001096138 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302607+0000", 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2329000000000003e-05 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302679+0000", 2024-05-09T09:53:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1928000000000007e-05 2024-05-09T09:53:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.133 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.133 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:53.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:53:53.135 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:53.132+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:53.236 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:53.232+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:53.337 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:53.332+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:53.337 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:53.338 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:53.338 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:53.338 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:53.351 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:53:53.442 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:53.440+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:53.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:53:53.519 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:53.519 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:53.519 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:53.519 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:53.519 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:53.533 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:53:53.582 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:53.580+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:53.640 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:53.636+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:53.651 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 42.542440485, 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:53:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:53:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:53:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.361083645000001, 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:53:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.357752122000001, 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:53:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.465436148999999, 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.445482290999998, 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:53:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:53:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:53:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:53:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.420725052000002, 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.402366262999998, 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:53:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:53:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:53:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:53:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.370414420000003, 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.340463358999997, 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:53:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:53:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:53:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:53:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.283014250999997, 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:53:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.236183799000003, 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.169134896999999, 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:53:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:53:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.163556090999997, 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.943411204, 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:53:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:53:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:53:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.823287456000003, 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.659909218999999, 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.624829945999998, 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.620983332000002, 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:53:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:53:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:53:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.587710758999997, 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:53:53.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:53:53.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:53:53.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.553164594999998, 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:53.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:53.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:53.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:53:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:53:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:53.764 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:53.764 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:53.765 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:53:53.766 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:53.760+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:53.866 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:53.860+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:53.966 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:53.964+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:53.977 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:53.977 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:53.977 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:53.977 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:53.995 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:53:54.082 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:54.080+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:54.168 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:54.164+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:54.207 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:54.208 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:54.208 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:54.208 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:54.208 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:54.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:53:54.274 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:54.272+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:54.371 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:54.366+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:54.447 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:54.447 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:54.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:54.447 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:54.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.267978319999997, 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.448 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:53:54.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:53:54.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:53:54.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:53:54.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:53:54.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.453 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.253461862000002, 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.454 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:54.459 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.152758526, 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:53:54.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:53:54.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.140901112000002, 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.466 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.466 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.466 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:53:54.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.466 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:54.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:53:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:53:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:53:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.787711524999999, 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:53:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.783780028000002, 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:53:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:53:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:53:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:53:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:53:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.653617818999997, 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:53:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:53:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:53:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:53:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.649668226000003, 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:53:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.595444076, 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:53:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:53:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:53:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:53:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.591811958000001, 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.506 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.581316590999997, 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:53:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:53:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:53:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.577483583000003, 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:53:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:53:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:53:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:53:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.530622030000004, 2024-05-09T09:53:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:53:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.526935215999998, 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:53:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:53:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.440285111000001, 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.436427477000002, 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:53:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:53:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.341142536, 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:53:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:53:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.336701888999997, 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:53:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:53:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:53:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:53:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:53:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:53:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:53:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.326261815000002, 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:53:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:53:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:53:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:53:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.322306605999998, 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:53:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:54.573 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:54.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:53:54.619 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:54.616+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:54.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:53:54.675 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:54.672+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:54.776 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:54.772+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:54.789 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:54.789 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:54.789 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:54.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:53:54.875 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:54.875 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:54.878 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:54.874+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:54.906 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:54.907 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:54.938 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:54.938 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:54.968 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:54.968 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:54.979 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:54.976+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:55.001 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:55.002 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:55.020 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:55.021 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:55.035 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:55.035 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:55.039 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:53:55.068 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:55.069 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:55.080 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:55.078+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:55.102 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:55.102 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:55.181 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:55.178+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:55.242 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:55.242 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:55.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:53:55.303 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:55.302+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:55.383 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:55.382+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:55.390 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:55.390 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:55.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:53:55.483 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:55.480+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:55.570 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:55.571 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:55.584 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:55.582+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:55.585 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:53:55.685 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:55.682+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:55.745 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:55.746 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:55.760 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:53:55.803 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:55.802+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:55.887 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:55.884+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:55.925 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:55.926 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:55.940 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:53:55.988 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:55.986+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:56.063 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:56.063 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:56.077 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:53:56.119 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:56.118+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:56.191 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:56.190+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:56.239 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:56.239 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:56.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:53:56.295 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:56.294+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:56.393 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:56.390+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:56.419 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:56.419 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:56.433 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:53:56.519 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:56.518+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:56.575 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:53:56.598 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:56.598 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:56.612 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:53:56.622 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:53:56.620+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:53:56.699 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:56.698+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:56.780 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:56.781 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:56.794 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:53:56.796 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:56.792+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:56.897 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:56.892+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:56.963 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:56.963 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:56.980 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:53:56.997 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:56.992+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:57.098 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:57.096+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:57.103 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:57.118 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:53:57.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:53:57.151 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:53:57.222 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:57.220+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:57.246 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:57.246 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:57.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:53:57.300 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:57.298+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:57.343 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:57.344 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:57.368 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:57.368 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:57.400 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:57.400 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:57.401 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:57.396+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:57.409 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:57.409 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:57.409 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:57.409 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:57.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:53:57.429 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:57.430 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:57.463 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:57.463 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:57.497 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:57.497 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:57.502 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:57.500+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:57.530 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:57.530 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:57.540 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:57.540 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:57.540 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:57.540 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:57.540 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:57.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:53:57.563 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:57.563 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:57.630 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:57.628+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:57.676 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:57.676 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:57.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:57.676 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:57.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.676 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:57.676 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 42.475150225999997, 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:53:57.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:53:57.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:53:57.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.508140165, 2024-05-09T09:53:57.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.478041681000001, 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.688 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:53:57.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:53:57.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:53:57.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:53:57.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.448389229, 2024-05-09T09:53:57.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:53:57.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:53:57.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.433818838999997, 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.699 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:53:57.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.405468481, 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:53:57.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:53:57.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.710 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.386744489000002, 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:57.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:53:57.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.349879411000003, 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:53:57.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.284696062000002, 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.722 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.281843787, 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.727 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.278704603000001, 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:53:57.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:53:57.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:53:57.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:53:57.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.153798361, 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:53:57.738 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:53:57.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:53:57.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.148789215999997, 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:53:57.744 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.954156808, 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.750 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.949983113000002, 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.756 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:53:57.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.898096056, 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:53:57.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:53:57.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:53:57.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.893501847000003, 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:53:57.767 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:53:57.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.772 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.712206561000002, 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:53:57.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:53:57.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:57.778 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.708517811, 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:53:57.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:53:57.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1021 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.3763276149999992, 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032568440000000001, 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1021 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299425+0000", 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9560000000000002e-06 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299441+0000", 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.539e-05 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299477+0000", 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5735999999999998e-05 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299494+0000", 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7195999999999999e-05 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299653+0000", 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015902900000000001 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299889+0000", 2024-05-09T09:53:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023567799999999999 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.300250+0000", 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000361527 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.301419+0000", 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011689370000000001 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302515+0000", 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001096138 2024-05-09T09:53:57.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302607+0000", 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2329000000000003e-05 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302679+0000", 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1928000000000007e-05 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:57.789 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:57.790 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-09T09:53:57.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-09T09:53:57.791 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:57.790+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:57.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:53:57.891 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:57.888+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:57.992 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:57.990+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:58.006 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:58.006 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:58.006 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:58.006 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:58.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:53:58.110 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:58.108+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:58.194 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:58.190+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:58.237 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:58.237 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:58.237 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:58.237 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:58.237 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:58.255 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:53:58.302 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:58.300+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:58.396 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:53:58.394+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:53:58.413 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:58.413 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.303393907, 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:58.414 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:53:58.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.122037067000001, 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.419 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:53:58.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:53:58.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:53:58.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:53:58.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:53:58.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:53:58.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:53:58.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.118705544000001, 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:53:58.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.430 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.226389570999999, 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:53:58.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:58.436 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.206435712999998, 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:53:58.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:53:58.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:53:58.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.181678474000002, 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:53:58.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:53:58.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.163319684999998, 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.131367842000003, 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.453 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.458 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.101416780999998, 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.459 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:58.464 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.043967672999997, 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.997137221000003, 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.470 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.475 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.930088318999999, 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.476 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:53:58.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:53:58.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:53:58.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.924509512999997, 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:53:58.481 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:53:58.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:53:58.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:53:58.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.704364626, 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.487 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:53:58.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:53:58.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.492 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.584240878000003, 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:58.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.420862640999999, 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.498 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:53:58.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.385783367999998, 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:53:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.381936754000002, 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:53:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:53:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.348664180999997, 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:53:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:53:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:53:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:53:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.314118016999998, 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.526 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:58.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:53:58.528 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:58.524+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:58.628 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:58.626+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:58.683 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:58.683 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:58.684 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:58.684 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:58.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:53:58.729 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:58.730+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:58.806 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:58.806 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:58.806 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:58.806 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:58.806 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:58.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:53:58.866 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:58.864+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:58.931 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:58.928+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.755770222000002, 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.934 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:53:58.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.741253764, 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:53:58.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.640550427999997, 2024-05-09T09:53:58.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:53:58.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:53:58.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:53:58.950 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.628693014, 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:53:58.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:53:58.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:53:58.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.956 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.275503426999997, 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:58.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:53:58.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:53:58.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.27157193, 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:53:58.962 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.141409721000002, 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.137460128000001, 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.973 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:53:58.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.978 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.083235977999998, 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:53:58.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.079603859999999, 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.984 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:53:58.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.069108493000002, 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.990 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.065275485000001, 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:58.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:58.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:58.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:58.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.000 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.018413932000001, 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:59.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.014727118000003, 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:53:59.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:53:59.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:53:59.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.928077012999999, 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:53:59.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:53:59.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:53:59.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.924219379, 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:53:59.017 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:53:59.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.022 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.828934437999997, 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:53:59.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.028 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.824493791000002, 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.814053717, 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.034 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:53:59.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:53:59.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:53:59.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.810098508000003, 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.045 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:59.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:53:59.047 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:59.046+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:59.147 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:53:59.146+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:53:59.170 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.0 to 1 (10000) 2024-05-09T09:53:59.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:53:59.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-09T09:53:59.264 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:59.265 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:59.265 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:53:59.265 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:59.265 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:53:59.260+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:53:59.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:53:59.349 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:59.346+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:59.450 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:53:59.448+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:53:59.472 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:59.472 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:53:59.472 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:53:59.472 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:53:59.472 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:59.489 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:53:59.551 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:53:59.550+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:53:59.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:53:59.652 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:59.648+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:59.683 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:53:59.683 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:53:59.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:53:59.683 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.509581271999998, 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:53:59.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:59.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:53:59.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:53:59.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.460769161000002, 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556879999999999, 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.692 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220488+0000", 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.596e-06 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220504+0000", 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5753e-05 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220541+0000", 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999999e-05 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220559+0000", 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7465999999999998e-05 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220704+0000", 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144754 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220947+0000", 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243386 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.221368+0000", 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420963 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.222994+0000", 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016260949999999999 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223686+0000", 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069151800000000002 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223771+0000", 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5822000000000006e-05 2024-05-09T09:53:59.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223840+0000", 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8734999999999998e-05 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.421569032999997, 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032488740000000001, 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 227 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259687+0000", 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259699+0000", 2024-05-09T09:53:59.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2199e-05 2024-05-09T09:53:59.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259731+0000", 2024-05-09T09:53:59.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2060000000000001e-05 2024-05-09T09:53:59.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259747+0000", 2024-05-09T09:53:59.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5832999999999999e-05 2024-05-09T09:53:59.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259923+0000", 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017627699999999999 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260168+0000", 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024482200000000001 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260592+0000", 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042451899999999999 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262409+0000", 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018164889999999999 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262778+0000", 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036952099999999999 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262863+0000", 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5121e-05 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262933+0000", 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9913000000000006e-05 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.707 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.414478561000003, 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032339780000000002, 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.708 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 229 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266777+0000", 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1900000000000002e-06 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266789+0000", 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1365999999999999e-05 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266820+0000", 2024-05-09T09:53:59.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1053000000000002e-05 2024-05-09T09:53:59.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266838+0000", 2024-05-09T09:53:59.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7963000000000001e-05 2024-05-09T09:53:59.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266959+0000", 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121691 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267173+0000", 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021379999999999999 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267579+0000", 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040555300000000001 2024-05-09T09:53:59.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269040+0000", 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014609549999999999 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269859+0000", 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081965300000000005 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269946+0000", 2024-05-09T09:53:59.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6488000000000003e-05 2024-05-09T09:53:59.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270009+0000", 2024-05-09T09:53:59.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3266e-05 2024-05-09T09:53:59.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.714 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.407521359999997, 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003225641, 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.715 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273734+0000", 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273747+0000", 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2363e-05 2024-05-09T09:53:59.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273777+0000", 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273792+0000", 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5157000000000001e-05 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273906+0000", 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011372800000000001 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274111+0000", 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000205556 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:59.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274578+0000", 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046704899999999998 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276012+0000", 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001433805 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276811+0000", 2024-05-09T09:53:59.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079894299999999998 2024-05-09T09:53:59.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276891+0000", 2024-05-09T09:53:59.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9948000000000001e-05 2024-05-09T09:53:59.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276958+0000", 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6872999999999995e-05 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:438 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.322038771999999, 2024-05-09T09:53:59.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044008270000000004, 2024-05-09T09:53:59.723 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.723 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.723 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.723 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.723 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:53:59.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359216+0000", 2024-05-09T09:53:59.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0389999999999999e-06 2024-05-09T09:53:59.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359224+0000", 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1999999999999994e-06 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359237+0000", 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2826999999999999e-05 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359243+0000", 2024-05-09T09:53:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0129999999999999e-06 2024-05-09T09:53:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359298+0000", 2024-05-09T09:53:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5041999999999999e-05 2024-05-09T09:53:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359388+0000", 2024-05-09T09:53:59.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0174999999999996e-05 2024-05-09T09:53:59.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359523+0000", 2024-05-09T09:53:59.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135122 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.360060+0000", 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053657399999999995 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363514+0000", 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003454146 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363574+0000", 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.982e-05 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363616+0000", 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1869000000000002e-05 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:443 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.317097609999998, 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041654989999999996, 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 443 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364157+0000", 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2299999999999999e-07 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364163+0000", 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9059999999999999e-06 2024-05-09T09:53:59.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364177+0000", 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3890000000000001e-05 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364183+0000", 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8210000000000004e-06 2024-05-09T09:53:59.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364250+0000", 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6965999999999995e-05 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364341+0000", 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0847999999999995e-05 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364524+0000", 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182778 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.365027+0000", 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050315500000000003 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368257+0000", 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293809999999999 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368293+0000", 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6612000000000001e-05 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368321+0000", 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8218999999999999e-05 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:476 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.297219577, 2024-05-09T09:53:59.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030779259999999999, 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 476 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384035+0000", 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.046e-06 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384041+0000", 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6899999999999997e-06 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384055+0000", 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4457999999999999e-05 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384062+0000", 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3709999999999996e-06 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384143+0000", 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1678e-05 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384199+0000", 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5940999999999999e-05 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384322+0000", 2024-05-09T09:53:59.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122617 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384970+0000", 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064774299999999999 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387007+0000", 2024-05-09T09:53:59.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020371009999999999 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387067+0000", 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0234e-05 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387112+0000", 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5046999999999997e-05 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.074711946999997, 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003541209, 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.746 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 736 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606544+0000", 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606556+0000", 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.185e-05 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606586+0000", 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606602+0000", 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606759+0000", 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157594 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607123+0000", 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036346000000000002 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607703+0000", 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057985000000000003 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609215+0000", 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512071 2024-05-09T09:53:59.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609797+0000", 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058224999999999998 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609969+0000", 2024-05-09T09:53:59.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171767 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.610083+0000", 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114221 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.752 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.070194688000001, 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029874860000000001, 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 738 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611061+0000", 2024-05-09T09:53:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1739999999999999e-06 2024-05-09T09:53:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611073+0000", 2024-05-09T09:53:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1619e-05 2024-05-09T09:53:59.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611099+0000", 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6103000000000001e-05 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611112+0000", 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611252+0000", 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014065799999999999 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611494+0000", 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000241769 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611980+0000", 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000486331 2024-05-09T09:53:59.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613227+0000", 2024-05-09T09:53:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012462529999999999 2024-05-09T09:53:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613772+0000", 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054489600000000001 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613927+0000", 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000155668 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.614046+0000", 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119065 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.759 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.993515414999997, 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003024648, 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.760 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 772 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687740+0000", 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687753+0000", 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2587e-05 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687785+0000", 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1942e-05 2024-05-09T09:53:59.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687802+0000", 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687946+0000", 2024-05-09T09:53:59.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014396100000000001 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688198+0000", 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025293499999999998 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688521+0000", 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032281500000000001 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.689716+0000", 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011949160000000001 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690602+0000", 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088602799999999997 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690692+0000", 2024-05-09T09:53:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9468000000000005e-05 2024-05-09T09:53:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690763+0000", 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1109e-05 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.866387303000003, 2024-05-09T09:53:59.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002920887, 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 826 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:53:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:53:59.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814868+0000", 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.193e-06 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814880+0000", 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1907e-05 2024-05-09T09:53:59.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814912+0000", 2024-05-09T09:53:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1165999999999999e-05 2024-05-09T09:53:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814929+0000", 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7912999999999999e-05 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815074+0000", 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014431399999999999 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815305+0000", 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023076300000000001 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815650+0000", 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034591999999999999 2024-05-09T09:53:59.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.816971+0000", 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001320508 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817634+0000", 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066317500000000001 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817720+0000", 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6365000000000004e-05 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817787+0000", 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6662999999999995e-05 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.838209223, 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003347376, 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 838 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843046+0000", 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9870000000000002e-06 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843059+0000", 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3123e-05 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843090+0000", 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843105+0000", 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4956e-05 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843258+0000", 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015342099999999999 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843636+0000", 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377644 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.844223+0000", 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058732299999999995 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.845580+0000", 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013567270000000001 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846218+0000", 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063835499999999996 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846313+0000", 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4475000000000006e-05 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846392+0000", 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9202000000000005e-05 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.833937341999999, 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029984809999999999, 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 840 2024-05-09T09:53:59.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847318+0000", 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7230000000000001e-06 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847328+0000", 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0233e-05 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847353+0000", 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4719000000000002e-05 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847365+0000", 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2534000000000001e-05 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847493+0000", 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012747799999999999 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847627+0000", 2024-05-09T09:53:59.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013396 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847937+0000", 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031040499999999998 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.848946+0000", 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010091029999999999 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850158+0000", 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001211349 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850239+0000", 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1079000000000001e-05 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850315+0000", 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5897999999999997e-05 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.790 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.809690054999997, 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029954320000000001, 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871566+0000", 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.153e-06 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871578+0000", 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.184e-05 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871608+0000", 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0859999999999999e-05 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871623+0000", 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4899000000000001e-05 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871760+0000", 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136685 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871990+0000", 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229559 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.872322+0000", 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000332128 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.873500+0000", 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001178023 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874351+0000", 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085124199999999999 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874437+0000", 2024-05-09T09:53:59.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6062000000000004e-05 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874559+0000", 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121981 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.772952691, 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029994549999999998, 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.798 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 865 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908303+0000", 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1560000000000002e-06 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908315+0000", 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:53:59.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908345+0000", 2024-05-09T09:53:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0383e-05 2024-05-09T09:53:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908360+0000", 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5023e-05 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908507+0000", 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014646799999999999 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908728+0000", 2024-05-09T09:53:59.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022162899999999999 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.909067+0000", 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000338621 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.910282+0000", 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001215156 2024-05-09T09:53:59.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911147+0000", 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086497500000000003 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911229+0000", 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2472000000000006e-05 2024-05-09T09:53:59.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911300+0000", 2024-05-09T09:53:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0832000000000002e-05 2024-05-09T09:53:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.805 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.704135667000003, 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033122170000000001, 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.806 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 895 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:53:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977120+0000", 2024-05-09T09:53:59.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1100000000000001e-06 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977132+0000", 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1552999999999999e-05 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977163+0000", 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1383000000000001e-05 2024-05-09T09:53:59.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977178+0000", 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4807000000000001e-05 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977331+0000", 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152967 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977700+0000", 2024-05-09T09:53:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036903700000000001 2024-05-09T09:53:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.978266+0000", 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056619699999999995 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.979467+0000", 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001201166 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980277+0000", 2024-05-09T09:53:59.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081005900000000002 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980367+0000", 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0298999999999997e-05 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980430+0000", 2024-05-09T09:53:59.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2638999999999994e-05 2024-05-09T09:53:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:53:59.814 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.699805335000001, 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029215339999999999, 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 897 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:53:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981450+0000", 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0099999999999998e-06 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981461+0000", 2024-05-09T09:53:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0504e-05 2024-05-09T09:53:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981488+0000", 2024-05-09T09:53:59.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7503000000000001e-05 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981509+0000", 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0406000000000001e-05 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981602+0000", 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3828999999999999e-05 2024-05-09T09:53:59.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981724+0000", 2024-05-09T09:53:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121124 2024-05-09T09:53:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981998+0000", 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027401500000000001 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.982980+0000", 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098280999999999998 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984221+0000", 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012405960000000001 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984306+0000", 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5074000000000006e-05 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984370+0000", 2024-05-09T09:53:59.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3663000000000004e-05 2024-05-09T09:53:59.824 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.824 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.824 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.824 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.824 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.610742776999999, 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029823219999999999, 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 934 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070513+0000", 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:53:59.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070525+0000", 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070558+0000", 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2651999999999998e-05 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070580+0000", 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.194e-05 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070713+0000", 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013299399999999999 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070937+0000", 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022408700000000001 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.071257+0000", 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032046100000000002 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.072520+0000", 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001262448 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073338+0000", 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081789299999999998 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073425+0000", 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7127999999999997e-05 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073493+0000", 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8355999999999994e-05 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.830 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.604051214999998, 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029267099999999999, 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:53:59.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 937 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:53:59.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077204+0000", 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.804e-06 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077215+0000", 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0576e-05 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:53:59.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077244+0000", 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8866000000000001e-05 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077265+0000", 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1607000000000002e-05 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077410+0000", 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014486699999999999 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077632+0000", 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022217600000000001 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077954+0000", 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321665 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.078933+0000", 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097881899999999991 2024-05-09T09:53:59.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.079959+0000", 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001026676 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080047+0000", 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7114999999999995e-05 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:53:59.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080129+0000", 2024-05-09T09:53:59.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539000000000004e-05 2024-05-09T09:53:59.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.837 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:53:59.837 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:53:59.837 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:53:59.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:53:59.839 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:53:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:53:59.842 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:53:59.842 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:53:59.842 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:53:59.843 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:53:59.843 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:53:59.843 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:53:59.843 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:53:59.844 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:53:59.844 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:53:59.834+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:53:59.864 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:53:59.865 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:53:59.881 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:53:59.882 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:53:59.899 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:53:59.899 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:53:59.958 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:53:59.956+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:53:59.976 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:53:59.976 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:53:59.991 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:00.040 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:00.036+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:00.120 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:00.121 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:00.135 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:00.178 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.1 to 1 (10000) 2024-05-09T09:54:00.178 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:54:00.179 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:00.178+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:00.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-09T09:54:00.241 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:00.238+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:00.264 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:00.264 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:00.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:00.343 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:00.340+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:00.443 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:00.442+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:00.448 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:00.448 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:00.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:00.551 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:00.550+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:00.623 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:00.623 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:00.638 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:00.683 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:00.682+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:00.747 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:00.744+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:00.807 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:00.807 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:00.821 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:00.848 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:00.844+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:00.945 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:00.946 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:00.949 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:00.946+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:00.960 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:01.050 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:01.046+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:01.122 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:01.122 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:01.136 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:01.179 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.2 to 1 (10000) 2024-05-09T09:54:01.179 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:01.178+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:01.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-09T09:54:01.255 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:01.254+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:01.300 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:01.300 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:01.314 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:01.355 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:01.354+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:01.456 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:01.454+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:01.479 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:01.479 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:01.493 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:01.557 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:01.552+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:01.655 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:01.656 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:01.658 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:01.654+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:01.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:01.759 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:01.756+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:01.830 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:01.831 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:01.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:01.860 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:01.858+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:01.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:01.961 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:01.962+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:02.016 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:02.016 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:02.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:02.062 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:02.058+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:02.118 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:02.118 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:02.149 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:02.149 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:02.163 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:02.162+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:02.180 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:02.180 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:02.196 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.3 to 1 (10000) 2024-05-09T09:54:02.209 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:02.209 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:02.209 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:02.209 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:02.209 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:02.218 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:54:02.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-09T09:54:02.226 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:02.226 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:02.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:02.260 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:02.261 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:02.295 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:02.295 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:02.295 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:02.292+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:02.329 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:02.329 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:02.363 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:02.363 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:02.364 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:02.362+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:02.448 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:02.448 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:02.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:02.448 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:02.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.448 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.244384099000001, 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.449 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.450 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:54:02.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.451 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:02.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:02.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:54:02.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:54:02.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:54:02.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:54:02.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:54:02.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:54:02.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:54:02.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:54:02.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:54:02.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:54:02.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:54:02.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:54:02.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:54:02.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:54:02.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:54:02.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:54:02.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:54:02.502 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.277374037999998, 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:54:02.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:54:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:54:02.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:54:02.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:02.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:54:02.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.247275553999998, 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.510 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:02.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:54:02.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:54:02.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:02.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.517 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.217623101999997, 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:54:02.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:54:02.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:54:02.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:54:02.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:02.525 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.203052712000002, 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:54:02.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:54:02.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:54:02.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:54:02.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:02.532 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.174702353999997, 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.533 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:54:02.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:54:02.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.155978361999999, 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.540 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:54:02.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:02.547 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.119113284000001, 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:54:02.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:02.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:54:02.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:54:02.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.554 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.053929934999999, 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.555 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:54:02.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.051077659999997, 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.561 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.562 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.562 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:54:02.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.562 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:54:02.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:54:02.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.047938475999999, 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:54:02.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:54:02.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.574 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.923032233999997, 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.575 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:54:02.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:54:02.580 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.918023089000002, 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.581 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:54:02.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:54:02.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.723390680999998, 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.588 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:02.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:54:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.594 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.719216985999999, 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.595 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:54:02.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.600 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.667329928999997, 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:54:02.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.662735720000001, 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:54:02.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:54:02.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.481440434, 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.612 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:54:02.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:54:02.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.477751683999998, 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:54:02.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:54:02.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:54:02.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1021 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.145561488, 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032568440000000001, 2024-05-09T09:54:02.625 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1021 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:02.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299425+0000", 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9560000000000002e-06 2024-05-09T09:54:02.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299441+0000", 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.539e-05 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299477+0000", 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5735999999999998e-05 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299494+0000", 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7195999999999999e-05 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299653+0000", 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015902900000000001 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:02.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299889+0000", 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023567799999999999 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.300250+0000", 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000361527 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.301419+0000", 2024-05-09T09:54:02.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011689370000000001 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302515+0000", 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001096138 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302607+0000", 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2329000000000003e-05 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:02.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302679+0000", 2024-05-09T09:54:02.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1928000000000007e-05 2024-05-09T09:54:02.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.632 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:02.632 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:02.632 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:02.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:02.633 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:02.568+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:02.664 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:02.662+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:02.743 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:02.744 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:02.744 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:02.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:02.807 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:02.808+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:02.866 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:02.864+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:02.870 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:02.870 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:02.870 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:02.871 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:02.871 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:02.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:02.975 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:02.976+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.932540932999999, 2024-05-09T09:54:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:54:03.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:54:03.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.751184092999999, 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:54:03.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.747852569999999, 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.053 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.855536596999997, 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.059 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:54:03.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.835582739000003, 2024-05-09T09:54:03.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:54:03.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:54:03.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:54:03.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.8108255, 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:54:03.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:54:03.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.792466711000003, 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.078 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:54:03.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:54:03.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:54:03.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:54:03.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.760514868000001, 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:54:03.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:54:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:54:03.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.089 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.730563807000003, 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.673114699000003, 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:54:03.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:54:03.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:54:03.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.626284247000001, 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:54:03.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.559235344999998, 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.108 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:54:03.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:54:03.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:54:03.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:54:03.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.553656539000002, 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:03.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:54:03.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.122 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.333511651999999, 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:54:03.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:54:03.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:54:03.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.213387904000001, 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:54:03.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:54:03.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.133 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.050009666999998, 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:03.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:54:03.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:54:03.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:54:03.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.014930393999997, 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.139 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:54:03.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:54:03.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:54:03.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.145 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.01108378, 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:54:03.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:54:03.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:54:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.151 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.977811207000002, 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.152 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:54:03.157 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.943265042999997, 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.158 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:03.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:54:03.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:54:03.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.164 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:03.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:03.166 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:03.164+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:03.198 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:54:03.216 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.5 to 1 (10000) 2024-05-09T09:54:03.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-09T09:54:03.290 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:03.292+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:03.331 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:03.331 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:03.347 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:03.391 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:03.392+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:03.468 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:03.468+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:03.561 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:03.561 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:03.561 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:03.561 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:03.562 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:03.569 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:03.566+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:03.583 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:03.670 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:03.670+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:03.771 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:03.772+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:03.792 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:03.792 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:03.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:03.792 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:03.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.612877154000003, 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.793 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:54:03.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:54:03.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:54:03.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:54:03.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:54:03.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:54:03.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.799 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.598360696, 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:54:03.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:54:03.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:54:03.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:54:03.804 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.497657359999998, 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.805 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:03.810 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.485799946, 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.815 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.132610358999997, 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:54:03.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:54:03.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:03.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:54:03.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:54:03.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:54:03.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.128678862000001, 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.822 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:54:03.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:54:03.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:54:03.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.827 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.998516653000003, 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.828 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:03.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:54:03.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.833 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.994567060000001, 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.834 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:03.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:54:03.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:54:03.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:54:03.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.940342909999998, 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:54:03.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:54:03.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.936710792, 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:54:03.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:03.852 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.926215425000002, 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:54:03.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:54:03.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:54:03.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:54:03.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.922382417000001, 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.858 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:54:03.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:54:03.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.863 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.875520864000002, 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:54:03.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:54:03.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:03.869 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.871834049999997, 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.785183945, 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.875 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:54:03.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.781326311000001, 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:54:03.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:54:03.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.686041369999998, 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:54:03.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:54:03.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.681600723000003, 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:54:03.892 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:54:03.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:54:03.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.671160649000001, 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:54:03.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.903 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.667205440000004, 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:03.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:03.909 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:03.911 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:03.911 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:03.910+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:04.012 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:04.012+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:04.112 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:04.112+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:04.128 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:04.129 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:04.129 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:04.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:04.213 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:04.210+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:04.219 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.6 to 1 (10000) 2024-05-09T09:54:04.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-09T09:54:04.314 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:04.314+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:04.365 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:04.365 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:04.365 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:04.365 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:04.365 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:04.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:04.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:04.415 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:04.414+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:04.515 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:04.516+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:04.573 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:04.573 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.399827494999997, 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.574 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:04.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:04.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:04.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:04.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.582 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.351015384, 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556879999999999, 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-05-09T09:54:04.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220488+0000", 2024-05-09T09:54:04.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.596e-06 2024-05-09T09:54:04.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220504+0000", 2024-05-09T09:54:04.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5753e-05 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220541+0000", 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999999e-05 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220559+0000", 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7465999999999998e-05 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220704+0000", 2024-05-09T09:54:04.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144754 2024-05-09T09:54:04.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220947+0000", 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243386 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.221368+0000", 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420963 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.222994+0000", 2024-05-09T09:54:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016260949999999999 2024-05-09T09:54:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223686+0000", 2024-05-09T09:54:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069151800000000002 2024-05-09T09:54:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223771+0000", 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5822000000000006e-05 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223840+0000", 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8734999999999998e-05 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.311815256000003, 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032488740000000001, 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 227 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259687+0000", 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259699+0000", 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2199e-05 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259731+0000", 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2060000000000001e-05 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259747+0000", 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5832999999999999e-05 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259923+0000", 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017627699999999999 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260168+0000", 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024482200000000001 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260592+0000", 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042451899999999999 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262409+0000", 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018164889999999999 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262778+0000", 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036952099999999999 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262863+0000", 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5121e-05 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262933+0000", 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9913000000000006e-05 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.597 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.304724784000001, 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032339780000000002, 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 229 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266777+0000", 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1900000000000002e-06 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266789+0000", 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1365999999999999e-05 2024-05-09T09:54:04.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266820+0000", 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1053000000000002e-05 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266838+0000", 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7963000000000001e-05 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266959+0000", 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121691 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267173+0000", 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021379999999999999 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267579+0000", 2024-05-09T09:54:04.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040555300000000001 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269040+0000", 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014609549999999999 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269859+0000", 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081965300000000005 2024-05-09T09:54:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269946+0000", 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6488000000000003e-05 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270009+0000", 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3266e-05 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.604 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.297767583000002, 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003225641, 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.605 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273734+0000", 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273747+0000", 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2363e-05 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273777+0000", 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273792+0000", 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5157000000000001e-05 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273906+0000", 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011372800000000001 2024-05-09T09:54:04.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274111+0000", 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000205556 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274578+0000", 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046704899999999998 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276012+0000", 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001433805 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276811+0000", 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079894299999999998 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276891+0000", 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9948000000000001e-05 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276958+0000", 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6872999999999995e-05 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:438 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.611 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.212284994999997, 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044008270000000004, 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:04.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359216+0000", 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0389999999999999e-06 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359224+0000", 2024-05-09T09:54:04.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1999999999999994e-06 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359237+0000", 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2826999999999999e-05 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359243+0000", 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0129999999999999e-06 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359298+0000", 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5041999999999999e-05 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359388+0000", 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0174999999999996e-05 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359523+0000", 2024-05-09T09:54:04.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135122 2024-05-09T09:54:04.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.360060+0000", 2024-05-09T09:54:04.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053657399999999995 2024-05-09T09:54:04.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363514+0000", 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003454146 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363574+0000", 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.982e-05 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363616+0000", 2024-05-09T09:54:04.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1869000000000002e-05 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:443 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.207343833000003, 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041654989999999996, 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 443 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364157+0000", 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2299999999999999e-07 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364163+0000", 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9059999999999999e-06 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364177+0000", 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3890000000000001e-05 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364183+0000", 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8210000000000004e-06 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364250+0000", 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6965999999999995e-05 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364341+0000", 2024-05-09T09:54:04.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0847999999999995e-05 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364524+0000", 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182778 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.365027+0000", 2024-05-09T09:54:04.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050315500000000003 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368257+0000", 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293809999999999 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368293+0000", 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6612000000000001e-05 2024-05-09T09:54:04.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368321+0000", 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8218999999999999e-05 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:476 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.187465799999998, 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030779259999999999, 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 476 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:04.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384035+0000", 2024-05-09T09:54:04.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.046e-06 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384041+0000", 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6899999999999997e-06 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384055+0000", 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4457999999999999e-05 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384062+0000", 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3709999999999996e-06 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384143+0000", 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1678e-05 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384199+0000", 2024-05-09T09:54:04.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5940999999999999e-05 2024-05-09T09:54:04.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:04.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384322+0000", 2024-05-09T09:54:04.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122617 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384970+0000", 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064774299999999999 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387007+0000", 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020371009999999999 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387067+0000", 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0234e-05 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387112+0000", 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5046999999999997e-05 2024-05-09T09:54:04.634 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.964958170000003, 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003541209, 2024-05-09T09:54:04.635 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 736 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:04.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606544+0000", 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606556+0000", 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.185e-05 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606586+0000", 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606602+0000", 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606759+0000", 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157594 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607123+0000", 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036346000000000002 2024-05-09T09:54:04.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607703+0000", 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057985000000000003 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609215+0000", 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512071 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609797+0000", 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058224999999999998 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609969+0000", 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171767 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.610083+0000", 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114221 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.641 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.960440910999999, 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029874860000000001, 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.642 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 738 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611061+0000", 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1739999999999999e-06 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611073+0000", 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1619e-05 2024-05-09T09:54:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611099+0000", 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6103000000000001e-05 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611112+0000", 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611252+0000", 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014065799999999999 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611494+0000", 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000241769 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611980+0000", 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000486331 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613227+0000", 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012462529999999999 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613772+0000", 2024-05-09T09:54:04.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054489600000000001 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613927+0000", 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000155668 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.614046+0000", 2024-05-09T09:54:04.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119065 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.883761638000003, 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003024648, 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 772 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687740+0000", 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687753+0000", 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2587e-05 2024-05-09T09:54:04.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687785+0000", 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1942e-05 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687802+0000", 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687946+0000", 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014396100000000001 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688198+0000", 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025293499999999998 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688521+0000", 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032281500000000001 2024-05-09T09:54:04.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.689716+0000", 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011949160000000001 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690602+0000", 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088602799999999997 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690692+0000", 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9468000000000005e-05 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690763+0000", 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1109e-05 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.655 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.756633526000002, 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002920887, 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 826 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814868+0000", 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.193e-06 2024-05-09T09:54:04.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814880+0000", 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1907e-05 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814912+0000", 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1165999999999999e-05 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814929+0000", 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7912999999999999e-05 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815074+0000", 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014431399999999999 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815305+0000", 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023076300000000001 2024-05-09T09:54:04.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:04.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815650+0000", 2024-05-09T09:54:04.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034591999999999999 2024-05-09T09:54:04.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.816971+0000", 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001320508 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817634+0000", 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066317500000000001 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817720+0000", 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6365000000000004e-05 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817787+0000", 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6662999999999995e-05 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.728455445999998, 2024-05-09T09:54:04.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003347376, 2024-05-09T09:54:04.663 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.663 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.663 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.663 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 838 2024-05-09T09:54:04.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843046+0000", 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9870000000000002e-06 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843059+0000", 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3123e-05 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843090+0000", 2024-05-09T09:54:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843105+0000", 2024-05-09T09:54:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4956e-05 2024-05-09T09:54:04.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843258+0000", 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015342099999999999 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843636+0000", 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377644 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.844223+0000", 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058732299999999995 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.845580+0000", 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013567270000000001 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846218+0000", 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063835499999999996 2024-05-09T09:54:04.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846313+0000", 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4475000000000006e-05 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846392+0000", 2024-05-09T09:54:04.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9202000000000005e-05 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.724183564999997, 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029984809999999999, 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.670 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 840 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847318+0000", 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7230000000000001e-06 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847328+0000", 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0233e-05 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847353+0000", 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4719000000000002e-05 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847365+0000", 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2534000000000001e-05 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847493+0000", 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012747799999999999 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847627+0000", 2024-05-09T09:54:04.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013396 2024-05-09T09:54:04.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:04.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847937+0000", 2024-05-09T09:54:04.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031040499999999998 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.848946+0000", 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010091029999999999 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850158+0000", 2024-05-09T09:54:04.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001211349 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850239+0000", 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1079000000000001e-05 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850315+0000", 2024-05-09T09:54:04.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5897999999999997e-05 2024-05-09T09:54:04.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.678 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.678 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.678 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:04.678 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.699936278000003, 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029954320000000001, 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.679 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:04.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871566+0000", 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.153e-06 2024-05-09T09:54:04.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871578+0000", 2024-05-09T09:54:04.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.184e-05 2024-05-09T09:54:04.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871608+0000", 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0859999999999999e-05 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871623+0000", 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4899000000000001e-05 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871760+0000", 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136685 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871990+0000", 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229559 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.872322+0000", 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000332128 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.873500+0000", 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001178023 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874351+0000", 2024-05-09T09:54:04.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085124199999999999 2024-05-09T09:54:04.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874437+0000", 2024-05-09T09:54:04.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6062000000000004e-05 2024-05-09T09:54:04.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874559+0000", 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121981 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:04.687 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.663198913999999, 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029994549999999998, 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 865 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908303+0000", 2024-05-09T09:54:04.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1560000000000002e-06 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908315+0000", 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908345+0000", 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0383e-05 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908360+0000", 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5023e-05 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908507+0000", 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014646799999999999 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908728+0000", 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022162899999999999 2024-05-09T09:54:04.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.909067+0000", 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000338621 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.910282+0000", 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001215156 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911147+0000", 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086497500000000003 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911229+0000", 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2472000000000006e-05 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911300+0000", 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0832000000000002e-05 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.693 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.594381890000001, 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033122170000000001, 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 895 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977120+0000", 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1100000000000001e-06 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977132+0000", 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1552999999999999e-05 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977163+0000", 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1383000000000001e-05 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977178+0000", 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4807000000000001e-05 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977331+0000", 2024-05-09T09:54:04.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152967 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977700+0000", 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036903700000000001 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.978266+0000", 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056619699999999995 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.979467+0000", 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001201166 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980277+0000", 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081005900000000002 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980367+0000", 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0298999999999997e-05 2024-05-09T09:54:04.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980430+0000", 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2638999999999994e-05 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.700 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.590051557999999, 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029215339999999999, 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 897 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981450+0000", 2024-05-09T09:54:04.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0099999999999998e-06 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981461+0000", 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0504e-05 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981488+0000", 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7503000000000001e-05 2024-05-09T09:54:04.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981509+0000", 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0406000000000001e-05 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981602+0000", 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3828999999999999e-05 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981724+0000", 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121124 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981998+0000", 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027401500000000001 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.982980+0000", 2024-05-09T09:54:04.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098280999999999998 2024-05-09T09:54:04.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984221+0000", 2024-05-09T09:54:04.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012405960000000001 2024-05-09T09:54:04.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984306+0000", 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5074000000000006e-05 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984370+0000", 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3663000000000004e-05 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.500988999999997, 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029823219999999999, 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 934 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.708 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070513+0000", 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070525+0000", 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070558+0000", 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2651999999999998e-05 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070580+0000", 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.194e-05 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070713+0000", 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013299399999999999 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070937+0000", 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022408700000000001 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.071257+0000", 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032046100000000002 2024-05-09T09:54:04.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.072520+0000", 2024-05-09T09:54:04.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001262448 2024-05-09T09:54:04.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073338+0000", 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081789299999999998 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073425+0000", 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7127999999999997e-05 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073493+0000", 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8355999999999994e-05 2024-05-09T09:54:04.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.494297437999997, 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029267099999999999, 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:04.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 937 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:04.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077204+0000", 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.804e-06 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077215+0000", 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0576e-05 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077244+0000", 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8866000000000001e-05 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077265+0000", 2024-05-09T09:54:04.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1607000000000002e-05 2024-05-09T09:54:04.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:04.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077410+0000", 2024-05-09T09:54:04.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014486699999999999 2024-05-09T09:54:04.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077632+0000", 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022217600000000001 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077954+0000", 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321665 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:04.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.078933+0000", 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097881899999999991 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.079959+0000", 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001026676 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080047+0000", 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7114999999999995e-05 2024-05-09T09:54:04.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:04.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:04.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:04.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080129+0000", 2024-05-09T09:54:04.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539000000000004e-05 2024-05-09T09:54:04.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.722 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:04.723 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:04.723 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:04.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:04.725 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:04.725 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:04.726 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:04.726 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:04.727 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:04.727 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:04.727 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:04.724+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:04.731 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:04.731 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:04.762 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:04.763 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:04.793 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:04.793 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:04.824 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:04.824+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:04.825 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:04.825 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:04.858 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:04.858 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:04.860 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:04.860 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:04.874 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:04.925 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:04.922+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:04.997 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:04.997 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:05.011 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:05.055 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:05.054+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:05.126 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:05.128+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:05.181 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:05.181 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:05.196 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:05.226 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.7 to 1 (10000) 2024-05-09T09:54:05.232 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:54:05.243 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:05.242+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:05.256 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-09T09:54:05.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:54:05.323 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:05.323 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:05.338 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:05.346 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:05.348+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:05.429 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:05.428+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:05.500 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:05.500 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:05.514 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:05.529 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:05.528+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:54:05.629 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:54:05.631 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:05.630+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:05.637 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:05.637 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:05.641 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-05-09T09:54:05.298181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":804,"num_read_kb":547,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":38,"num_bytes_recovered":1741,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":528,"ondisk_log_size":528,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":215180,"kb_used_data":5204,"kb_used_omap":10,"kb_used_meta":209845,"kb_avail":660387700,"statfs":{"total":676457349120,"available":676237004800,"internally_reserved":0,"allocated":5328896,"data_stored":3204426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11154,"internal_metadata":214881390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000887"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271129+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:54:04.271129+0000","last_peered":"2024-05-09T09:54:04.271129+0000","last_clean":"2024-05-09T09:54:04.271129+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:54:04.271129+0000","last_undegraded":"2024-05-09T09:54:04.271129+0000","last_fullsized":"2024-05-09T09:54:04.271129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434339+0000","last_change":"2024-05-09T09:53:28.743971+0000","last_active":"2024-05-09T09:54:03.434339+0000","last_peered":"2024-05-09T09:54:03.434339+0000","last_clean":"2024-05-09T09:54:03.434339+0000","last_became_active":"2024-05-09T09:53:28.742941+0000","last_became_peered":"2024-05-09T09:53:28.742941+0000","last_unstale":"2024-05-09T09:54:03.434339+0000","last_undegraded":"2024-05-09T09:54:03.434339+0000","last_fullsized":"2024-05-09T09:54:03.434339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:05:43.273931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218748+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:54:04.218748+0000","last_peered":"2024-05-09T09:54:04.218748+0000","last_clean":"2024-05-09T09:54:04.218748+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:54:04.218748+0000","last_undegraded":"2024-05-09T09:54:04.218748+0000","last_fullsized":"2024-05-09T09:54:04.218748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269713+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:54:04.269713+0000","last_peered":"2024-05-09T09:54:04.269713+0000","last_clean":"2024-05-09T09:54:04.269713+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:54:04.269713+0000","last_undegraded":"2024-05-09T09:54:04.269713+0000","last_fullsized":"2024-05-09T09:54:04.269713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218591+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:54:04.218591+0000","last_peered":"2024-05-09T09:54:04.218591+0000","last_clean":"2024-05-09T09:54:04.218591+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:54:04.218591+0000","last_undegraded":"2024-05-09T09:54:04.218591+0000","last_fullsized":"2024-05-09T09:54:04.218591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217283+0000","last_change":"2024-05-09T09:53:28.774715+0000","last_active":"2024-05-09T09:54:04.217283+0000","last_peered":"2024-05-09T09:54:04.217283+0000","last_clean":"2024-05-09T09:54:04.217283+0000","last_became_active":"2024-05-09T09:53:28.774015+0000","last_became_peered":"2024-05-09T09:53:28.774015+0000","last_unstale":"2024-05-09T09:54:04.217283+0000","last_undegraded":"2024-05-09T09:54:04.217283+0000","last_fullsized":"2024-05-09T09:54:04.217283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:33.002835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433672+0000","last_change":"2024-05-09T09:53:07.122498+0000","last_active":"2024-05-09T09:54:03.433672+0000","last_peered":"2024-05-09T09:54:03.433672+0000","last_clean":"2024-05-09T09:54:03.433672+0000","last_became_active":"2024-05-09T09:53:07.121122+0000","last_became_peered":"2024-05-09T09:53:07.121122+0000","last_unstale":"2024-05-09T09:54:03.433672+0000","last_undegraded":"2024-05-09T09:54:03.433672+0000","last_fullsized":"2024-05-09T09:54:03.433672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:09:33.860750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217554+0000","last_change":"2024-05-09T09:53:09.125729+0000","last_active":"2024-05-09T09:54:04.217554+0000","last_peered":"2024-05-09T09:54:04.217554+0000","last_clean":"2024-05-09T09:54:04.217554+0000","last_became_active":"2024-05-09T09:53:09.125431+0000","last_became_peered":"2024-05-09T09:53:09.125431+0000","last_unstale":"2024-05-09T09:54:04.217554+0000","last_undegraded":"2024-05-09T09:54:04.217554+0000","last_fullsized":"2024-05-09T09:54:04.217554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320090+0000","last_change":"2024-05-09T09:53:54.477992+0000","last_active":"2024-05-09T09:54:03.320090+0000","last_peered":"2024-05-09T09:54:03.320090+0000","last_clean":"2024-05-09T09:54:03.320090+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:54:03.320090+0000","last_undegraded":"2024-05-09T09:54:03.320090+0000","last_fullsized":"2024-05-09T09:54:03.320090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:38.501294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321246+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:54:03.321246+0000","last_peered":"2024-05-09T09:54:03.321246+0000","last_clean":"2024-05-09T09:54:03.321246+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:54:03.321246+0000","last_undegraded":"2024-05-09T09:54:03.321246+0000","last_fullsized":"2024-05-09T09:54:03.321246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435172+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:54:03.435172+0000","last_peered":"2024-05-09T09:54:03.435172+0000","last_clean":"2024-05-09T09:54:03.435172+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:54:03.435172+0000","last_undegraded":"2024-05-09T09:54:03.435172+0000","last_fullsized":"2024-05-09T09:54:03.435172+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:45:31.509591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218512+0000","last_change":"2024-05-09T09:53:28.768336+0000","last_active":"2024-05-09T09:54:04.218512+0000","last_peered":"2024-05-09T09:54:04.218512+0000","last_clean":"2024-05-09T09:54:04.218512+0000","last_became_active":"2024-05-09T09:53:28.766320+0000","last_became_peered":"2024-05-09T09:53:28.766320+0000","last_unstale":"2024-05-09T09:54:04.218512+0000","last_undegraded":"2024-05-09T09:54:04.218512+0000","last_fullsized":"2024-05-09T09:54:04.218512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:23:32.084558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269995+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:54:04.269995+0000","last_peered":"2024-05-09T09:54:04.269995+0000","last_clean":"2024-05-09T09:54:04.269995+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:54:04.269995+0000","last_undegraded":"2024-05-09T09:54:04.269995+0000","last_fullsized":"2024-05-09T09:54:04.269995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435703+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:54:03.435703+0000","last_peered":"2024-05-09T09:54:03.435703+0000","last_clean":"2024-05-09T09:54:03.435703+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:54:03.435703+0000","last_undegraded":"2024-05-09T09:54:03.435703+0000","last_fullsized":"2024-05-09T09:54:03.435703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205426+0000","last_change":"2024-05-09T09:53:07.119794+0000","last_active":"2024-05-09T09:54:03.205426+0000","last_peered":"2024-05-09T09:54:03.205426+0000","last_clean":"2024-05-09T09:54:03.205426+0000","last_became_active":"2024-05-09T09:53:07.119402+0000","last_became_peered":"2024-05-09T09:53:07.119402+0000","last_unstale":"2024-05-09T09:54:03.205426+0000","last_undegraded":"2024-05-09T09:54:03.205426+0000","last_fullsized":"2024-05-09T09:54:03.205426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.575043+0000","last_change":"2024-05-09T09:53:09.109546+0000","last_active":"2024-05-09T09:54:03.575043+0000","last_peered":"2024-05-09T09:54:03.575043+0000","last_clean":"2024-05-09T09:54:03.575043+0000","last_became_active":"2024-05-09T09:53:09.108979+0000","last_became_peered":"2024-05-09T09:53:09.108979+0000","last_unstale":"2024-05-09T09:54:03.575043+0000","last_undegraded":"2024-05-09T09:54:03.575043+0000","last_fullsized":"2024-05-09T09:54:03.575043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:57.701380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.215845+0000","last_change":"2024-05-09T09:53:28.760228+0000","last_active":"2024-05-09T09:54:04.215845+0000","last_peered":"2024-05-09T09:54:04.215845+0000","last_clean":"2024-05-09T09:54:04.215845+0000","last_became_active":"2024-05-09T09:53:28.759657+0000","last_became_peered":"2024-05-09T09:53:28.759657+0000","last_unstale":"2024-05-09T09:54:04.215845+0000","last_undegraded":"2024-05-09T09:54:04.215845+0000","last_fullsized":"2024-05-09T09:54:04.215845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:44.696699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271386+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:54:04.271386+0000","last_peered":"2024-05-09T09:54:04.271386+0000","last_clean":"2024-05-09T09:54:04.271386+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:54:04.271386+0000","last_undegraded":"2024-05-09T09:54:04.271386+0000","last_fullsized":"2024-05-09T09:54:04.271386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269929+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:54:04.269929+0000","last_peered":"2024-05-09T09:54:04.269929+0000","last_clean":"2024-05-09T09:54:04.269929+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:54:04.269929+0000","last_undegraded":"2024-05-09T09:54:04.269929+0000","last_fullsized":"2024-05-09T09:54:04.269929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321843+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:54:03.321843+0000","last_peered":"2024-05-09T09:54:03.321843+0000","last_clean":"2024-05-09T09:54:03.321843+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:54:03.321843+0000","last_undegraded":"2024-05-09T09:54:03.321843+0000","last_fullsized":"2024-05-09T09:54:03.321843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435448+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:54:03.435448+0000","last_peered":"2024-05-09T09:54:03.435448+0000","last_clean":"2024-05-09T09:54:03.435448+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:54:03.435448+0000","last_undegraded":"2024-05-09T09:54:03.435448+0000","last_fullsized":"2024-05-09T09:54:03.435448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321972+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:54:03.321972+0000","last_peered":"2024-05-09T09:54:03.321972+0000","last_clean":"2024-05-09T09:54:03.321972+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:54:03.321972+0000","last_undegraded":"2024-05-09T09:54:03.321972+0000","last_fullsized":"2024-05-09T09:54:03.321972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573918+0000","last_change":"2024-05-09T09:53:09.109289+0000","last_active":"2024-05-09T09:54:03.573918+0000","last_peered":"2024-05-09T09:54:03.573918+0000","last_clean":"2024-05-09T09:54:03.573918+0000","last_became_active":"2024-05-09T09:53:09.108483+0000","last_became_peered":"2024-05-09T09:53:09.108483+0000","last_unstale":"2024-05-09T09:54:03.573918+0000","last_undegraded":"2024-05-09T09:54:03.573918+0000","last_fullsized":"2024-05-09T09:54:03.573918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:55.077672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321369+0000","last_change":"2024-05-09T09:53:28.769627+0000","last_active":"2024-05-09T09:54:03.321369+0000","last_peered":"2024-05-09T09:54:03.321369+0000","last_clean":"2024-05-09T09:54:03.321369+0000","last_became_active":"2024-05-09T09:53:28.768939+0000","last_became_peered":"2024-05-09T09:53:28.768939+0000","last_unstale":"2024-05-09T09:54:03.321369+0000","last_undegraded":"2024-05-09T09:54:03.321369+0000","last_fullsized":"2024-05-09T09:54:03.321369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:31.035254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574359+0000","last_change":"2024-05-09T09:53:28.768598+0000","last_active":"2024-05-09T09:54:03.574359+0000","last_peered":"2024-05-09T09:54:03.574359+0000","last_clean":"2024-05-09T09:54:03.574359+0000","last_became_active":"2024-05-09T09:53:28.751472+0000","last_became_peered":"2024-05-09T09:53:28.751472+0000","last_unstale":"2024-05-09T09:54:03.574359+0000","last_undegraded":"2024-05-09T09:54:03.574359+0000","last_fullsized":"2024-05-09T09:54:03.574359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:37.593516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206730+0000","last_change":"2024-05-09T09:53:07.113936+0000","last_active":"2024-05-09T09:54:03.206730+0000","last_peered":"2024-05-09T09:54:03.206730+0000","last_clean":"2024-05-09T09:54:03.206730+0000","last_became_active":"2024-05-09T09:53:07.113560+0000","last_became_peered":"2024-05-09T09:53:07.113560+0000","last_unstale":"2024-05-09T09:54:03.206730+0000","last_undegraded":"2024-05-09T09:54:03.206730+0000","last_fullsized":"2024-05-09T09:54:03.206730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574634+0000","last_change":"2024-05-09T09:53:54.474438+0000","last_active":"2024-05-09T09:54:03.574634+0000","last_peered":"2024-05-09T09:54:03.574634+0000","last_clean":"2024-05-09T09:54:03.574634+0000","last_became_active":"2024-05-09T09:53:54.474119+0000","last_became_peered":"2024-05-09T09:53:54.474119+0000","last_unstale":"2024-05-09T09:54:03.574634+0000","last_undegraded":"2024-05-09T09:54:03.574634+0000","last_fullsized":"2024-05-09T09:54:03.574634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:05.292436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217362+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:54:04.217362+0000","last_peered":"2024-05-09T09:54:04.217362+0000","last_clean":"2024-05-09T09:54:04.217362+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:54:04.217362+0000","last_undegraded":"2024-05-09T09:54:04.217362+0000","last_fullsized":"2024-05-09T09:54:04.217362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206345+0000","last_change":"2024-05-09T09:53:28.764726+0000","last_active":"2024-05-09T09:54:03.206345+0000","last_peered":"2024-05-09T09:54:03.206345+0000","last_clean":"2024-05-09T09:54:03.206345+0000","last_became_active":"2024-05-09T09:53:28.742951+0000","last_became_peered":"2024-05-09T09:53:28.742951+0000","last_unstale":"2024-05-09T09:54:03.206345+0000","last_undegraded":"2024-05-09T09:54:03.206345+0000","last_fullsized":"2024-05-09T09:54:03.206345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:05.916196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202430+0000","last_change":"2024-05-09T09:53:09.113975+0000","last_active":"2024-05-09T09:54:03.202430+0000","last_peered":"2024-05-09T09:54:03.202430+0000","last_clean":"2024-05-09T09:54:03.202430+0000","last_became_active":"2024-05-09T09:53:09.112863+0000","last_became_peered":"2024-05-09T09:53:09.112863+0000","last_unstale":"2024-05-09T09:54:03.202430+0000","last_undegraded":"2024-05-09T09:54:03.202430+0000","last_fullsized":"2024-05-09T09:54:03.202430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:33.354661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270029+0000","last_change":"2024-05-09T09:53:28.741314+0000","last_active":"2024-05-09T09:54:04.270029+0000","last_peered":"2024-05-09T09:54:04.270029+0000","last_clean":"2024-05-09T09:54:04.270029+0000","last_became_active":"2024-05-09T09:53:28.740956+0000","last_became_peered":"2024-05-09T09:53:28.740956+0000","last_unstale":"2024-05-09T09:54:04.270029+0000","last_undegraded":"2024-05-09T09:54:04.270029+0000","last_fullsized":"2024-05-09T09:54:04.270029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:20.659273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436210+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:54:03.436210+0000","last_peered":"2024-05-09T09:54:03.436210+0000","last_clean":"2024-05-09T09:54:03.436210+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:54:03.436210+0000","last_undegraded":"2024-05-09T09:54:03.436210+0000","last_fullsized":"2024-05-09T09:54:03.436210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219662+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:54:04.219662+0000","last_peered":"2024-05-09T09:54:04.219662+0000","last_clean":"2024-05-09T09:54:04.219662+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:54:04.219662+0000","last_undegraded":"2024-05-09T09:54:04.219662+0000","last_fullsized":"2024-05-09T09:54:04.219662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270829+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:54:04.270829+0000","last_peered":"2024-05-09T09:54:04.270829+0000","last_clean":"2024-05-09T09:54:04.270829+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:54:04.270829+0000","last_undegraded":"2024-05-09T09:54:04.270829+0000","last_fullsized":"2024-05-09T09:54:04.270829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":53,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434211+0000","last_change":"2024-05-09T09:53:28.769492+0000","last_active":"2024-05-09T09:54:03.434211+0000","last_peered":"2024-05-09T09:54:03.434211+0000","last_clean":"2024-05-09T09:54:03.434211+0000","last_became_active":"2024-05-09T09:53:28.769145+0000","last_became_peered":"2024-05-09T09:53:28.769145+0000","last_unstale":"2024-05-09T09:54:03.434211+0000","last_undegraded":"2024-05-09T09:54:03.434211+0000","last_fullsized":"2024-05-09T09:54:03.434211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:19.465808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436682+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:54:03.436682+0000","last_peered":"2024-05-09T09:54:03.436682+0000","last_clean":"2024-05-09T09:54:03.436682+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:54:03.436682+0000","last_undegraded":"2024-05-09T09:54:03.436682+0000","last_fullsized":"2024-05-09T09:54:03.436682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217485+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:54:04.217485+0000","last_peered":"2024-05-09T09:54:04.217485+0000","last_clean":"2024-05-09T09:54:04.217485+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:54:04.217485+0000","last_undegraded":"2024-05-09T09:54:04.217485+0000","last_fullsized":"2024-05-09T09:54:04.217485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202199+0000","last_change":"2024-05-09T09:53:11.120948+0000","last_active":"2024-05-09T09:54:03.202199+0000","last_peered":"2024-05-09T09:54:03.202199+0000","last_clean":"2024-05-09T09:54:03.202199+0000","last_became_active":"2024-05-09T09:53:11.120423+0000","last_became_peered":"2024-05-09T09:53:11.120423+0000","last_unstale":"2024-05-09T09:54:03.202199+0000","last_undegraded":"2024-05-09T09:54:03.202199+0000","last_fullsized":"2024-05-09T09:54:03.202199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:06.988958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":78,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574822+0000","last_change":"2024-05-09T09:53:28.787828+0000","last_active":"2024-05-09T09:54:03.574822+0000","last_peered":"2024-05-09T09:54:03.574822+0000","last_clean":"2024-05-09T09:54:03.574822+0000","last_became_active":"2024-05-09T09:53:28.753432+0000","last_became_peered":"2024-05-09T09:53:28.753432+0000","last_unstale":"2024-05-09T09:54:03.574822+0000","last_undegraded":"2024-05-09T09:54:03.574822+0000","last_fullsized":"2024-05-09T09:54:03.574822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219752+0000","last_change":"2024-05-09T09:53:28.773447+0000","last_active":"2024-05-09T09:54:04.219752+0000","last_peered":"2024-05-09T09:54:04.219752+0000","last_clean":"2024-05-09T09:54:04.219752+0000","last_became_active":"2024-05-09T09:53:28.767423+0000","last_became_peered":"2024-05-09T09:53:28.767423+0000","last_unstale":"2024-05-09T09:54:04.219752+0000","last_undegraded":"2024-05-09T09:54:04.219752+0000","last_fullsized":"2024-05-09T09:54:04.219752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:30.413262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217111+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:54:04.217111+0000","last_peered":"2024-05-09T09:54:04.217111+0000","last_clean":"2024-05-09T09:54:04.217111+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:54:04.217111+0000","last_undegraded":"2024-05-09T09:54:04.217111+0000","last_fullsized":"2024-05-09T09:54:04.217111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219108+0000","last_change":"2024-05-09T09:53:09.113086+0000","last_active":"2024-05-09T09:54:04.219108+0000","last_peered":"2024-05-09T09:54:04.219108+0000","last_clean":"2024-05-09T09:54:04.219108+0000","last_became_active":"2024-05-09T09:53:09.112715+0000","last_became_peered":"2024-05-09T09:53:09.112715+0000","last_unstale":"2024-05-09T09:54:04.219108+0000","last_undegraded":"2024-05-09T09:54:04.219108+0000","last_fullsized":"2024-05-09T09:54:04.219108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270158+0000","last_change":"2024-05-09T09:53:28.745367+0000","last_active":"2024-05-09T09:54:04.270158+0000","last_peered":"2024-05-09T09:54:04.270158+0000","last_clean":"2024-05-09T09:54:04.270158+0000","last_became_active":"2024-05-09T09:53:28.745077+0000","last_became_peered":"2024-05-09T09:53:28.745077+0000","last_unstale":"2024-05-09T09:54:04.270158+0000","last_undegraded":"2024-05-09T09:54:04.270158+0000","last_fullsized":"2024-05-09T09:54:04.270158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:33.351895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203441+0000","last_change":"2024-05-09T09:53:11.119863+0000","last_active":"2024-05-09T09:54:03.203441+0000","last_peered":"2024-05-09T09:54:03.203441+0000","last_clean":"2024-05-09T09:54:03.203441+0000","last_became_active":"2024-05-09T09:53:11.119093+0000","last_became_peered":"2024-05-09T09:53:11.119093+0000","last_unstale":"2024-05-09T09:54:03.203441+0000","last_undegraded":"2024-05-09T09:54:03.203441+0000","last_fullsized":"2024-05-09T09:54:03.203441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:27.928171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":88,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574174+0000","last_change":"2024-05-09T09:53:28.800370+0000","last_active":"2024-05-09T09:54:03.574174+0000","last_peered":"2024-05-09T09:54:03.574174+0000","last_clean":"2024-05-09T09:54:03.574174+0000","last_became_active":"2024-05-09T09:53:28.760579+0000","last_became_peered":"2024-05-09T09:53:28.760579+0000","last_unstale":"2024-05-09T09:54:03.574174+0000","last_undegraded":"2024-05-09T09:54:03.574174+0000","last_fullsized":"2024-05-09T09:54:03.574174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:29.935297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271559+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:54:04.271559+0000","last_peered":"2024-05-09T09:54:04.271559+0000","last_clean":"2024-05-09T09:54:04.271559+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:54:04.271559+0000","last_undegraded":"2024-05-09T09:54:04.271559+0000","last_fullsized":"2024-05-09T09:54:04.271559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573780+0000","last_change":"2024-05-09T09:53:28.751329+0000","last_active":"2024-05-09T09:54:03.573780+0000","last_peered":"2024-05-09T09:54:03.573780+0000","last_clean":"2024-05-09T09:54:03.573780+0000","last_became_active":"2024-05-09T09:53:28.750943+0000","last_became_peered":"2024-05-09T09:53:28.750943+0000","last_unstale":"2024-05-09T09:54:03.573780+0000","last_undegraded":"2024-05-09T09:54:03.573780+0000","last_fullsized":"2024-05-09T09:54:03.573780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:40.249137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202832+0000","last_change":"2024-05-09T09:53:09.133623+0000","last_active":"2024-05-09T09:54:03.202832+0000","last_peered":"2024-05-09T09:54:03.202832+0000","last_clean":"2024-05-09T09:54:03.202832+0000","last_became_active":"2024-05-09T09:53:09.133066+0000","last_became_peered":"2024-05-09T09:53:09.133066+0000","last_unstale":"2024-05-09T09:54:03.202832+0000","last_undegraded":"2024-05-09T09:54:03.202832+0000","last_fullsized":"2024-05-09T09:54:03.202832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:56.384209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320145+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:54:03.320145+0000","last_peered":"2024-05-09T09:54:03.320145+0000","last_clean":"2024-05-09T09:54:03.320145+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:54:03.320145+0000","last_undegraded":"2024-05-09T09:54:03.320145+0000","last_fullsized":"2024-05-09T09:54:03.320145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435591+0000","last_change":"2024-05-09T09:53:11.126737+0000","last_active":"2024-05-09T09:54:03.435591+0000","last_peered":"2024-05-09T09:54:03.435591+0000","last_clean":"2024-05-09T09:54:03.435591+0000","last_became_active":"2024-05-09T09:53:11.125702+0000","last_became_peered":"2024-05-09T09:53:11.125702+0000","last_unstale":"2024-05-09T09:54:03.435591+0000","last_undegraded":"2024-05-09T09:54:03.435591+0000","last_fullsized":"2024-05-09T09:54:03.435591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:31:04.360774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271291+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:54:04.271291+0000","last_peered":"2024-05-09T09:54:04.271291+0000","last_clean":"2024-05-09T09:54:04.271291+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:54:04.271291+0000","last_undegraded":"2024-05-09T09:54:04.271291+0000","last_fullsized":"2024-05-09T09:54:04.271291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201478+0000","last_change":"2024-05-09T09:53:15.173857+0000","last_active":"2024-05-09T09:54:03.201478+0000","last_peered":"2024-05-09T09:54:03.201478+0000","last_clean":"2024-05-09T09:54:03.201478+0000","last_became_active":"2024-05-09T09:53:15.172351+0000","last_became_peered":"2024-05-09T09:53:15.172351+0000","last_unstale":"2024-05-09T09:54:03.201478+0000","last_undegraded":"2024-05-09T09:54:03.201478+0000","last_fullsized":"2024-05-09T09:54:03.201478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:19.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434714+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:54:03.434714+0000","last_peered":"2024-05-09T09:54:03.434714+0000","last_clean":"2024-05-09T09:54:03.434714+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:54:03.434714+0000","last_undegraded":"2024-05-09T09:54:03.434714+0000","last_fullsized":"2024-05-09T09:54:03.434714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271405+0000","last_change":"2024-05-09T09:53:28.767146+0000","last_active":"2024-05-09T09:54:04.271405+0000","last_peered":"2024-05-09T09:54:04.271405+0000","last_clean":"2024-05-09T09:54:04.271405+0000","last_became_active":"2024-05-09T09:53:28.766702+0000","last_became_peered":"2024-05-09T09:53:28.766702+0000","last_unstale":"2024-05-09T09:54:04.271405+0000","last_undegraded":"2024-05-09T09:54:04.271405+0000","last_fullsized":"2024-05-09T09:54:04.271405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:21.693641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269288+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:54:04.269288+0000","last_peered":"2024-05-09T09:54:04.269288+0000","last_clean":"2024-05-09T09:54:04.269288+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:54:04.269288+0000","last_undegraded":"2024-05-09T09:54:04.269288+0000","last_fullsized":"2024-05-09T09:54:04.269288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":87,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434344+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:54:03.434344+0000","last_peered":"2024-05-09T09:54:03.434344+0000","last_clean":"2024-05-09T09:54:03.434344+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:54:03.434344+0000","last_undegraded":"2024-05-09T09:54:03.434344+0000","last_fullsized":"2024-05-09T09:54:03.434344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220920+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:54:04.220920+0000","last_peered":"2024-05-09T09:54:04.220920+0000","last_clean":"2024-05-09T09:54:04.220920+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:54:04.220920+0000","last_undegraded":"2024-05-09T09:54:04.220920+0000","last_fullsized":"2024-05-09T09:54:04.220920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":53,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435048+0000","last_change":"2024-05-09T09:53:28.760592+0000","last_active":"2024-05-09T09:54:03.435048+0000","last_peered":"2024-05-09T09:54:03.435048+0000","last_clean":"2024-05-09T09:54:03.435048+0000","last_became_active":"2024-05-09T09:53:28.760362+0000","last_became_peered":"2024-05-09T09:53:28.760362+0000","last_unstale":"2024-05-09T09:54:03.435048+0000","last_undegraded":"2024-05-09T09:54:03.435048+0000","last_fullsized":"2024-05-09T09:54:03.435048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:38:13.251841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.223638+0000","last_change":"2024-05-09T09:53:28.771994+0000","last_active":"2024-05-09T09:54:04.223638+0000","last_peered":"2024-05-09T09:54:04.223638+0000","last_clean":"2024-05-09T09:54:04.223638+0000","last_became_active":"2024-05-09T09:53:28.771491+0000","last_became_peered":"2024-05-09T09:53:28.771491+0000","last_unstale":"2024-05-09T09:54:04.223638+0000","last_undegraded":"2024-05-09T09:54:04.223638+0000","last_fullsized":"2024-05-09T09:54:04.223638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:32:58.387203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271328+0000","last_change":"2024-05-09T09:53:28.752919+0000","last_active":"2024-05-09T09:54:04.271328+0000","last_peered":"2024-05-09T09:54:04.271328+0000","last_clean":"2024-05-09T09:54:04.271328+0000","last_became_active":"2024-05-09T09:53:28.752541+0000","last_became_peered":"2024-05-09T09:53:28.752541+0000","last_unstale":"2024-05-09T09:54:04.271328+0000","last_undegraded":"2024-05-09T09:54:04.271328+0000","last_fullsized":"2024-05-09T09:54:04.271328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:00.224275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.575277+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:54:03.575277+0000","last_peered":"2024-05-09T09:54:03.575277+0000","last_clean":"2024-05-09T09:54:03.575277+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:54:03.575277+0000","last_undegraded":"2024-05-09T09:54:03.575277+0000","last_fullsized":"2024-05-09T09:54:03.575277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.207201+0000","last_change":"2024-05-09T09:53:13.139707+0000","last_active":"2024-05-09T09:54:03.207201+0000","last_peered":"2024-05-09T09:54:03.207201+0000","last_clean":"2024-05-09T09:54:03.207201+0000","last_became_active":"2024-05-09T09:53:13.138048+0000","last_became_peered":"2024-05-09T09:53:13.138048+0000","last_unstale":"2024-05-09T09:54:03.207201+0000","last_undegraded":"2024-05-09T09:54:03.207201+0000","last_fullsized":"2024-05-09T09:54:03.207201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:54.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202989+0000","last_change":"2024-05-09T09:53:15.173268+0000","last_active":"2024-05-09T09:54:03.202989+0000","last_peered":"2024-05-09T09:54:03.202989+0000","last_clean":"2024-05-09T09:54:03.202989+0000","last_became_active":"2024-05-09T09:53:15.172435+0000","last_became_peered":"2024-05-09T09:53:15.172435+0000","last_unstale":"2024-05-09T09:54:03.202989+0000","last_undegraded":"2024-05-09T09:54:03.202989+0000","last_fullsized":"2024-05-09T09:54:03.202989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:04.426998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":53,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321198+0000","last_change":"2024-05-09T09:53:28.742191+0000","last_active":"2024-05-09T09:54:03.321198+0000","last_peered":"2024-05-09T09:54:03.321198+0000","last_clean":"2024-05-09T09:54:03.321198+0000","last_became_active":"2024-05-09T09:53:28.741539+0000","last_became_peered":"2024-05-09T09:53:28.741539+0000","last_unstale":"2024-05-09T09:54:03.321198+0000","last_undegraded":"2024-05-09T09:54:03.321198+0000","last_fullsized":"2024-05-09T09:54:03.321198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:28.614319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320533+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:54:03.320533+0000","last_peered":"2024-05-09T09:54:03.320533+0000","last_clean":"2024-05-09T09:54:03.320533+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:54:03.320533+0000","last_undegraded":"2024-05-09T09:54:03.320533+0000","last_fullsized":"2024-05-09T09:54:03.320533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270526+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:54:04.270526+0000","last_peered":"2024-05-09T09:54:04.270526+0000","last_clean":"2024-05-09T09:54:04.270526+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:54:04.270526+0000","last_undegraded":"2024-05-09T09:54:04.270526+0000","last_fullsized":"2024-05-09T09:54:04.270526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574237+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:54:03.574237+0000","last_peered":"2024-05-09T09:54:03.574237+0000","last_clean":"2024-05-09T09:54:03.574237+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:54:03.574237+0000","last_undegraded":"2024-05-09T09:54:03.574237+0000","last_fullsized":"2024-05-09T09:54:03.574237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":83,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269097+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:54:04.269097+0000","last_peered":"2024-05-09T09:54:04.269097+0000","last_clean":"2024-05-09T09:54:04.269097+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:54:04.269097+0000","last_undegraded":"2024-05-09T09:54:04.269097+0000","last_fullsized":"2024-05-09T09:54:04.269097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216492+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:54:04.216492+0000","last_peered":"2024-05-09T09:54:04.216492+0000","last_clean":"2024-05-09T09:54:04.216492+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:54:04.216492+0000","last_undegraded":"2024-05-09T09:54:04.216492+0000","last_fullsized":"2024-05-09T09:54:04.216492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219576+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:54:04.219576+0000","last_peered":"2024-05-09T09:54:04.219576+0000","last_clean":"2024-05-09T09:54:04.219576+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:54:04.219576+0000","last_undegraded":"2024-05-09T09:54:04.219576+0000","last_fullsized":"2024-05-09T09:54:04.219576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218120+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:54:04.218120+0000","last_peered":"2024-05-09T09:54:04.218120+0000","last_clean":"2024-05-09T09:54:04.218120+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:54:04.218120+0000","last_undegraded":"2024-05-09T09:54:04.218120+0000","last_fullsized":"2024-05-09T09:54:04.218120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433645+0000","last_change":"2024-05-09T09:53:07.121861+0000","last_active":"2024-05-09T09:54:03.433645+0000","last_peered":"2024-05-09T09:54:03.433645+0000","last_clean":"2024-05-09T09:54:03.433645+0000","last_became_active":"2024-05-09T09:53:07.117776+0000","last_became_peered":"2024-05-09T09:53:07.117776+0000","last_unstale":"2024-05-09T09:54:03.433645+0000","last_undegraded":"2024-05-09T09:54:03.433645+0000","last_fullsized":"2024-05-09T09:54:03.433645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:31.804009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573699+0000","last_change":"2024-05-09T09:53:28.782906+0000","last_active":"2024-05-09T09:54:03.573699+0000","last_peered":"2024-05-09T09:54:03.573699+0000","last_clean":"2024-05-09T09:54:03.573699+0000","last_became_active":"2024-05-09T09:53:28.782399+0000","last_became_peered":"2024-05-09T09:53:28.782399+0000","last_unstale":"2024-05-09T09:54:03.573699+0000","last_undegraded":"2024-05-09T09:54:03.573699+0000","last_fullsized":"2024-05-09T09:54:03.573699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:01.845355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216723+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:54:04.216723+0000","last_peered":"2024-05-09T09:54:04.216723+0000","last_clean":"2024-05-09T09:54:04.216723+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:54:04.216723+0000","last_undegraded":"2024-05-09T09:54:04.216723+0000","last_fullsized":"2024-05-09T09:54:04.216723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.575140+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:54:03.575140+0000","last_peered":"2024-05-09T09:54:03.575140+0000","last_clean":"2024-05-09T09:54:03.575140+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:54:03.575140+0000","last_undegraded":"2024-05-09T09:54:03.575140+0000","last_fullsized":"2024-05-09T09:54:03.575140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220787+0000","last_change":"2024-05-09T09:53:17.180823+0000","last_active":"2024-05-09T09:54:04.220787+0000","last_peered":"2024-05-09T09:54:04.220787+0000","last_clean":"2024-05-09T09:54:04.220787+0000","last_became_active":"2024-05-09T09:53:17.180037+0000","last_became_peered":"2024-05-09T09:53:17.180037+0000","last_unstale":"2024-05-09T09:54:04.220787+0000","last_undegraded":"2024-05-09T09:54:04.220787+0000","last_fullsized":"2024-05-09T09:54:04.220787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:18.049912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202310+0000","last_change":"2024-05-09T09:53:28.750006+0000","last_active":"2024-05-09T09:54:03.202310+0000","last_peered":"2024-05-09T09:54:03.202310+0000","last_clean":"2024-05-09T09:54:03.202310+0000","last_became_active":"2024-05-09T09:53:28.746020+0000","last_became_peered":"2024-05-09T09:53:28.746020+0000","last_unstale":"2024-05-09T09:54:03.202310+0000","last_undegraded":"2024-05-09T09:54:03.202310+0000","last_fullsized":"2024-05-09T09:54:03.202310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:24.373466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203609+0000","last_change":"2024-05-09T09:53:07.104902+0000","last_active":"2024-05-09T09:54:03.203609+0000","last_peered":"2024-05-09T09:54:03.203609+0000","last_clean":"2024-05-09T09:54:03.203609+0000","last_became_active":"2024-05-09T09:53:07.102780+0000","last_became_peered":"2024-05-09T09:53:07.102780+0000","last_unstale":"2024-05-09T09:54:03.203609+0000","last_undegraded":"2024-05-09T09:54:03.203609+0000","last_fullsized":"2024-05-09T09:54:03.203609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573064+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:54:03.573064+0000","last_peered":"2024-05-09T09:54:03.573064+0000","last_clean":"2024-05-09T09:54:03.573064+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:54:03.573064+0000","last_undegraded":"2024-05-09T09:54:03.573064+0000","last_fullsized":"2024-05-09T09:54:03.573064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":94,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218550+0000","last_change":"2024-05-09T09:53:28.801179+0000","last_active":"2024-05-09T09:54:04.218550+0000","last_peered":"2024-05-09T09:54:04.218550+0000","last_clean":"2024-05-09T09:54:04.218550+0000","last_became_active":"2024-05-09T09:53:28.754551+0000","last_became_peered":"2024-05-09T09:53:28.754551+0000","last_unstale":"2024-05-09T09:54:04.218550+0000","last_undegraded":"2024-05-09T09:54:04.218550+0000","last_fullsized":"2024-05-09T09:54:04.218550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:58.465410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220061+0000","last_change":"2024-05-09T09:53:15.165179+0000","last_active":"2024-05-09T09:54:04.220061+0000","last_peered":"2024-05-09T09:54:04.220061+0000","last_clean":"2024-05-09T09:54:04.220061+0000","last_became_active":"2024-05-09T09:53:15.164441+0000","last_became_peered":"2024-05-09T09:53:15.164441+0000","last_unstale":"2024-05-09T09:54:04.220061+0000","last_undegraded":"2024-05-09T09:54:04.220061+0000","last_fullsized":"2024-05-09T09:54:04.220061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:48.243582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206230+0000","last_change":"2024-05-09T09:53:17.191808+0000","last_active":"2024-05-09T09:54:03.206230+0000","last_peered":"2024-05-09T09:54:03.206230+0000","last_clean":"2024-05-09T09:54:03.206230+0000","last_became_active":"2024-05-09T09:53:17.191148+0000","last_became_peered":"2024-05-09T09:53:17.191148+0000","last_unstale":"2024-05-09T09:54:03.206230+0000","last_undegraded":"2024-05-09T09:54:03.206230+0000","last_fullsized":"2024-05-09T09:54:03.206230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:36.468016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574439+0000","last_change":"2024-05-09T09:53:28.762435+0000","last_active":"2024-05-09T09:54:03.574439+0000","last_peered":"2024-05-09T09:54:03.574439+0000","last_clean":"2024-05-09T09:54:03.574439+0000","last_became_active":"2024-05-09T09:53:28.760397+0000","last_became_peered":"2024-05-09T09:53:28.760397+0000","last_unstale":"2024-05-09T09:54:03.574439+0000","last_undegraded":"2024-05-09T09:54:03.574439+0000","last_fullsized":"2024-05-09T09:54:03.574439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:12.839880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320783+0000","last_change":"2024-05-09T09:53:28.755939+0000","last_active":"2024-05-09T09:54:03.320783+0000","last_peered":"2024-05-09T09:54:03.320783+0000","last_clean":"2024-05-09T09:54:03.320783+0000","last_became_active":"2024-05-09T09:53:28.755617+0000","last_became_peered":"2024-05-09T09:53:28.755617+0000","last_unstale":"2024-05-09T09:54:03.320783+0000","last_undegraded":"2024-05-09T09:54:03.320783+0000","last_fullsized":"2024-05-09T09:54:03.320783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:48.530850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216737+0000","last_change":"2024-05-09T09:53:28.768514+0000","last_active":"2024-05-09T09:54:04.216737+0000","last_peered":"2024-05-09T09:54:04.216737+0000","last_clean":"2024-05-09T09:54:04.216737+0000","last_became_active":"2024-05-09T09:53:28.768249+0000","last_became_peered":"2024-05-09T09:53:28.768249+0000","last_unstale":"2024-05-09T09:54:04.216737+0000","last_undegraded":"2024-05-09T09:54:04.216737+0000","last_fullsized":"2024-05-09T09:54:04.216737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:00.329546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":81,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574908+0000","last_change":"2024-05-09T09:53:13.139144+0000","last_active":"2024-05-09T09:54:03.574908+0000","last_peered":"2024-05-09T09:54:03.574908+0000","last_clean":"2024-05-09T09:54:03.574908+0000","last_became_active":"2024-05-09T09:53:13.138683+0000","last_became_peered":"2024-05-09T09:53:13.138683+0000","last_unstale":"2024-05-09T09:54:03.574908+0000","last_undegraded":"2024-05-09T09:54:03.574908+0000","last_fullsized":"2024-05-09T09:54:03.574908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:36.290227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573271+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:54:03.573271+0000","last_peered":"2024-05-09T09:54:03.573271+0000","last_clean":"2024-05-09T09:54:03.573271+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:54:03.573271+0000","last_undegraded":"2024-05-09T09:54:03.573271+0000","last_fullsized":"2024-05-09T09:54:03.573271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.221183+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:54:04.221183+0000","last_peered":"2024-05-09T09:54:04.221183+0000","last_clean":"2024-05-09T09:54:04.221183+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:54:04.221183+0000","last_undegraded":"2024-05-09T09:54:04.221183+0000","last_fullsized":"2024-05-09T09:54:04.221183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321372+0000","last_change":"2024-05-09T09:53:28.758902+0000","last_active":"2024-05-09T09:54:03.321372+0000","last_peered":"2024-05-09T09:54:03.321372+0000","last_clean":"2024-05-09T09:54:03.321372+0000","last_became_active":"2024-05-09T09:53:28.758540+0000","last_became_peered":"2024-05-09T09:53:28.758540+0000","last_unstale":"2024-05-09T09:54:03.321372+0000","last_undegraded":"2024-05-09T09:54:03.321372+0000","last_fullsized":"2024-05-09T09:54:03.321372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:27:47.363363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573111+0000","last_change":"2024-05-09T09:53:28.752743+0000","last_active":"2024-05-09T09:54:03.573111+0000","last_peered":"2024-05-09T09:54:03.573111+0000","last_clean":"2024-05-09T09:54:03.573111+0000","last_became_active":"2024-05-09T09:53:28.751727+0000","last_became_peered":"2024-05-09T09:53:28.751727+0000","last_unstale":"2024-05-09T09:54:03.573111+0000","last_undegraded":"2024-05-09T09:54:03.573111+0000","last_fullsized":"2024-05-09T09:54:03.573111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:02.196032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436339+0000","last_change":"2024-05-09T09:53:28.771015+0000","last_active":"2024-05-09T09:54:03.436339+0000","last_peered":"2024-05-09T09:54:03.436339+0000","last_clean":"2024-05-09T09:54:03.436339+0000","last_became_active":"2024-05-09T09:53:28.748303+0000","last_became_peered":"2024-05-09T09:53:28.748303+0000","last_unstale":"2024-05-09T09:54:03.436339+0000","last_undegraded":"2024-05-09T09:54:03.436339+0000","last_fullsized":"2024-05-09T09:54:03.436339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:38.716671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201887+0000","last_change":"2024-05-09T09:53:13.149070+0000","last_active":"2024-05-09T09:54:03.201887+0000","last_peered":"2024-05-09T09:54:03.201887+0000","last_clean":"2024-05-09T09:54:03.201887+0000","last_became_active":"2024-05-09T09:53:13.148617+0000","last_became_peered":"2024-05-09T09:53:13.148617+0000","last_unstale":"2024-05-09T09:54:03.201887+0000","last_undegraded":"2024-05-09T09:54:03.201887+0000","last_fullsized":"2024-05-09T09:54:03.201887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:38.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321500+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:54:03.321500+0000","last_peered":"2024-05-09T09:54:03.321500+0000","last_clean":"2024-05-09T09:54:03.321500+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:54:03.321500+0000","last_undegraded":"2024-05-09T09:54:03.321500+0000","last_fullsized":"2024-05-09T09:54:03.321500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217199+0000","last_change":"2024-05-09T09:53:28.775511+0000","last_active":"2024-05-09T09:54:04.217199+0000","last_peered":"2024-05-09T09:54:04.217199+0000","last_clean":"2024-05-09T09:54:04.217199+0000","last_became_active":"2024-05-09T09:53:28.773612+0000","last_became_peered":"2024-05-09T09:53:28.773612+0000","last_unstale":"2024-05-09T09:54:04.217199+0000","last_undegraded":"2024-05-09T09:54:04.217199+0000","last_fullsized":"2024-05-09T09:54:04.217199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:05.916196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220177+0000","last_change":"2024-05-09T09:53:09.110661+0000","last_active":"2024-05-09T09:54:04.220177+0000","last_peered":"2024-05-09T09:54:04.220177+0000","last_clean":"2024-05-09T09:54:04.220177+0000","last_became_active":"2024-05-09T09:53:09.110341+0000","last_became_peered":"2024-05-09T09:53:09.110341+0000","last_unstale":"2024-05-09T09:54:04.220177+0000","last_undegraded":"2024-05-09T09:54:04.220177+0000","last_fullsized":"2024-05-09T09:54:04.220177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205649+0000","last_change":"2024-05-09T09:53:07.106510+0000","last_active":"2024-05-09T09:54:03.205649+0000","last_peered":"2024-05-09T09:54:03.205649+0000","last_clean":"2024-05-09T09:54:03.205649+0000","last_became_active":"2024-05-09T09:53:07.106159+0000","last_became_peered":"2024-05-09T09:53:07.106159+0000","last_unstale":"2024-05-09T09:54:03.205649+0000","last_undegraded":"2024-05-09T09:54:03.205649+0000","last_fullsized":"2024-05-09T09:54:03.205649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435888+0000","last_change":"2024-05-09T09:53:28.778309+0000","last_active":"2024-05-09T09:54:03.435888+0000","last_peered":"2024-05-09T09:54:03.435888+0000","last_clean":"2024-05-09T09:54:03.435888+0000","last_became_active":"2024-05-09T09:53:28.777865+0000","last_became_peered":"2024-05-09T09:53:28.777865+0000","last_unstale":"2024-05-09T09:54:03.435888+0000","last_undegraded":"2024-05-09T09:54:03.435888+0000","last_fullsized":"2024-05-09T09:54:03.435888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:19:44.556837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":84,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436223+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:54:03.436223+0000","last_peered":"2024-05-09T09:54:03.436223+0000","last_clean":"2024-05-09T09:54:03.436223+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:54:03.436223+0000","last_undegraded":"2024-05-09T09:54:03.436223+0000","last_fullsized":"2024-05-09T09:54:03.436223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320193+0000","last_change":"2024-05-09T09:53:15.172479+0000","last_active":"2024-05-09T09:54:03.320193+0000","last_peered":"2024-05-09T09:54:03.320193+0000","last_clean":"2024-05-09T09:54:03.320193+0000","last_became_active":"2024-05-09T09:53:15.171668+0000","last_became_peered":"2024-05-09T09:53:15.171668+0000","last_unstale":"2024-05-09T09:54:03.320193+0000","last_undegraded":"2024-05-09T09:54:03.320193+0000","last_fullsized":"2024-05-09T09:54:03.320193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:10.247676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220883+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:54:04.220883+0000","last_peered":"2024-05-09T09:54:04.220883+0000","last_clean":"2024-05-09T09:54:04.220883+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:54:04.220883+0000","last_undegraded":"2024-05-09T09:54:04.220883+0000","last_fullsized":"2024-05-09T09:54:04.220883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321824+0000","last_change":"2024-05-09T09:53:28.743912+0000","last_active":"2024-05-09T09:54:03.321824+0000","last_peered":"2024-05-09T09:54:03.321824+0000","last_clean":"2024-05-09T09:54:03.321824+0000","last_became_active":"2024-05-09T09:53:28.743471+0000","last_became_peered":"2024-05-09T09:53:28.743471+0000","last_unstale":"2024-05-09T09:54:03.321824+0000","last_undegraded":"2024-05-09T09:54:03.321824+0000","last_fullsized":"2024-05-09T09:54:03.321824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:05.292436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269317+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:54:04.269317+0000","last_peered":"2024-05-09T09:54:04.269317+0000","last_clean":"2024-05-09T09:54:04.269317+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:54:04.269317+0000","last_undegraded":"2024-05-09T09:54:04.269317+0000","last_fullsized":"2024-05-09T09:54:04.269317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435233+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:54:03.435233+0000","last_peered":"2024-05-09T09:54:03.435233+0000","last_clean":"2024-05-09T09:54:03.435233+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:54:03.435233+0000","last_undegraded":"2024-05-09T09:54:03.435233+0000","last_fullsized":"2024-05-09T09:54:03.435233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202634+0000","last_change":"2024-05-09T09:53:07.133344+0000","last_active":"2024-05-09T09:54:03.202634+0000","last_peered":"2024-05-09T09:54:03.202634+0000","last_clean":"2024-05-09T09:54:03.202634+0000","last_became_active":"2024-05-09T09:53:07.132983+0000","last_became_peered":"2024-05-09T09:53:07.132983+0000","last_unstale":"2024-05-09T09:54:03.202634+0000","last_undegraded":"2024-05-09T09:54:03.202634+0000","last_fullsized":"2024-05-09T09:54:03.202634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269856+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:54:04.269856+0000","last_peered":"2024-05-09T09:54:04.269856+0000","last_clean":"2024-05-09T09:54:04.269856+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:54:04.269856+0000","last_undegraded":"2024-05-09T09:54:04.269856+0000","last_fullsized":"2024-05-09T09:54:04.269856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":83,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436479+0000","last_change":"2024-05-09T09:53:13.142914+0000","last_active":"2024-05-09T09:54:03.436479+0000","last_peered":"2024-05-09T09:54:03.436479+0000","last_clean":"2024-05-09T09:54:03.436479+0000","last_became_active":"2024-05-09T09:53:13.142158+0000","last_became_peered":"2024-05-09T09:53:13.142158+0000","last_unstale":"2024-05-09T09:54:03.436479+0000","last_undegraded":"2024-05-09T09:54:03.436479+0000","last_fullsized":"2024-05-09T09:54:03.436479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:07:08.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219499+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:54:04.219499+0000","last_peered":"2024-05-09T09:54:04.219499+0000","last_clean":"2024-05-09T09:54:04.219499+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:54:04.219499+0000","last_undegraded":"2024-05-09T09:54:04.219499+0000","last_fullsized":"2024-05-09T09:54:04.219499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319780+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:54:03.319780+0000","last_peered":"2024-05-09T09:54:03.319780+0000","last_clean":"2024-05-09T09:54:03.319780+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:54:03.319780+0000","last_undegraded":"2024-05-09T09:54:03.319780+0000","last_fullsized":"2024-05-09T09:54:03.319780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219228+0000","last_change":"2024-05-09T09:53:54.476843+0000","last_active":"2024-05-09T09:54:04.219228+0000","last_peered":"2024-05-09T09:54:04.219228+0000","last_clean":"2024-05-09T09:54:04.219228+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:54:04.219228+0000","last_undegraded":"2024-05-09T09:54:04.219228+0000","last_fullsized":"2024-05-09T09:54:04.219228+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:48.486905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269027+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:54:04.269027+0000","last_peered":"2024-05-09T09:54:04.269027+0000","last_clean":"2024-05-09T09:54:04.269027+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:54:04.269027+0000","last_undegraded":"2024-05-09T09:54:04.269027+0000","last_fullsized":"2024-05-09T09:54:04.269027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216810+0000","last_change":"2024-05-09T09:53:28.760440+0000","last_active":"2024-05-09T09:54:04.216810+0000","last_peered":"2024-05-09T09:54:04.216810+0000","last_clean":"2024-05-09T09:54:04.216810+0000","last_became_active":"2024-05-09T09:53:28.759582+0000","last_became_peered":"2024-05-09T09:53:28.759582+0000","last_unstale":"2024-05-09T09:54:04.216810+0000","last_undegraded":"2024-05-09T09:54:04.216810+0000","last_fullsized":"2024-05-09T09:54:04.216810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:04.160509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436934+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:54:03.436934+0000","last_peered":"2024-05-09T09:54:03.436934+0000","last_clean":"2024-05-09T09:54:03.436934+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:54:03.436934+0000","last_undegraded":"2024-05-09T09:54:03.436934+0000","last_fullsized":"2024-05-09T09:54:03.436934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":109,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216647+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:54:04.216647+0000","last_peered":"2024-05-09T09:54:04.216647+0000","last_clean":"2024-05-09T09:54:04.216647+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:54:04.216647+0000","last_undegraded":"2024-05-09T09:54:04.216647+0000","last_fullsized":"2024-05-09T09:54:04.216647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271401+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:54:04.271401+0000","last_peered":"2024-05-09T09:54:04.271401+0000","last_clean":"2024-05-09T09:54:04.271401+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:54:04.271401+0000","last_undegraded":"2024-05-09T09:54:04.271401+0000","last_fullsized":"2024-05-09T09:54:04.271401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.223966+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:54:04.223966+0000","last_peered":"2024-05-09T09:54:04.223966+0000","last_clean":"2024-05-09T09:54:04.223966+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:54:04.223966+0000","last_undegraded":"2024-05-09T09:54:04.223966+0000","last_fullsized":"2024-05-09T09:54:04.223966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220254+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:54:04.220254+0000","last_peered":"2024-05-09T09:54:04.220254+0000","last_clean":"2024-05-09T09:54:04.220254+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:54:04.220254+0000","last_undegraded":"2024-05-09T09:54:04.220254+0000","last_fullsized":"2024-05-09T09:54:04.220254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573335+0000","last_change":"2024-05-09T09:53:01.049359+0000","last_active":"2024-05-09T09:54:03.573335+0000","last_peered":"2024-05-09T09:54:03.573335+0000","last_clean":"2024-05-09T09:54:03.573335+0000","last_became_active":"2024-05-09T09:53:01.048940+0000","last_became_peered":"2024-05-09T09:53:01.048940+0000","last_unstale":"2024-05-09T09:54:03.573335+0000","last_undegraded":"2024-05-09T09:54:03.573335+0000","last_fullsized":"2024-05-09T09:54:03.573335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.213882+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:54:04.213882+0000","last_peered":"2024-05-09T09:54:04.213882+0000","last_clean":"2024-05-09T09:54:04.213882+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:54:04.213882+0000","last_undegraded":"2024-05-09T09:54:04.213882+0000","last_fullsized":"2024-05-09T09:54:04.213882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":61,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573365+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:54:03.573365+0000","last_peered":"2024-05-09T09:54:03.573365+0000","last_clean":"2024-05-09T09:54:03.573365+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:54:03.573365+0000","last_undegraded":"2024-05-09T09:54:03.573365+0000","last_fullsized":"2024-05-09T09:54:03.573365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":89,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270991+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:54:04.270991+0000","last_peered":"2024-05-09T09:54:04.270991+0000","last_clean":"2024-05-09T09:54:04.270991+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:54:04.270991+0000","last_undegraded":"2024-05-09T09:54:04.270991+0000","last_fullsized":"2024-05-09T09:54:04.270991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217778+0000","last_change":"2024-05-09T09:53:28.759697+0000","last_active":"2024-05-09T09:54:04.217778+0000","last_peered":"2024-05-09T09:54:04.217778+0000","last_clean":"2024-05-09T09:54:04.217778+0000","last_became_active":"2024-05-09T09:53:28.754487+0000","last_became_peered":"2024-05-09T09:53:28.754487+0000","last_unstale":"2024-05-09T09:54:04.217778+0000","last_undegraded":"2024-05-09T09:54:04.217778+0000","last_fullsized":"2024-05-09T09:54:04.217778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:11:23.077295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206963+0000","last_change":"2024-05-09T09:53:28.771270+0000","last_active":"2024-05-09T09:54:03.206963+0000","last_peered":"2024-05-09T09:54:03.206963+0000","last_clean":"2024-05-09T09:54:03.206963+0000","last_became_active":"2024-05-09T09:53:28.766128+0000","last_became_peered":"2024-05-09T09:53:28.766128+0000","last_unstale":"2024-05-09T09:54:03.206963+0000","last_undegraded":"2024-05-09T09:54:03.206963+0000","last_fullsized":"2024-05-09T09:54:03.206963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:32:30.757143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216986+0000","last_change":"2024-05-09T09:53:09.108330+0000","last_active":"2024-05-09T09:54:04.216986+0000","last_peered":"2024-05-09T09:54:04.216986+0000","last_clean":"2024-05-09T09:54:04.216986+0000","last_became_active":"2024-05-09T09:53:09.107980+0000","last_became_peered":"2024-05-09T09:53:09.107980+0000","last_unstale":"2024-05-09T09:54:04.216986+0000","last_undegraded":"2024-05-09T09:54:04.216986+0000","last_fullsized":"2024-05-09T09:54:04.216986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435826+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:54:03.435826+0000","last_peered":"2024-05-09T09:54:03.435826+0000","last_clean":"2024-05-09T09:54:03.435826+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:54:03.435826+0000","last_undegraded":"2024-05-09T09:54:03.435826+0000","last_fullsized":"2024-05-09T09:54:03.435826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217860+0000","last_change":"2024-05-09T09:53:28.768510+0000","last_active":"2024-05-09T09:54:04.217860+0000","last_peered":"2024-05-09T09:54:04.217860+0000","last_clean":"2024-05-09T09:54:04.217860+0000","last_became_active":"2024-05-09T09:53:28.767365+0000","last_became_peered":"2024-05-09T09:53:28.767365+0000","last_unstale":"2024-05-09T09:54:04.217860+0000","last_undegraded":"2024-05-09T09:54:04.217860+0000","last_fullsized":"2024-05-09T09:54:04.217860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:15:29.736628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218433+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:54:04.218433+0000","last_peered":"2024-05-09T09:54:04.218433+0000","last_clean":"2024-05-09T09:54:04.218433+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:54:04.218433+0000","last_undegraded":"2024-05-09T09:54:04.218433+0000","last_fullsized":"2024-05-09T09:54:04.218433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":92,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201932+0000","last_change":"2024-05-09T09:53:28.810809+0000","last_active":"2024-05-09T09:54:03.201932+0000","last_peered":"2024-05-09T09:54:03.201932+0000","last_clean":"2024-05-09T09:54:03.201932+0000","last_became_active":"2024-05-09T09:53:28.745129+0000","last_became_peered":"2024-05-09T09:53:28.745129+0000","last_unstale":"2024-05-09T09:54:03.201932+0000","last_undegraded":"2024-05-09T09:54:03.201932+0000","last_fullsized":"2024-05-09T09:54:03.201932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:03.327328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322015+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:54:03.322015+0000","last_peered":"2024-05-09T09:54:03.322015+0000","last_clean":"2024-05-09T09:54:03.322015+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:54:03.322015+0000","last_undegraded":"2024-05-09T09:54:03.322015+0000","last_fullsized":"2024-05-09T09:54:03.322015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434069+0000","last_change":"2024-05-09T09:53:17.191919+0000","last_active":"2024-05-09T09:54:03.434069+0000","last_peered":"2024-05-09T09:54:03.434069+0000","last_clean":"2024-05-09T09:54:03.434069+0000","last_became_active":"2024-05-09T09:53:17.191273+0000","last_became_peered":"2024-05-09T09:53:17.191273+0000","last_unstale":"2024-05-09T09:54:03.434069+0000","last_undegraded":"2024-05-09T09:54:03.434069+0000","last_fullsized":"2024-05-09T09:54:03.434069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:41:14.437931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.214423+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:54:04.214423+0000","last_peered":"2024-05-09T09:54:04.214423+0000","last_clean":"2024-05-09T09:54:04.214423+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:54:04.214423+0000","last_undegraded":"2024-05-09T09:54:04.214423+0000","last_fullsized":"2024-05-09T09:54:04.214423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433656+0000","last_change":"2024-05-09T09:53:07.117502+0000","last_active":"2024-05-09T09:54:03.433656+0000","last_peered":"2024-05-09T09:54:03.433656+0000","last_clean":"2024-05-09T09:54:03.433656+0000","last_became_active":"2024-05-09T09:53:07.116656+0000","last_became_peered":"2024-05-09T09:53:07.116656+0000","last_unstale":"2024-05-09T09:54:03.433656+0000","last_undegraded":"2024-05-09T09:54:03.433656+0000","last_fullsized":"2024-05-09T09:54:03.433656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:36.827054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217203+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:54:04.217203+0000","last_peered":"2024-05-09T09:54:04.217203+0000","last_clean":"2024-05-09T09:54:04.217203+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:54:04.217203+0000","last_undegraded":"2024-05-09T09:54:04.217203+0000","last_fullsized":"2024-05-09T09:54:04.217203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217725+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:54:04.217725+0000","last_peered":"2024-05-09T09:54:04.217725+0000","last_clean":"2024-05-09T09:54:04.217725+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:54:04.217725+0000","last_undegraded":"2024-05-09T09:54:04.217725+0000","last_fullsized":"2024-05-09T09:54:04.217725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":90,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216116+0000","last_change":"2024-05-09T09:53:13.138657+0000","last_active":"2024-05-09T09:54:04.216116+0000","last_peered":"2024-05-09T09:54:04.216116+0000","last_clean":"2024-05-09T09:54:04.216116+0000","last_became_active":"2024-05-09T09:53:13.138098+0000","last_became_peered":"2024-05-09T09:53:13.138098+0000","last_unstale":"2024-05-09T09:54:04.216116+0000","last_undegraded":"2024-05-09T09:54:04.216116+0000","last_fullsized":"2024-05-09T09:54:04.216116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200175+0000","last_change":"2024-05-09T09:53:28.764677+0000","last_active":"2024-05-09T09:54:03.200175+0000","last_peered":"2024-05-09T09:54:03.200175+0000","last_clean":"2024-05-09T09:54:03.200175+0000","last_became_active":"2024-05-09T09:53:28.750831+0000","last_became_peered":"2024-05-09T09:53:28.750831+0000","last_unstale":"2024-05-09T09:54:03.200175+0000","last_undegraded":"2024-05-09T09:54:03.200175+0000","last_fullsized":"2024-05-09T09:54:03.200175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.042630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219829+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:54:04.219829+0000","last_peered":"2024-05-09T09:54:04.219829+0000","last_clean":"2024-05-09T09:54:04.219829+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:54:04.219829+0000","last_undegraded":"2024-05-09T09:54:04.219829+0000","last_fullsized":"2024-05-09T09:54:04.219829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218044+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:54:04.218044+0000","last_peered":"2024-05-09T09:54:04.218044+0000","last_clean":"2024-05-09T09:54:04.218044+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:54:04.218044+0000","last_undegraded":"2024-05-09T09:54:04.218044+0000","last_fullsized":"2024-05-09T09:54:04.218044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217059+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:54:04.217059+0000","last_peered":"2024-05-09T09:54:04.217059+0000","last_clean":"2024-05-09T09:54:04.217059+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:54:04.217059+0000","last_undegraded":"2024-05-09T09:54:04.217059+0000","last_fullsized":"2024-05-09T09:54:04.217059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270407+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:54:04.270407+0000","last_peered":"2024-05-09T09:54:04.270407+0000","last_clean":"2024-05-09T09:54:04.270407+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:54:04.270407+0000","last_undegraded":"2024-05-09T09:54:04.270407+0000","last_fullsized":"2024-05-09T09:54:04.270407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320268+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:54:03.320268+0000","last_peered":"2024-05-09T09:54:03.320268+0000","last_clean":"2024-05-09T09:54:03.320268+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:54:03.320268+0000","last_undegraded":"2024-05-09T09:54:03.320268+0000","last_fullsized":"2024-05-09T09:54:03.320268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.214235+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:54:04.214235+0000","last_peered":"2024-05-09T09:54:04.214235+0000","last_clean":"2024-05-09T09:54:04.214235+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:54:04.214235+0000","last_undegraded":"2024-05-09T09:54:04.214235+0000","last_fullsized":"2024-05-09T09:54:04.214235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434421+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:54:03.434421+0000","last_peered":"2024-05-09T09:54:03.434421+0000","last_clean":"2024-05-09T09:54:03.434421+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:54:03.434421+0000","last_undegraded":"2024-05-09T09:54:03.434421+0000","last_fullsized":"2024-05-09T09:54:03.434421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203130+0000","last_change":"2024-05-09T09:53:17.266084+0000","last_active":"2024-05-09T09:54:03.203130+0000","last_peered":"2024-05-09T09:54:03.203130+0000","last_clean":"2024-05-09T09:54:03.203130+0000","last_became_active":"2024-05-09T09:53:17.265259+0000","last_became_peered":"2024-05-09T09:53:17.265259+0000","last_unstale":"2024-05-09T09:54:03.203130+0000","last_undegraded":"2024-05-09T09:54:03.203130+0000","last_fullsized":"2024-05-09T09:54:03.203130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:37.896643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434981+0000","last_change":"2024-05-09T09:53:54.462031+0000","last_active":"2024-05-09T09:54:03.434981+0000","last_peered":"2024-05-09T09:54:03.434981+0000","last_clean":"2024-05-09T09:54:03.434981+0000","last_became_active":"2024-05-09T09:53:54.461208+0000","last_became_peered":"2024-05-09T09:53:54.461208+0000","last_unstale":"2024-05-09T09:54:03.434981+0000","last_undegraded":"2024-05-09T09:54:03.434981+0000","last_fullsized":"2024-05-09T09:54:03.434981+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.406756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202627+0000","last_change":"2024-05-09T09:53:07.126817+0000","last_active":"2024-05-09T09:54:03.202627+0000","last_peered":"2024-05-09T09:54:03.202627+0000","last_clean":"2024-05-09T09:54:03.202627+0000","last_became_active":"2024-05-09T09:53:07.126401+0000","last_became_peered":"2024-05-09T09:53:07.126401+0000","last_unstale":"2024-05-09T09:54:03.202627+0000","last_undegraded":"2024-05-09T09:54:03.202627+0000","last_fullsized":"2024-05-09T09:54:03.202627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218821+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:54:04.218821+0000","last_peered":"2024-05-09T09:54:04.218821+0000","last_clean":"2024-05-09T09:54:04.218821+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:54:04.218821+0000","last_undegraded":"2024-05-09T09:54:04.218821+0000","last_fullsized":"2024-05-09T09:54:04.218821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200043+0000","last_change":"2024-05-09T09:53:28.765354+0000","last_active":"2024-05-09T09:54:03.200043+0000","last_peered":"2024-05-09T09:54:03.200043+0000","last_clean":"2024-05-09T09:54:03.200043+0000","last_became_active":"2024-05-09T09:53:28.746277+0000","last_became_peered":"2024-05-09T09:53:28.746277+0000","last_unstale":"2024-05-09T09:54:03.200043+0000","last_undegraded":"2024-05-09T09:54:03.200043+0000","last_fullsized":"2024-05-09T09:54:03.200043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:59.736713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":87,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203218+0000","last_change":"2024-05-09T09:53:28.789938+0000","last_active":"2024-05-09T09:54:03.203218+0000","last_peered":"2024-05-09T09:54:03.203218+0000","last_clean":"2024-05-09T09:54:03.203218+0000","last_became_active":"2024-05-09T09:53:28.745262+0000","last_became_peered":"2024-05-09T09:53:28.745262+0000","last_unstale":"2024-05-09T09:54:03.203218+0000","last_undegraded":"2024-05-09T09:54:03.203218+0000","last_fullsized":"2024-05-09T09:54:03.203218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:52.500998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200189+0000","last_change":"2024-05-09T09:53:15.181187+0000","last_active":"2024-05-09T09:54:03.200189+0000","last_peered":"2024-05-09T09:54:03.200189+0000","last_clean":"2024-05-09T09:54:03.200189+0000","last_became_active":"2024-05-09T09:53:15.180486+0000","last_became_peered":"2024-05-09T09:53:15.180486+0000","last_unstale":"2024-05-09T09:54:03.200189+0000","last_undegraded":"2024-05-09T09:54:03.200189+0000","last_fullsized":"2024-05-09T09:54:03.200189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:33.941331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217864+0000","last_change":"2024-05-09T09:53:17.173663+0000","last_active":"2024-05-09T09:54:04.217864+0000","last_peered":"2024-05-09T09:54:04.217864+0000","last_clean":"2024-05-09T09:54:04.217864+0000","last_became_active":"2024-05-09T09:53:17.172903+0000","last_became_peered":"2024-05-09T09:53:17.172903+0000","last_unstale":"2024-05-09T09:54:04.217864+0000","last_undegraded":"2024-05-09T09:54:04.217864+0000","last_fullsized":"2024-05-09T09:54:04.217864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:13.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434863+0000","last_change":"2024-05-09T09:53:28.746682+0000","last_active":"2024-05-09T09:54:03.434863+0000","last_peered":"2024-05-09T09:54:03.434863+0000","last_clean":"2024-05-09T09:54:03.434863+0000","last_became_active":"2024-05-09T09:53:28.745900+0000","last_became_peered":"2024-05-09T09:53:28.745900+0000","last_unstale":"2024-05-09T09:54:03.434863+0000","last_undegraded":"2024-05-09T09:54:03.434863+0000","last_fullsized":"2024-05-09T09:54:03.434863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:44.945655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219022+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:54:04.219022+0000","last_peered":"2024-05-09T09:54:04.219022+0000","last_clean":"2024-05-09T09:54:04.219022+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:54:04.219022+0000","last_undegraded":"2024-05-09T09:54:04.219022+0000","last_fullsized":"2024-05-09T09:54:04.219022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322406+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:54:03.322406+0000","last_peered":"2024-05-09T09:54:03.322406+0000","last_clean":"2024-05-09T09:54:03.322406+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:54:03.322406+0000","last_undegraded":"2024-05-09T09:54:03.322406+0000","last_fullsized":"2024-05-09T09:54:03.322406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205967+0000","last_change":"2024-05-09T09:53:11.119230+0000","last_active":"2024-05-09T09:54:03.205967+0000","last_peered":"2024-05-09T09:54:03.205967+0000","last_clean":"2024-05-09T09:54:03.205967+0000","last_became_active":"2024-05-09T09:53:11.118785+0000","last_became_peered":"2024-05-09T09:53:11.118785+0000","last_unstale":"2024-05-09T09:54:03.205967+0000","last_undegraded":"2024-05-09T09:54:03.205967+0000","last_fullsized":"2024-05-09T09:54:03.205967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:01.845355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":94,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269326+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:54:04.269326+0000","last_peered":"2024-05-09T09:54:04.269326+0000","last_clean":"2024-05-09T09:54:04.269326+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:54:04.269326+0000","last_undegraded":"2024-05-09T09:54:04.269326+0000","last_fullsized":"2024-05-09T09:54:04.269326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202865+0000","last_change":"2024-05-09T09:53:15.168489+0000","last_active":"2024-05-09T09:54:03.202865+0000","last_peered":"2024-05-09T09:54:03.202865+0000","last_clean":"2024-05-09T09:54:03.202865+0000","last_became_active":"2024-05-09T09:53:15.167829+0000","last_became_peered":"2024-05-09T09:53:15.167829+0000","last_unstale":"2024-05-09T09:54:03.202865+0000","last_undegraded":"2024-05-09T09:54:03.202865+0000","last_fullsized":"2024-05-09T09:54:03.202865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:27:00.491112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435329+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:54:03.435329+0000","last_peered":"2024-05-09T09:54:03.435329+0000","last_clean":"2024-05-09T09:54:03.435329+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:54:03.435329+0000","last_undegraded":"2024-05-09T09:54:03.435329+0000","last_fullsized":"2024-05-09T09:54:03.435329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218549+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:54:04.218549+0000","last_peered":"2024-05-09T09:54:04.218549+0000","last_clean":"2024-05-09T09:54:04.218549+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:54:04.218549+0000","last_undegraded":"2024-05-09T09:54:04.218549+0000","last_fullsized":"2024-05-09T09:54:04.218549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320916+0000","last_change":"2024-05-09T09:53:28.758299+0000","last_active":"2024-05-09T09:54:03.320916+0000","last_peered":"2024-05-09T09:54:03.320916+0000","last_clean":"2024-05-09T09:54:03.320916+0000","last_became_active":"2024-05-09T09:53:28.757819+0000","last_became_peered":"2024-05-09T09:53:28.757819+0000","last_unstale":"2024-05-09T09:54:03.320916+0000","last_undegraded":"2024-05-09T09:54:03.320916+0000","last_fullsized":"2024-05-09T09:54:03.320916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:41.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270119+0000","last_change":"2024-05-09T09:53:28.744175+0000","last_active":"2024-05-09T09:54:04.270119+0000","last_peered":"2024-05-09T09:54:04.270119+0000","last_clean":"2024-05-09T09:54:04.270119+0000","last_became_active":"2024-05-09T09:53:28.743783+0000","last_became_peered":"2024-05-09T09:53:28.743783+0000","last_unstale":"2024-05-09T09:54:04.270119+0000","last_undegraded":"2024-05-09T09:54:04.270119+0000","last_fullsized":"2024-05-09T09:54:04.270119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:03.321447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.213885+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:54:04.213885+0000","last_peered":"2024-05-09T09:54:04.213885+0000","last_clean":"2024-05-09T09:54:04.213885+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:54:04.213885+0000","last_undegraded":"2024-05-09T09:54:04.213885+0000","last_fullsized":"2024-05-09T09:54:04.213885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.199925+0000","last_change":"2024-05-09T09:53:13.138669+0000","last_active":"2024-05-09T09:54:03.199925+0000","last_peered":"2024-05-09T09:54:03.199925+0000","last_clean":"2024-05-09T09:54:03.199925+0000","last_became_active":"2024-05-09T09:53:13.137815+0000","last_became_peered":"2024-05-09T09:53:13.137815+0000","last_unstale":"2024-05-09T09:54:03.199925+0000","last_undegraded":"2024-05-09T09:54:03.199925+0000","last_fullsized":"2024-05-09T09:54:03.199925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:09.306529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205201+0000","last_change":"2024-05-09T09:53:15.180530+0000","last_active":"2024-05-09T09:54:03.205201+0000","last_peered":"2024-05-09T09:54:03.205201+0000","last_clean":"2024-05-09T09:54:03.205201+0000","last_became_active":"2024-05-09T09:53:15.179752+0000","last_became_peered":"2024-05-09T09:53:15.179752+0000","last_unstale":"2024-05-09T09:54:03.205201+0000","last_undegraded":"2024-05-09T09:54:03.205201+0000","last_fullsized":"2024-05-09T09:54:03.205201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:14.853148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201659+0000","last_change":"2024-05-09T09:53:17.186939+0000","last_active":"2024-05-09T09:54:03.201659+0000","last_peered":"2024-05-09T09:54:03.201659+0000","last_clean":"2024-05-09T09:54:03.201659+0000","last_became_active":"2024-05-09T09:53:17.186138+0000","last_became_peered":"2024-05-09T09:53:17.186138+0000","last_unstale":"2024-05-09T09:54:03.201659+0000","last_undegraded":"2024-05-09T09:54:03.201659+0000","last_fullsized":"2024-05-09T09:54:03.201659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:52.756156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.214496+0000","last_change":"2024-05-09T09:53:09.116139+0000","last_active":"2024-05-09T09:54:04.214496+0000","last_peered":"2024-05-09T09:54:04.214496+0000","last_clean":"2024-05-09T09:54:04.214496+0000","last_became_active":"2024-05-09T09:53:09.115542+0000","last_became_peered":"2024-05-09T09:53:09.115542+0000","last_unstale":"2024-05-09T09:54:04.214496+0000","last_undegraded":"2024-05-09T09:54:04.214496+0000","last_fullsized":"2024-05-09T09:54:04.214496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:18.060153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270566+0000","last_change":"2024-05-09T09:53:07.123261+0000","last_active":"2024-05-09T09:54:04.270566+0000","last_peered":"2024-05-09T09:54:04.270566+0000","last_clean":"2024-05-09T09:54:04.270566+0000","last_became_active":"2024-05-09T09:53:07.122491+0000","last_became_peered":"2024-05-09T09:53:07.122491+0000","last_unstale":"2024-05-09T09:54:04.270566+0000","last_undegraded":"2024-05-09T09:54:04.270566+0000","last_fullsized":"2024-05-09T09:54:04.270566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:31.417620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206845+0000","last_change":"2024-05-09T09:53:11.117544+0000","last_active":"2024-05-09T09:54:03.206845+0000","last_peered":"2024-05-09T09:54:03.206845+0000","last_clean":"2024-05-09T09:54:03.206845+0000","last_became_active":"2024-05-09T09:53:11.116890+0000","last_became_peered":"2024-05-09T09:53:11.116890+0000","last_unstale":"2024-05-09T09:54:03.206845+0000","last_undegraded":"2024-05-09T09:54:03.206845+0000","last_fullsized":"2024-05-09T09:54:03.206845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:17.548338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'5","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.215972+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:54:04.215972+0000","last_peered":"2024-05-09T09:54:04.215972+0000","last_clean":"2024-05-09T09:54:04.215972+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:54:04.215972+0000","last_undegraded":"2024-05-09T09:54:04.215972+0000","last_fullsized":"2024-05-09T09:54:04.215972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269664+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:54:04.269664+0000","last_peered":"2024-05-09T09:54:04.269664+0000","last_clean":"2024-05-09T09:54:04.269664+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:54:04.269664+0000","last_undegraded":"2024-05-09T09:54:04.269664+0000","last_fullsized":"2024-05-09T09:54:04.269664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218332+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:54:04.218332+0000","last_peered":"2024-05-09T09:54:04.218332+0000","last_clean":"2024-05-09T09:54:04.218332+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:54:04.218332+0000","last_undegraded":"2024-05-09T09:54:04.218332+0000","last_fullsized":"2024-05-09T09:54:04.218332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201035+0000","last_change":"2024-05-09T09:53:09.136473+0000","last_active":"2024-05-09T09:54:03.201035+0000","last_peered":"2024-05-09T09:54:03.201035+0000","last_clean":"2024-05-09T09:54:03.201035+0000","last_became_active":"2024-05-09T09:53:09.136201+0000","last_became_peered":"2024-05-09T09:53:09.136201+0000","last_unstale":"2024-05-09T09:54:03.201035+0000","last_undegraded":"2024-05-09T09:54:03.201035+0000","last_fullsized":"2024-05-09T09:54:03.201035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436044+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:54:03.436044+0000","last_peered":"2024-05-09T09:54:03.436044+0000","last_clean":"2024-05-09T09:54:03.436044+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:54:03.436044+0000","last_undegraded":"2024-05-09T09:54:03.436044+0000","last_fullsized":"2024-05-09T09:54:03.436044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":73,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268438+0000","last_change":"2024-05-09T09:53:28.749167+0000","last_active":"2024-05-09T09:54:04.268438+0000","last_peered":"2024-05-09T09:54:04.268438+0000","last_clean":"2024-05-09T09:54:04.268438+0000","last_became_active":"2024-05-09T09:53:28.739510+0000","last_became_peered":"2024-05-09T09:53:28.739510+0000","last_unstale":"2024-05-09T09:54:04.268438+0000","last_undegraded":"2024-05-09T09:54:04.268438+0000","last_fullsized":"2024-05-09T09:54:04.268438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:42.520109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206608+0000","last_change":"2024-05-09T09:53:13.143103+0000","last_active":"2024-05-09T09:54:03.206608+0000","last_peered":"2024-05-09T09:54:03.206608+0000","last_clean":"2024-05-09T09:54:03.206608+0000","last_became_active":"2024-05-09T09:53:13.142107+0000","last_became_peered":"2024-05-09T09:53:13.142107+0000","last_unstale":"2024-05-09T09:54:03.206608+0000","last_undegraded":"2024-05-09T09:54:03.206608+0000","last_fullsized":"2024-05-09T09:54:03.206608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:38.201518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320063+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:54:03.320063+0000","last_peered":"2024-05-09T09:54:03.320063+0000","last_clean":"2024-05-09T09:54:03.320063+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:54:03.320063+0000","last_undegraded":"2024-05-09T09:54:03.320063+0000","last_fullsized":"2024-05-09T09:54:03.320063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434737+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:54:03.434737+0000","last_peered":"2024-05-09T09:54:03.434737+0000","last_clean":"2024-05-09T09:54:03.434737+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:54:03.434737+0000","last_undegraded":"2024-05-09T09:54:03.434737+0000","last_fullsized":"2024-05-09T09:54:03.434737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205792+0000","last_change":"2024-05-09T09:53:09.113837+0000","last_active":"2024-05-09T09:54:03.205792+0000","last_peered":"2024-05-09T09:54:03.205792+0000","last_clean":"2024-05-09T09:54:03.205792+0000","last_became_active":"2024-05-09T09:53:09.113332+0000","last_became_peered":"2024-05-09T09:53:09.113332+0000","last_unstale":"2024-05-09T09:54:03.205792+0000","last_undegraded":"2024-05-09T09:54:03.205792+0000","last_fullsized":"2024-05-09T09:54:03.205792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220427+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:54:04.220427+0000","last_peered":"2024-05-09T09:54:04.220427+0000","last_clean":"2024-05-09T09:54:04.220427+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:54:04.220427+0000","last_undegraded":"2024-05-09T09:54:04.220427+0000","last_fullsized":"2024-05-09T09:54:04.220427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320467+0000","last_change":"2024-05-09T09:53:28.742646+0000","last_active":"2024-05-09T09:54:03.320467+0000","last_peered":"2024-05-09T09:54:03.320467+0000","last_clean":"2024-05-09T09:54:03.320467+0000","last_became_active":"2024-05-09T09:53:28.741146+0000","last_became_peered":"2024-05-09T09:53:28.741146+0000","last_unstale":"2024-05-09T09:54:03.320467+0000","last_undegraded":"2024-05-09T09:54:03.320467+0000","last_fullsized":"2024-05-09T09:54:03.320467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:22.885815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268854+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:54:04.268854+0000","last_peered":"2024-05-09T09:54:04.268854+0000","last_clean":"2024-05-09T09:54:04.268854+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:54:04.268854+0000","last_undegraded":"2024-05-09T09:54:04.268854+0000","last_fullsized":"2024-05-09T09:54:04.268854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217391+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:54:04.217391+0000","last_peered":"2024-05-09T09:54:04.217391+0000","last_clean":"2024-05-09T09:54:04.217391+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:54:04.217391+0000","last_undegraded":"2024-05-09T09:54:04.217391+0000","last_fullsized":"2024-05-09T09:54:04.217391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322283+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:54:03.322283+0000","last_peered":"2024-05-09T09:54:03.322283+0000","last_clean":"2024-05-09T09:54:03.322283+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:54:03.322283+0000","last_undegraded":"2024-05-09T09:54:03.322283+0000","last_fullsized":"2024-05-09T09:54:03.322283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205538+0000","last_change":"2024-05-09T09:53:07.103925+0000","last_active":"2024-05-09T09:54:03.205538+0000","last_peered":"2024-05-09T09:54:03.205538+0000","last_clean":"2024-05-09T09:54:03.205538+0000","last_became_active":"2024-05-09T09:53:07.103470+0000","last_became_peered":"2024-05-09T09:53:07.103470+0000","last_unstale":"2024-05-09T09:54:03.205538+0000","last_undegraded":"2024-05-09T09:54:03.205538+0000","last_fullsized":"2024-05-09T09:54:03.205538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219423+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:54:04.219423+0000","last_peered":"2024-05-09T09:54:04.219423+0000","last_clean":"2024-05-09T09:54:04.219423+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:54:04.219423+0000","last_undegraded":"2024-05-09T09:54:04.219423+0000","last_fullsized":"2024-05-09T09:54:04.219423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220581+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:54:04.220581+0000","last_peered":"2024-05-09T09:54:04.220581+0000","last_clean":"2024-05-09T09:54:04.220581+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:54:04.220581+0000","last_undegraded":"2024-05-09T09:54:04.220581+0000","last_fullsized":"2024-05-09T09:54:04.220581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433949+0000","last_change":"2024-05-09T09:53:15.165405+0000","last_active":"2024-05-09T09:54:03.433949+0000","last_peered":"2024-05-09T09:54:03.433949+0000","last_clean":"2024-05-09T09:54:03.433949+0000","last_became_active":"2024-05-09T09:53:15.164221+0000","last_became_peered":"2024-05-09T09:53:15.164221+0000","last_unstale":"2024-05-09T09:54:03.433949+0000","last_undegraded":"2024-05-09T09:54:03.433949+0000","last_fullsized":"2024-05-09T09:54:03.433949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:50.451431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206393+0000","last_change":"2024-05-09T09:53:17.269258+0000","last_active":"2024-05-09T09:54:03.206393+0000","last_peered":"2024-05-09T09:54:03.206393+0000","last_clean":"2024-05-09T09:54:03.206393+0000","last_became_active":"2024-05-09T09:53:17.268496+0000","last_became_peered":"2024-05-09T09:53:17.268496+0000","last_unstale":"2024-05-09T09:54:03.206393+0000","last_undegraded":"2024-05-09T09:54:03.206393+0000","last_fullsized":"2024-05-09T09:54:03.206393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:01.756096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219304+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:54:04.219304+0000","last_peered":"2024-05-09T09:54:04.219304+0000","last_clean":"2024-05-09T09:54:04.219304+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:54:04.219304+0000","last_undegraded":"2024-05-09T09:54:04.219304+0000","last_fullsized":"2024-05-09T09:54:04.219304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.223720+0000","last_change":"2024-05-09T09:53:54.475349+0000","last_active":"2024-05-09T09:54:04.223720+0000","last_peered":"2024-05-09T09:54:04.223720+0000","last_clean":"2024-05-09T09:54:04.223720+0000","last_became_active":"2024-05-09T09:53:54.474959+0000","last_became_peered":"2024-05-09T09:53:54.474959+0000","last_unstale":"2024-05-09T09:54:04.223720+0000","last_undegraded":"2024-05-09T09:54:04.223720+0000","last_fullsized":"2024-05-09T09:54:04.223720+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:26.396710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322125+0000","last_change":"2024-05-09T09:53:28.741150+0000","last_active":"2024-05-09T09:54:03.322125+0000","last_peered":"2024-05-09T09:54:03.322125+0000","last_clean":"2024-05-09T09:54:03.322125+0000","last_became_active":"2024-05-09T09:53:28.740892+0000","last_became_peered":"2024-05-09T09:53:28.740892+0000","last_unstale":"2024-05-09T09:54:03.322125+0000","last_undegraded":"2024-05-09T09:54:03.322125+0000","last_fullsized":"2024-05-09T09:54:03.322125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:26.374270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":83,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269687+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:54:04.269687+0000","last_peered":"2024-05-09T09:54:04.269687+0000","last_clean":"2024-05-09T09:54:04.269687+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:54:04.269687+0000","last_undegraded":"2024-05-09T09:54:04.269687+0000","last_fullsized":"2024-05-09T09:54:04.269687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220505+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:54:04.220505+0000","last_peered":"2024-05-09T09:54:04.220505+0000","last_clean":"2024-05-09T09:54:04.220505+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:54:04.220505+0000","last_undegraded":"2024-05-09T09:54:04.220505+0000","last_fullsized":"2024-05-09T09:54:04.220505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319757+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:54:03.319757+0000","last_peered":"2024-05-09T09:54:03.319757+0000","last_clean":"2024-05-09T09:54:03.319757+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:54:03.319757+0000","last_undegraded":"2024-05-09T09:54:03.319757+0000","last_fullsized":"2024-05-09T09:54:03.319757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203305+0000","last_change":"2024-05-09T09:53:09.113372+0000","last_active":"2024-05-09T09:54:03.203305+0000","last_peered":"2024-05-09T09:54:03.203305+0000","last_clean":"2024-05-09T09:54:03.203305+0000","last_became_active":"2024-05-09T09:53:09.113041+0000","last_became_peered":"2024-05-09T09:53:09.113041+0000","last_unstale":"2024-05-09T09:54:03.203305+0000","last_undegraded":"2024-05-09T09:54:03.203305+0000","last_fullsized":"2024-05-09T09:54:03.203305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:00.152062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.214346+0000","last_change":"2024-05-09T09:53:28.753324+0000","last_active":"2024-05-09T09:54:04.214346+0000","last_peered":"2024-05-09T09:54:04.214346+0000","last_clean":"2024-05-09T09:54:04.214346+0000","last_became_active":"2024-05-09T09:53:28.752392+0000","last_became_peered":"2024-05-09T09:53:28.752392+0000","last_unstale":"2024-05-09T09:54:04.214346+0000","last_undegraded":"2024-05-09T09:54:04.214346+0000","last_fullsized":"2024-05-09T09:54:04.214346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:32.264858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202013+0000","last_change":"2024-05-09T09:53:28.776777+0000","last_active":"2024-05-09T09:54:03.202013+0000","last_peered":"2024-05-09T09:54:03.202013+0000","last_clean":"2024-05-09T09:54:03.202013+0000","last_became_active":"2024-05-09T09:53:28.771962+0000","last_became_peered":"2024-05-09T09:53:28.771962+0000","last_unstale":"2024-05-09T09:54:03.202013+0000","last_undegraded":"2024-05-09T09:54:03.202013+0000","last_fullsized":"2024-05-09T09:54:03.202013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:14.948048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203318+0000","last_change":"2024-05-09T09:53:13.152997+0000","last_active":"2024-05-09T09:54:03.203318+0000","last_peered":"2024-05-09T09:54:03.203318+0000","last_clean":"2024-05-09T09:54:03.203318+0000","last_became_active":"2024-05-09T09:53:13.152490+0000","last_became_peered":"2024-05-09T09:53:13.152490+0000","last_unstale":"2024-05-09T09:54:03.203318+0000","last_undegraded":"2024-05-09T09:54:03.203318+0000","last_fullsized":"2024-05-09T09:54:03.203318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:45.449537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218420+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:54:04.218420+0000","last_peered":"2024-05-09T09:54:04.218420+0000","last_clean":"2024-05-09T09:54:04.218420+0000","last_became_active":"2024-05-09T09:53:15.167480+0000","last_became_peered":"2024-05-09T09:53:15.167480+0000","last_unstale":"2024-05-09T09:54:04.218420+0000","last_undegraded":"2024-05-09T09:54:04.218420+0000","last_fullsized":"2024-05-09T09:54:04.218420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:07.450989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434309+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:54:03.434309+0000","last_peered":"2024-05-09T09:54:03.434309+0000","last_clean":"2024-05-09T09:54:03.434309+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:54:03.434309+0000","last_undegraded":"2024-05-09T09:54:03.434309+0000","last_fullsized":"2024-05-09T09:54:03.434309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574439+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:54:03.574439+0000","last_peered":"2024-05-09T09:54:03.574439+0000","last_clean":"2024-05-09T09:54:03.574439+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:54:03.574439+0000","last_undegraded":"2024-05-09T09:54:03.574439+0000","last_fullsized":"2024-05-09T09:54:03.574439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217472+0000","last_change":"2024-05-09T09:53:28.761425+0000","last_active":"2024-05-09T09:54:04.217472+0000","last_peered":"2024-05-09T09:54:04.217472+0000","last_clean":"2024-05-09T09:54:04.217472+0000","last_became_active":"2024-05-09T09:53:28.761078+0000","last_became_peered":"2024-05-09T09:53:28.761078+0000","last_unstale":"2024-05-09T09:54:04.217472+0000","last_undegraded":"2024-05-09T09:54:04.217472+0000","last_fullsized":"2024-05-09T09:54:04.217472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:27.825337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220235+0000","last_change":"2024-05-09T09:53:28.769345+0000","last_active":"2024-05-09T09:54:04.220235+0000","last_peered":"2024-05-09T09:54:04.220235+0000","last_clean":"2024-05-09T09:54:04.220235+0000","last_became_active":"2024-05-09T09:53:28.769135+0000","last_became_peered":"2024-05-09T09:53:28.769135+0000","last_unstale":"2024-05-09T09:54:04.220235+0000","last_undegraded":"2024-05-09T09:54:04.220235+0000","last_fullsized":"2024-05-09T09:54:04.220235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:10.820319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":88,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321858+0000","last_change":"2024-05-09T09:53:28.776504+0000","last_active":"2024-05-09T09:54:03.321858+0000","last_peered":"2024-05-09T09:54:03.321858+0000","last_clean":"2024-05-09T09:54:03.321858+0000","last_became_active":"2024-05-09T09:53:28.743863+0000","last_became_peered":"2024-05-09T09:53:28.743863+0000","last_unstale":"2024-05-09T09:54:03.321858+0000","last_undegraded":"2024-05-09T09:54:03.321858+0000","last_fullsized":"2024-05-09T09:54:03.321858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:38.290799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"32'3","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321738+0000","last_change":"2024-05-09T09:53:28.778387+0000","last_active":"2024-05-09T09:54:03.321738+0000","last_peered":"2024-05-09T09:54:03.321738+0000","last_clean":"2024-05-09T09:54:03.321738+0000","last_became_active":"2024-05-09T09:53:28.740628+0000","last_became_peered":"2024-05-09T09:53:28.740628+0000","last_unstale":"2024-05-09T09:54:03.321738+0000","last_undegraded":"2024-05-09T09:54:03.321738+0000","last_fullsized":"2024-05-09T09:54:03.321738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:04.362375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268421+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:54:04.268421+0000","last_peered":"2024-05-09T09:54:04.268421+0000","last_clean":"2024-05-09T09:54:04.268421+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:54:04.268421+0000","last_undegraded":"2024-05-09T09:54:04.268421+0000","last_fullsized":"2024-05-09T09:54:04.268421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.207271+0000","last_change":"2024-05-09T09:53:28.770704+0000","last_active":"2024-05-09T09:54:03.207271+0000","last_peered":"2024-05-09T09:54:03.207271+0000","last_clean":"2024-05-09T09:54:03.207271+0000","last_became_active":"2024-05-09T09:53:28.765094+0000","last_became_peered":"2024-05-09T09:53:28.765094+0000","last_unstale":"2024-05-09T09:54:03.207271+0000","last_undegraded":"2024-05-09T09:54:03.207271+0000","last_fullsized":"2024-05-09T09:54:03.207271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:12.287035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574087+0000","last_change":"2024-05-09T09:53:54.471391+0000","last_active":"2024-05-09T09:54:03.574087+0000","last_peered":"2024-05-09T09:54:03.574087+0000","last_clean":"2024-05-09T09:54:03.574087+0000","last_became_active":"2024-05-09T09:53:54.471100+0000","last_became_peered":"2024-05-09T09:53:54.471100+0000","last_unstale":"2024-05-09T09:54:03.574087+0000","last_undegraded":"2024-05-09T09:54:03.574087+0000","last_fullsized":"2024-05-09T09:54:03.574087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.867000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268958+0000","last_change":"2024-05-09T09:53:28.756530+0000","last_active":"2024-05-09T09:54:04.268958+0000","last_peered":"2024-05-09T09:54:04.268958+0000","last_clean":"2024-05-09T09:54:04.268958+0000","last_became_active":"2024-05-09T09:53:28.756107+0000","last_became_peered":"2024-05-09T09:53:28.756107+0000","last_unstale":"2024-05-09T09:54:04.268958+0000","last_undegraded":"2024-05-09T09:54:04.268958+0000","last_fullsized":"2024-05-09T09:54:04.268958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:53.208895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":81,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434571+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:54:03.434571+0000","last_peered":"2024-05-09T09:54:03.434571+0000","last_clean":"2024-05-09T09:54:03.434571+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:54:03.434571+0000","last_undegraded":"2024-05-09T09:54:03.434571+0000","last_fullsized":"2024-05-09T09:54:03.434571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.215522+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:54:04.215522+0000","last_peered":"2024-05-09T09:54:04.215522+0000","last_clean":"2024-05-09T09:54:04.215522+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:54:04.215522+0000","last_undegraded":"2024-05-09T09:54:04.215522+0000","last_fullsized":"2024-05-09T09:54:04.215522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271655+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:54:04.271655+0000","last_peered":"2024-05-09T09:54:04.271655+0000","last_clean":"2024-05-09T09:54:04.271655+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:54:04.271655+0000","last_undegraded":"2024-05-09T09:54:04.271655+0000","last_fullsized":"2024-05-09T09:54:04.271655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203342+0000","last_change":"2024-05-09T09:53:28.778385+0000","last_active":"2024-05-09T09:54:03.203342+0000","last_peered":"2024-05-09T09:54:03.203342+0000","last_clean":"2024-05-09T09:54:03.203342+0000","last_became_active":"2024-05-09T09:53:28.777784+0000","last_became_peered":"2024-05-09T09:53:28.777784+0000","last_unstale":"2024-05-09T09:54:03.203342+0000","last_undegraded":"2024-05-09T09:54:03.203342+0000","last_fullsized":"2024-05-09T09:54:03.203342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:25.450368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436673+0000","last_change":"2024-05-09T09:53:28.740051+0000","last_active":"2024-05-09T09:54:03.436673+0000","last_peered":"2024-05-09T09:54:03.436673+0000","last_clean":"2024-05-09T09:54:03.436673+0000","last_became_active":"2024-05-09T09:53:28.739650+0000","last_became_peered":"2024-05-09T09:53:28.739650+0000","last_unstale":"2024-05-09T09:54:03.436673+0000","last_undegraded":"2024-05-09T09:54:03.436673+0000","last_fullsized":"2024-05-09T09:54:03.436673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:12:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434943+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:54:03.434943+0000","last_peered":"2024-05-09T09:54:03.434943+0000","last_clean":"2024-05-09T09:54:03.434943+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:54:03.434943+0000","last_undegraded":"2024-05-09T09:54:03.434943+0000","last_fullsized":"2024-05-09T09:54:03.434943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.215621+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:54:04.215621+0000","last_peered":"2024-05-09T09:54:04.215621+0000","last_clean":"2024-05-09T09:54:04.215621+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:54:04.215621+0000","last_undegraded":"2024-05-09T09:54:04.215621+0000","last_fullsized":"2024-05-09T09:54:04.215621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320068+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:54:03.320068+0000","last_peered":"2024-05-09T09:54:03.320068+0000","last_clean":"2024-05-09T09:54:03.320068+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:54:03.320068+0000","last_undegraded":"2024-05-09T09:54:03.320068+0000","last_fullsized":"2024-05-09T09:54:03.320068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201795+0000","last_change":"2024-05-09T09:53:17.266584+0000","last_active":"2024-05-09T09:54:03.201795+0000","last_peered":"2024-05-09T09:54:03.201795+0000","last_clean":"2024-05-09T09:54:03.201795+0000","last_became_active":"2024-05-09T09:53:17.265947+0000","last_became_peered":"2024-05-09T09:53:17.265947+0000","last_unstale":"2024-05-09T09:54:03.201795+0000","last_undegraded":"2024-05-09T09:54:03.201795+0000","last_fullsized":"2024-05-09T09:54:03.201795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.231815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201218+0000","last_change":"2024-05-09T09:53:09.121438+0000","last_active":"2024-05-09T09:54:03.201218+0000","last_peered":"2024-05-09T09:54:03.201218+0000","last_clean":"2024-05-09T09:54:03.201218+0000","last_became_active":"2024-05-09T09:53:09.121156+0000","last_became_peered":"2024-05-09T09:53:09.121156+0000","last_unstale":"2024-05-09T09:54:03.201218+0000","last_undegraded":"2024-05-09T09:54:03.201218+0000","last_fullsized":"2024-05-09T09:54:03.201218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:59.690822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202184+0000","last_change":"2024-05-09T09:53:07.131445+0000","last_active":"2024-05-09T09:54:03.202184+0000","last_peered":"2024-05-09T09:54:03.202184+0000","last_clean":"2024-05-09T09:54:03.202184+0000","last_became_active":"2024-05-09T09:53:07.131006+0000","last_became_peered":"2024-05-09T09:53:07.131006+0000","last_unstale":"2024-05-09T09:54:03.202184+0000","last_undegraded":"2024-05-09T09:54:03.202184+0000","last_fullsized":"2024-05-09T09:54:03.202184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319586+0000","last_change":"2024-05-09T09:53:28.756572+0000","last_active":"2024-05-09T09:54:03.319586+0000","last_peered":"2024-05-09T09:54:03.319586+0000","last_clean":"2024-05-09T09:54:03.319586+0000","last_became_active":"2024-05-09T09:53:28.756123+0000","last_became_peered":"2024-05-09T09:53:28.756123+0000","last_unstale":"2024-05-09T09:54:03.319586+0000","last_undegraded":"2024-05-09T09:54:03.319586+0000","last_fullsized":"2024-05-09T09:54:03.319586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:36.194391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.207420+0000","last_change":"2024-05-09T09:53:13.140437+0000","last_active":"2024-05-09T09:54:03.207420+0000","last_peered":"2024-05-09T09:54:03.207420+0000","last_clean":"2024-05-09T09:54:03.207420+0000","last_became_active":"2024-05-09T09:53:13.138894+0000","last_became_peered":"2024-05-09T09:53:13.138894+0000","last_unstale":"2024-05-09T09:54:03.207420+0000","last_undegraded":"2024-05-09T09:54:03.207420+0000","last_fullsized":"2024-05-09T09:54:03.207420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:14.004547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319967+0000","last_change":"2024-05-09T09:53:28.735850+0000","last_active":"2024-05-09T09:54:03.319967+0000","last_peered":"2024-05-09T09:54:03.319967+0000","last_clean":"2024-05-09T09:54:03.319967+0000","last_became_active":"2024-05-09T09:53:28.734651+0000","last_became_peered":"2024-05-09T09:53:28.734651+0000","last_unstale":"2024-05-09T09:54:03.319967+0000","last_undegraded":"2024-05-09T09:54:03.319967+0000","last_fullsized":"2024-05-09T09:54:03.319967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:07.450989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271132+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:54:04.271132+0000","last_peered":"2024-05-09T09:54:04.271132+0000","last_clean":"2024-05-09T09:54:04.271132+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:54:04.271132+0000","last_undegraded":"2024-05-09T09:54:04.271132+0000","last_fullsized":"2024-05-09T09:54:04.271132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319649+0000","last_change":"2024-05-09T09:53:28.755822+0000","last_active":"2024-05-09T09:54:03.319649+0000","last_peered":"2024-05-09T09:54:03.319649+0000","last_clean":"2024-05-09T09:54:03.319649+0000","last_became_active":"2024-05-09T09:53:28.755418+0000","last_became_peered":"2024-05-09T09:53:28.755418+0000","last_unstale":"2024-05-09T09:54:03.319649+0000","last_undegraded":"2024-05-09T09:54:03.319649+0000","last_fullsized":"2024-05-09T09:54:03.319649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:09.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220354+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:54:04.220354+0000","last_peered":"2024-05-09T09:54:04.220354+0000","last_clean":"2024-05-09T09:54:04.220354+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:54:04.220354+0000","last_undegraded":"2024-05-09T09:54:04.220354+0000","last_fullsized":"2024-05-09T09:54:04.220354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.221070+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:54:04.221070+0000","last_peered":"2024-05-09T09:54:04.221070+0000","last_clean":"2024-05-09T09:54:04.221070+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:54:04.221070+0000","last_undegraded":"2024-05-09T09:54:04.221070+0000","last_fullsized":"2024-05-09T09:54:04.221070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":87,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435356+0000","last_change":"2024-05-09T09:53:28.785207+0000","last_active":"2024-05-09T09:54:03.435356+0000","last_peered":"2024-05-09T09:54:03.435356+0000","last_clean":"2024-05-09T09:54:03.435356+0000","last_became_active":"2024-05-09T09:53:28.759010+0000","last_became_peered":"2024-05-09T09:53:28.759010+0000","last_unstale":"2024-05-09T09:54:03.435356+0000","last_undegraded":"2024-05-09T09:54:03.435356+0000","last_fullsized":"2024-05-09T09:54:03.435356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:29:11.862581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217303+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:54:04.217303+0000","last_peered":"2024-05-09T09:54:04.217303+0000","last_clean":"2024-05-09T09:54:04.217303+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:54:04.217303+0000","last_undegraded":"2024-05-09T09:54:04.217303+0000","last_fullsized":"2024-05-09T09:54:04.217303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217641+0000","last_change":"2024-05-09T09:53:28.767600+0000","last_active":"2024-05-09T09:54:04.217641+0000","last_peered":"2024-05-09T09:54:04.217641+0000","last_clean":"2024-05-09T09:54:04.217641+0000","last_became_active":"2024-05-09T09:53:28.766792+0000","last_became_peered":"2024-05-09T09:53:28.766792+0000","last_unstale":"2024-05-09T09:54:04.217641+0000","last_undegraded":"2024-05-09T09:54:04.217641+0000","last_fullsized":"2024-05-09T09:54:04.217641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:49.969409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220089+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:54:04.220089+0000","last_peered":"2024-05-09T09:54:04.220089+0000","last_clean":"2024-05-09T09:54:04.220089+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:54:04.220089+0000","last_undegraded":"2024-05-09T09:54:04.220089+0000","last_fullsized":"2024-05-09T09:54:04.220089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319912+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:54:03.319912+0000","last_peered":"2024-05-09T09:54:03.319912+0000","last_clean":"2024-05-09T09:54:03.319912+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:54:03.319912+0000","last_undegraded":"2024-05-09T09:54:03.319912+0000","last_fullsized":"2024-05-09T09:54:03.319912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218633+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:54:04.218633+0000","last_peered":"2024-05-09T09:54:04.218633+0000","last_clean":"2024-05-09T09:54:04.218633+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:54:04.218633+0000","last_undegraded":"2024-05-09T09:54:04.218633+0000","last_fullsized":"2024-05-09T09:54:04.218633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573206+0000","last_change":"2024-05-09T09:53:54.474568+0000","last_active":"2024-05-09T09:54:03.573206+0000","last_peered":"2024-05-09T09:54:03.573206+0000","last_clean":"2024-05-09T09:54:03.573206+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:54:03.573206+0000","last_undegraded":"2024-05-09T09:54:03.573206+0000","last_fullsized":"2024-05-09T09:54:03.573206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:31.979515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436338+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:54:03.436338+0000","last_peered":"2024-05-09T09:54:03.436338+0000","last_clean":"2024-05-09T09:54:03.436338+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:54:03.436338+0000","last_undegraded":"2024-05-09T09:54:03.436338+0000","last_fullsized":"2024-05-09T09:54:03.436338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433571+0000","last_change":"2024-05-09T09:53:07.124474+0000","last_active":"2024-05-09T09:54:03.433571+0000","last_peered":"2024-05-09T09:54:03.433571+0000","last_clean":"2024-05-09T09:54:03.433571+0000","last_became_active":"2024-05-09T09:53:07.123723+0000","last_became_peered":"2024-05-09T09:53:07.123723+0000","last_unstale":"2024-05-09T09:54:03.433571+0000","last_undegraded":"2024-05-09T09:54:03.433571+0000","last_fullsized":"2024-05-09T09:54:03.433571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:07.985561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217131+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:54:04.217131+0000","last_peered":"2024-05-09T09:54:04.217131+0000","last_clean":"2024-05-09T09:54:04.217131+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:54:04.217131+0000","last_undegraded":"2024-05-09T09:54:04.217131+0000","last_fullsized":"2024-05-09T09:54:04.217131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217632+0000","last_change":"2024-05-09T09:53:07.105696+0000","last_active":"2024-05-09T09:54:04.217632+0000","last_peered":"2024-05-09T09:54:04.217632+0000","last_clean":"2024-05-09T09:54:04.217632+0000","last_became_active":"2024-05-09T09:53:07.105002+0000","last_became_peered":"2024-05-09T09:53:07.105002+0000","last_unstale":"2024-05-09T09:54:04.217632+0000","last_undegraded":"2024-05-09T09:54:04.217632+0000","last_fullsized":"2024-05-09T09:54:04.217632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.207091+0000","last_change":"2024-05-09T09:53:09.133442+0000","last_active":"2024-05-09T09:54:03.207091+0000","last_peered":"2024-05-09T09:54:03.207091+0000","last_clean":"2024-05-09T09:54:03.207091+0000","last_became_active":"2024-05-09T09:53:09.133057+0000","last_became_peered":"2024-05-09T09:53:09.133057+0000","last_unstale":"2024-05-09T09:54:03.207091+0000","last_undegraded":"2024-05-09T09:54:03.207091+0000","last_fullsized":"2024-05-09T09:54:03.207091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:41.224127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201105+0000","last_change":"2024-05-09T09:53:54.470608+0000","last_active":"2024-05-09T09:54:03.201105+0000","last_peered":"2024-05-09T09:54:03.201105+0000","last_clean":"2024-05-09T09:54:03.201105+0000","last_became_active":"2024-05-09T09:53:54.470294+0000","last_became_peered":"2024-05-09T09:53:54.470294+0000","last_unstale":"2024-05-09T09:54:03.201105+0000","last_undegraded":"2024-05-09T09:54:03.201105+0000","last_fullsized":"2024-05-09T09:54:03.201105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:24:20.344478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320514+0000","last_change":"2024-05-09T09:53:28.756097+0000","last_active":"2024-05-09T09:54:03.320514+0000","last_peered":"2024-05-09T09:54:03.320514+0000","last_clean":"2024-05-09T09:54:03.320514+0000","last_became_active":"2024-05-09T09:53:28.755747+0000","last_became_peered":"2024-05-09T09:53:28.755747+0000","last_unstale":"2024-05-09T09:54:03.320514+0000","last_undegraded":"2024-05-09T09:54:03.320514+0000","last_fullsized":"2024-05-09T09:54:03.320514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:08.997460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220032+0000","last_change":"2024-05-09T09:53:07.106145+0000","last_active":"2024-05-09T09:54:04.220032+0000","last_peered":"2024-05-09T09:54:04.220032+0000","last_clean":"2024-05-09T09:54:04.220032+0000","last_became_active":"2024-05-09T09:53:07.105747+0000","last_became_peered":"2024-05-09T09:53:07.105747+0000","last_unstale":"2024-05-09T09:54:04.220032+0000","last_undegraded":"2024-05-09T09:54:04.220032+0000","last_fullsized":"2024-05-09T09:54:04.220032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200923+0000","last_change":"2024-05-09T09:53:09.114575+0000","last_active":"2024-05-09T09:54:03.200923+0000","last_peered":"2024-05-09T09:54:03.200923+0000","last_clean":"2024-05-09T09:54:03.200923+0000","last_became_active":"2024-05-09T09:53:09.114298+0000","last_became_peered":"2024-05-09T09:53:09.114298+0000","last_unstale":"2024-05-09T09:54:03.200923+0000","last_undegraded":"2024-05-09T09:54:03.200923+0000","last_fullsized":"2024-05-09T09:54:03.200923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322136+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:54:03.322136+0000","last_peered":"2024-05-09T09:54:03.322136+0000","last_clean":"2024-05-09T09:54:03.322136+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:54:03.322136+0000","last_undegraded":"2024-05-09T09:54:03.322136+0000","last_fullsized":"2024-05-09T09:54:03.322136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319828+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:54:03.319828+0000","last_peered":"2024-05-09T09:54:03.319828+0000","last_clean":"2024-05-09T09:54:03.319828+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:54:03.319828+0000","last_undegraded":"2024-05-09T09:54:03.319828+0000","last_fullsized":"2024-05-09T09:54:03.319828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203013+0000","last_change":"2024-05-09T09:53:28.772163+0000","last_active":"2024-05-09T09:54:03.203013+0000","last_peered":"2024-05-09T09:54:03.203013+0000","last_clean":"2024-05-09T09:54:03.203013+0000","last_became_active":"2024-05-09T09:53:28.771550+0000","last_became_peered":"2024-05-09T09:53:28.771550+0000","last_unstale":"2024-05-09T09:54:03.203013+0000","last_undegraded":"2024-05-09T09:54:03.203013+0000","last_fullsized":"2024-05-09T09:54:03.203013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:22.704330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220280+0000","last_change":"2024-05-09T09:53:09.113360+0000","last_active":"2024-05-09T09:54:04.220280+0000","last_peered":"2024-05-09T09:54:04.220280+0000","last_clean":"2024-05-09T09:54:04.220280+0000","last_became_active":"2024-05-09T09:53:09.112503+0000","last_became_peered":"2024-05-09T09:53:09.112503+0000","last_unstale":"2024-05-09T09:54:04.220280+0000","last_undegraded":"2024-05-09T09:54:04.220280+0000","last_fullsized":"2024-05-09T09:54:04.220280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433541+0000","last_change":"2024-05-09T09:53:07.117804+0000","last_active":"2024-05-09T09:54:03.433541+0000","last_peered":"2024-05-09T09:54:03.433541+0000","last_clean":"2024-05-09T09:54:03.433541+0000","last_became_active":"2024-05-09T09:53:07.116606+0000","last_became_peered":"2024-05-09T09:53:07.116606+0000","last_unstale":"2024-05-09T09:54:03.433541+0000","last_undegraded":"2024-05-09T09:54:03.433541+0000","last_fullsized":"2024-05-09T09:54:03.433541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:45:54.495728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573456+0000","last_change":"2024-05-09T09:53:28.775930+0000","last_active":"2024-05-09T09:54:03.573456+0000","last_peered":"2024-05-09T09:54:03.573456+0000","last_clean":"2024-05-09T09:54:03.573456+0000","last_became_active":"2024-05-09T09:53:28.775613+0000","last_became_peered":"2024-05-09T09:53:28.775613+0000","last_unstale":"2024-05-09T09:54:03.573456+0000","last_undegraded":"2024-05-09T09:54:03.573456+0000","last_fullsized":"2024-05-09T09:54:03.573456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:36.298968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201332+0000","last_change":"2024-05-09T09:53:28.770864+0000","last_active":"2024-05-09T09:54:03.201332+0000","last_peered":"2024-05-09T09:54:03.201332+0000","last_clean":"2024-05-09T09:54:03.201332+0000","last_became_active":"2024-05-09T09:53:28.765629+0000","last_became_peered":"2024-05-09T09:53:28.765629+0000","last_unstale":"2024-05-09T09:54:03.201332+0000","last_undegraded":"2024-05-09T09:54:03.201332+0000","last_fullsized":"2024-05-09T09:54:03.201332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:29.969514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.576596+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:54:03.576596+0000","last_peered":"2024-05-09T09:54:03.576596+0000","last_clean":"2024-05-09T09:54:03.576596+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:54:03.576596+0000","last_undegraded":"2024-05-09T09:54:03.576596+0000","last_fullsized":"2024-05-09T09:54:03.576596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435642+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:54:03.435642+0000","last_peered":"2024-05-09T09:54:03.435642+0000","last_clean":"2024-05-09T09:54:03.435642+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:54:03.435642+0000","last_undegraded":"2024-05-09T09:54:03.435642+0000","last_fullsized":"2024-05-09T09:54:03.435642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321163+0000","last_change":"2024-05-09T09:53:28.752616+0000","last_active":"2024-05-09T09:54:03.321163+0000","last_peered":"2024-05-09T09:54:03.321163+0000","last_clean":"2024-05-09T09:54:03.321163+0000","last_became_active":"2024-05-09T09:53:28.752302+0000","last_became_peered":"2024-05-09T09:53:28.752302+0000","last_unstale":"2024-05-09T09:54:03.321163+0000","last_undegraded":"2024-05-09T09:54:03.321163+0000","last_fullsized":"2024-05-09T09:54:03.321163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:33.991363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574104+0000","last_change":"2024-05-09T09:53:54.475107+0000","last_active":"2024-05-09T09:54:03.574104+0000","last_peered":"2024-05-09T09:54:03.574104+0000","last_clean":"2024-05-09T09:54:03.574104+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:54:03.574104+0000","last_undegraded":"2024-05-09T09:54:03.574104+0000","last_fullsized":"2024-05-09T09:54:03.574104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:07.978606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269745+0000","last_change":"2024-05-09T09:53:09.134867+0000","last_active":"2024-05-09T09:54:04.269745+0000","last_peered":"2024-05-09T09:54:04.269745+0000","last_clean":"2024-05-09T09:54:04.269745+0000","last_became_active":"2024-05-09T09:53:09.132179+0000","last_became_peered":"2024-05-09T09:53:09.132179+0000","last_unstale":"2024-05-09T09:54:04.269745+0000","last_undegraded":"2024-05-09T09:54:04.269745+0000","last_fullsized":"2024-05-09T09:54:04.269745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321645+0000","last_change":"2024-05-09T09:53:28.769931+0000","last_active":"2024-05-09T09:54:03.321645+0000","last_peered":"2024-05-09T09:54:03.321645+0000","last_clean":"2024-05-09T09:54:03.321645+0000","last_became_active":"2024-05-09T09:53:28.769331+0000","last_became_peered":"2024-05-09T09:53:28.769331+0000","last_unstale":"2024-05-09T09:54:03.321645+0000","last_undegraded":"2024-05-09T09:54:03.321645+0000","last_fullsized":"2024-05-09T09:54:03.321645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:18.496459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217030+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:54:04.217030+0000","last_peered":"2024-05-09T09:54:04.217030+0000","last_clean":"2024-05-09T09:54:04.217030+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:54:04.217030+0000","last_undegraded":"2024-05-09T09:54:04.217030+0000","last_fullsized":"2024-05-09T09:54:04.217030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270705+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:54:04.270705+0000","last_peered":"2024-05-09T09:54:04.270705+0000","last_clean":"2024-05-09T09:54:04.270705+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:54:04.270705+0000","last_undegraded":"2024-05-09T09:54:04.270705+0000","last_fullsized":"2024-05-09T09:54:04.270705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200815+0000","last_change":"2024-05-09T09:53:09.126958+0000","last_active":"2024-05-09T09:54:03.200815+0000","last_peered":"2024-05-09T09:54:03.200815+0000","last_clean":"2024-05-09T09:54:03.200815+0000","last_became_active":"2024-05-09T09:53:09.126577+0000","last_became_peered":"2024-05-09T09:53:09.126577+0000","last_unstale":"2024-05-09T09:54:03.200815+0000","last_undegraded":"2024-05-09T09:54:03.200815+0000","last_fullsized":"2024-05-09T09:54:03.200815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573687+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:54:03.573687+0000","last_peered":"2024-05-09T09:54:03.573687+0000","last_clean":"2024-05-09T09:54:03.573687+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:54:03.573687+0000","last_undegraded":"2024-05-09T09:54:03.573687+0000","last_fullsized":"2024-05-09T09:54:03.573687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268775+0000","last_change":"2024-05-09T09:53:09.136266+0000","last_active":"2024-05-09T09:54:04.268775+0000","last_peered":"2024-05-09T09:54:04.268775+0000","last_clean":"2024-05-09T09:54:04.268775+0000","last_became_active":"2024-05-09T09:53:09.135638+0000","last_became_peered":"2024-05-09T09:53:09.135638+0000","last_unstale":"2024-05-09T09:54:04.268775+0000","last_undegraded":"2024-05-09T09:54:04.268775+0000","last_fullsized":"2024-05-09T09:54:04.268775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.437104+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:54:03.437104+0000","last_peered":"2024-05-09T09:54:03.437104+0000","last_clean":"2024-05-09T09:54:03.437104+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:54:03.437104+0000","last_undegraded":"2024-05-09T09:54:03.437104+0000","last_fullsized":"2024-05-09T09:54:03.437104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434756+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:54:03.434756+0000","last_peered":"2024-05-09T09:54:03.434756+0000","last_clean":"2024-05-09T09:54:03.434756+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:54:03.434756+0000","last_undegraded":"2024-05-09T09:54:03.434756+0000","last_fullsized":"2024-05-09T09:54:03.434756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220203+0000","last_change":"2024-05-09T09:53:09.113504+0000","last_active":"2024-05-09T09:54:04.220203+0000","last_peered":"2024-05-09T09:54:04.220203+0000","last_clean":"2024-05-09T09:54:04.220203+0000","last_became_active":"2024-05-09T09:53:09.112750+0000","last_became_peered":"2024-05-09T09:53:09.112750+0000","last_unstale":"2024-05-09T09:54:04.220203+0000","last_undegraded":"2024-05-09T09:54:04.220203+0000","last_fullsized":"2024-05-09T09:54:04.220203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.223535+0000","last_change":"2024-05-09T09:53:28.740175+0000","last_active":"2024-05-09T09:54:04.223535+0000","last_peered":"2024-05-09T09:54:04.223535+0000","last_clean":"2024-05-09T09:54:04.223535+0000","last_became_active":"2024-05-09T09:53:28.739562+0000","last_became_peered":"2024-05-09T09:53:28.739562+0000","last_unstale":"2024-05-09T09:54:04.223535+0000","last_undegraded":"2024-05-09T09:54:04.223535+0000","last_fullsized":"2024-05-09T09:54:04.223535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:31.035254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435923+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:54:03.435923+0000","last_peered":"2024-05-09T09:54:03.435923+0000","last_clean":"2024-05-09T09:54:03.435923+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:54:03.435923+0000","last_undegraded":"2024-05-09T09:54:03.435923+0000","last_fullsized":"2024-05-09T09:54:03.435923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":684,"num_read_kb":443,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1196032,"data_stored":880415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":289915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":622592,"data_stored":289658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":0,"seq":60129542161,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":589824,"data_stored":288790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":288066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":593920,"data_stored":288754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1171456,"data_stored":878828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:54:05.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:54:05.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:05.747 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:05.746+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:05.823 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:05.824 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:05.833 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:05.830+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:05.837 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:05.934 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:05.936+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:06.001 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:06.001 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:06.016 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:06.063 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:06.062+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:06.136 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:06.136+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:06.139 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:06.139 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:06.153 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:06.207 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:54:06.219 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:54:06.235 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-05-09T09:54:05.298181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":804,"num_read_kb":547,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":38,"num_bytes_recovered":1741,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":528,"ondisk_log_size":528,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":215180,"kb_used_data":5204,"kb_used_omap":10,"kb_used_meta":209845,"kb_avail":660387700,"statfs":{"total":676457349120,"available":676237004800,"internally_reserved":0,"allocated":5328896,"data_stored":3204426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11154,"internal_metadata":214881390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000887"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271129+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:54:04.271129+0000","last_peered":"2024-05-09T09:54:04.271129+0000","last_clean":"2024-05-09T09:54:04.271129+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:54:04.271129+0000","last_undegraded":"2024-05-09T09:54:04.271129+0000","last_fullsized":"2024-05-09T09:54:04.271129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434339+0000","last_change":"2024-05-09T09:53:28.743971+0000","last_active":"2024-05-09T09:54:03.434339+0000","last_peered":"2024-05-09T09:54:03.434339+0000","last_clean":"2024-05-09T09:54:03.434339+0000","last_became_active":"2024-05-09T09:53:28.742941+0000","last_became_peered":"2024-05-09T09:53:28.742941+0000","last_unstale":"2024-05-09T09:54:03.434339+0000","last_undegraded":"2024-05-09T09:54:03.434339+0000","last_fullsized":"2024-05-09T09:54:03.434339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:05:43.273931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218748+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:54:04.218748+0000","last_peered":"2024-05-09T09:54:04.218748+0000","last_clean":"2024-05-09T09:54:04.218748+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:54:04.218748+0000","last_undegraded":"2024-05-09T09:54:04.218748+0000","last_fullsized":"2024-05-09T09:54:04.218748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269713+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:54:04.269713+0000","last_peered":"2024-05-09T09:54:04.269713+0000","last_clean":"2024-05-09T09:54:04.269713+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:54:04.269713+0000","last_undegraded":"2024-05-09T09:54:04.269713+0000","last_fullsized":"2024-05-09T09:54:04.269713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218591+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:54:04.218591+0000","last_peered":"2024-05-09T09:54:04.218591+0000","last_clean":"2024-05-09T09:54:04.218591+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:54:04.218591+0000","last_undegraded":"2024-05-09T09:54:04.218591+0000","last_fullsized":"2024-05-09T09:54:04.218591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217283+0000","last_change":"2024-05-09T09:53:28.774715+0000","last_active":"2024-05-09T09:54:04.217283+0000","last_peered":"2024-05-09T09:54:04.217283+0000","last_clean":"2024-05-09T09:54:04.217283+0000","last_became_active":"2024-05-09T09:53:28.774015+0000","last_became_peered":"2024-05-09T09:53:28.774015+0000","last_unstale":"2024-05-09T09:54:04.217283+0000","last_undegraded":"2024-05-09T09:54:04.217283+0000","last_fullsized":"2024-05-09T09:54:04.217283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:33.002835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433672+0000","last_change":"2024-05-09T09:53:07.122498+0000","last_active":"2024-05-09T09:54:03.433672+0000","last_peered":"2024-05-09T09:54:03.433672+0000","last_clean":"2024-05-09T09:54:03.433672+0000","last_became_active":"2024-05-09T09:53:07.121122+0000","last_became_peered":"2024-05-09T09:53:07.121122+0000","last_unstale":"2024-05-09T09:54:03.433672+0000","last_undegraded":"2024-05-09T09:54:03.433672+0000","last_fullsized":"2024-05-09T09:54:03.433672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:09:33.860750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217554+0000","last_change":"2024-05-09T09:53:09.125729+0000","last_active":"2024-05-09T09:54:04.217554+0000","last_peered":"2024-05-09T09:54:04.217554+0000","last_clean":"2024-05-09T09:54:04.217554+0000","last_became_active":"2024-05-09T09:53:09.125431+0000","last_became_peered":"2024-05-09T09:53:09.125431+0000","last_unstale":"2024-05-09T09:54:04.217554+0000","last_undegraded":"2024-05-09T09:54:04.217554+0000","last_fullsized":"2024-05-09T09:54:04.217554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320090+0000","last_change":"2024-05-09T09:53:54.477992+0000","last_active":"2024-05-09T09:54:03.320090+0000","last_peered":"2024-05-09T09:54:03.320090+0000","last_clean":"2024-05-09T09:54:03.320090+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:54:03.320090+0000","last_undegraded":"2024-05-09T09:54:03.320090+0000","last_fullsized":"2024-05-09T09:54:03.320090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:38.501294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321246+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:54:03.321246+0000","last_peered":"2024-05-09T09:54:03.321246+0000","last_clean":"2024-05-09T09:54:03.321246+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:54:03.321246+0000","last_undegraded":"2024-05-09T09:54:03.321246+0000","last_fullsized":"2024-05-09T09:54:03.321246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435172+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:54:03.435172+0000","last_peered":"2024-05-09T09:54:03.435172+0000","last_clean":"2024-05-09T09:54:03.435172+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:54:03.435172+0000","last_undegraded":"2024-05-09T09:54:03.435172+0000","last_fullsized":"2024-05-09T09:54:03.435172+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:45:31.509591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218512+0000","last_change":"2024-05-09T09:53:28.768336+0000","last_active":"2024-05-09T09:54:04.218512+0000","last_peered":"2024-05-09T09:54:04.218512+0000","last_clean":"2024-05-09T09:54:04.218512+0000","last_became_active":"2024-05-09T09:53:28.766320+0000","last_became_peered":"2024-05-09T09:53:28.766320+0000","last_unstale":"2024-05-09T09:54:04.218512+0000","last_undegraded":"2024-05-09T09:54:04.218512+0000","last_fullsized":"2024-05-09T09:54:04.218512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:23:32.084558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269995+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:54:04.269995+0000","last_peered":"2024-05-09T09:54:04.269995+0000","last_clean":"2024-05-09T09:54:04.269995+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:54:04.269995+0000","last_undegraded":"2024-05-09T09:54:04.269995+0000","last_fullsized":"2024-05-09T09:54:04.269995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435703+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:54:03.435703+0000","last_peered":"2024-05-09T09:54:03.435703+0000","last_clean":"2024-05-09T09:54:03.435703+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:54:03.435703+0000","last_undegraded":"2024-05-09T09:54:03.435703+0000","last_fullsized":"2024-05-09T09:54:03.435703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205426+0000","last_change":"2024-05-09T09:53:07.119794+0000","last_active":"2024-05-09T09:54:03.205426+0000","last_peered":"2024-05-09T09:54:03.205426+0000","last_clean":"2024-05-09T09:54:03.205426+0000","last_became_active":"2024-05-09T09:53:07.119402+0000","last_became_peered":"2024-05-09T09:53:07.119402+0000","last_unstale":"2024-05-09T09:54:03.205426+0000","last_undegraded":"2024-05-09T09:54:03.205426+0000","last_fullsized":"2024-05-09T09:54:03.205426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.575043+0000","last_change":"2024-05-09T09:53:09.109546+0000","last_active":"2024-05-09T09:54:03.575043+0000","last_peered":"2024-05-09T09:54:03.575043+0000","last_clean":"2024-05-09T09:54:03.575043+0000","last_became_active":"2024-05-09T09:53:09.108979+0000","last_became_peered":"2024-05-09T09:53:09.108979+0000","last_unstale":"2024-05-09T09:54:03.575043+0000","last_undegraded":"2024-05-09T09:54:03.575043+0000","last_fullsized":"2024-05-09T09:54:03.575043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:57.701380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.215845+0000","last_change":"2024-05-09T09:53:28.760228+0000","last_active":"2024-05-09T09:54:04.215845+0000","last_peered":"2024-05-09T09:54:04.215845+0000","last_clean":"2024-05-09T09:54:04.215845+0000","last_became_active":"2024-05-09T09:53:28.759657+0000","last_became_peered":"2024-05-09T09:53:28.759657+0000","last_unstale":"2024-05-09T09:54:04.215845+0000","last_undegraded":"2024-05-09T09:54:04.215845+0000","last_fullsized":"2024-05-09T09:54:04.215845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:44.696699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271386+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:54:04.271386+0000","last_peered":"2024-05-09T09:54:04.271386+0000","last_clean":"2024-05-09T09:54:04.271386+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:54:04.271386+0000","last_undegraded":"2024-05-09T09:54:04.271386+0000","last_fullsized":"2024-05-09T09:54:04.271386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269929+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:54:04.269929+0000","last_peered":"2024-05-09T09:54:04.269929+0000","last_clean":"2024-05-09T09:54:04.269929+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:54:04.269929+0000","last_undegraded":"2024-05-09T09:54:04.269929+0000","last_fullsized":"2024-05-09T09:54:04.269929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321843+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:54:03.321843+0000","last_peered":"2024-05-09T09:54:03.321843+0000","last_clean":"2024-05-09T09:54:03.321843+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:54:03.321843+0000","last_undegraded":"2024-05-09T09:54:03.321843+0000","last_fullsized":"2024-05-09T09:54:03.321843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435448+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:54:03.435448+0000","last_peered":"2024-05-09T09:54:03.435448+0000","last_clean":"2024-05-09T09:54:03.435448+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:54:03.435448+0000","last_undegraded":"2024-05-09T09:54:03.435448+0000","last_fullsized":"2024-05-09T09:54:03.435448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321972+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:54:03.321972+0000","last_peered":"2024-05-09T09:54:03.321972+0000","last_clean":"2024-05-09T09:54:03.321972+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:54:03.321972+0000","last_undegraded":"2024-05-09T09:54:03.321972+0000","last_fullsized":"2024-05-09T09:54:03.321972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573918+0000","last_change":"2024-05-09T09:53:09.109289+0000","last_active":"2024-05-09T09:54:03.573918+0000","last_peered":"2024-05-09T09:54:03.573918+0000","last_clean":"2024-05-09T09:54:03.573918+0000","last_became_active":"2024-05-09T09:53:09.108483+0000","last_became_peered":"2024-05-09T09:53:09.108483+0000","last_unstale":"2024-05-09T09:54:03.573918+0000","last_undegraded":"2024-05-09T09:54:03.573918+0000","last_fullsized":"2024-05-09T09:54:03.573918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:55.077672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321369+0000","last_change":"2024-05-09T09:53:28.769627+0000","last_active":"2024-05-09T09:54:03.321369+0000","last_peered":"2024-05-09T09:54:03.321369+0000","last_clean":"2024-05-09T09:54:03.321369+0000","last_became_active":"2024-05-09T09:53:28.768939+0000","last_became_peered":"2024-05-09T09:53:28.768939+0000","last_unstale":"2024-05-09T09:54:03.321369+0000","last_undegraded":"2024-05-09T09:54:03.321369+0000","last_fullsized":"2024-05-09T09:54:03.321369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:31.035254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574359+0000","last_change":"2024-05-09T09:53:28.768598+0000","last_active":"2024-05-09T09:54:03.574359+0000","last_peered":"2024-05-09T09:54:03.574359+0000","last_clean":"2024-05-09T09:54:03.574359+0000","last_became_active":"2024-05-09T09:53:28.751472+0000","last_became_peered":"2024-05-09T09:53:28.751472+0000","last_unstale":"2024-05-09T09:54:03.574359+0000","last_undegraded":"2024-05-09T09:54:03.574359+0000","last_fullsized":"2024-05-09T09:54:03.574359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:37.593516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206730+0000","last_change":"2024-05-09T09:53:07.113936+0000","last_active":"2024-05-09T09:54:03.206730+0000","last_peered":"2024-05-09T09:54:03.206730+0000","last_clean":"2024-05-09T09:54:03.206730+0000","last_became_active":"2024-05-09T09:53:07.113560+0000","last_became_peered":"2024-05-09T09:53:07.113560+0000","last_unstale":"2024-05-09T09:54:03.206730+0000","last_undegraded":"2024-05-09T09:54:03.206730+0000","last_fullsized":"2024-05-09T09:54:03.206730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:11.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574634+0000","last_change":"2024-05-09T09:53:54.474438+0000","last_active":"2024-05-09T09:54:03.574634+0000","last_peered":"2024-05-09T09:54:03.574634+0000","last_clean":"2024-05-09T09:54:03.574634+0000","last_became_active":"2024-05-09T09:53:54.474119+0000","last_became_peered":"2024-05-09T09:53:54.474119+0000","last_unstale":"2024-05-09T09:54:03.574634+0000","last_undegraded":"2024-05-09T09:54:03.574634+0000","last_fullsized":"2024-05-09T09:54:03.574634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:05.292436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217362+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:54:04.217362+0000","last_peered":"2024-05-09T09:54:04.217362+0000","last_clean":"2024-05-09T09:54:04.217362+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:54:04.217362+0000","last_undegraded":"2024-05-09T09:54:04.217362+0000","last_fullsized":"2024-05-09T09:54:04.217362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206345+0000","last_change":"2024-05-09T09:53:28.764726+0000","last_active":"2024-05-09T09:54:03.206345+0000","last_peered":"2024-05-09T09:54:03.206345+0000","last_clean":"2024-05-09T09:54:03.206345+0000","last_became_active":"2024-05-09T09:53:28.742951+0000","last_became_peered":"2024-05-09T09:53:28.742951+0000","last_unstale":"2024-05-09T09:54:03.206345+0000","last_undegraded":"2024-05-09T09:54:03.206345+0000","last_fullsized":"2024-05-09T09:54:03.206345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:05.916196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202430+0000","last_change":"2024-05-09T09:53:09.113975+0000","last_active":"2024-05-09T09:54:03.202430+0000","last_peered":"2024-05-09T09:54:03.202430+0000","last_clean":"2024-05-09T09:54:03.202430+0000","last_became_active":"2024-05-09T09:53:09.112863+0000","last_became_peered":"2024-05-09T09:53:09.112863+0000","last_unstale":"2024-05-09T09:54:03.202430+0000","last_undegraded":"2024-05-09T09:54:03.202430+0000","last_fullsized":"2024-05-09T09:54:03.202430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:33.354661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270029+0000","last_change":"2024-05-09T09:53:28.741314+0000","last_active":"2024-05-09T09:54:04.270029+0000","last_peered":"2024-05-09T09:54:04.270029+0000","last_clean":"2024-05-09T09:54:04.270029+0000","last_became_active":"2024-05-09T09:53:28.740956+0000","last_became_peered":"2024-05-09T09:53:28.740956+0000","last_unstale":"2024-05-09T09:54:04.270029+0000","last_undegraded":"2024-05-09T09:54:04.270029+0000","last_fullsized":"2024-05-09T09:54:04.270029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:20.659273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436210+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:54:03.436210+0000","last_peered":"2024-05-09T09:54:03.436210+0000","last_clean":"2024-05-09T09:54:03.436210+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:54:03.436210+0000","last_undegraded":"2024-05-09T09:54:03.436210+0000","last_fullsized":"2024-05-09T09:54:03.436210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"30'9","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219662+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:54:04.219662+0000","last_peered":"2024-05-09T09:54:04.219662+0000","last_clean":"2024-05-09T09:54:04.219662+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:54:04.219662+0000","last_undegraded":"2024-05-09T09:54:04.219662+0000","last_fullsized":"2024-05-09T09:54:04.219662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270829+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:54:04.270829+0000","last_peered":"2024-05-09T09:54:04.270829+0000","last_clean":"2024-05-09T09:54:04.270829+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:54:04.270829+0000","last_undegraded":"2024-05-09T09:54:04.270829+0000","last_fullsized":"2024-05-09T09:54:04.270829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":53,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434211+0000","last_change":"2024-05-09T09:53:28.769492+0000","last_active":"2024-05-09T09:54:03.434211+0000","last_peered":"2024-05-09T09:54:03.434211+0000","last_clean":"2024-05-09T09:54:03.434211+0000","last_became_active":"2024-05-09T09:53:28.769145+0000","last_became_peered":"2024-05-09T09:53:28.769145+0000","last_unstale":"2024-05-09T09:54:03.434211+0000","last_undegraded":"2024-05-09T09:54:03.434211+0000","last_fullsized":"2024-05-09T09:54:03.434211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:19.465808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436682+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:54:03.436682+0000","last_peered":"2024-05-09T09:54:03.436682+0000","last_clean":"2024-05-09T09:54:03.436682+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:54:03.436682+0000","last_undegraded":"2024-05-09T09:54:03.436682+0000","last_fullsized":"2024-05-09T09:54:03.436682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217485+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:54:04.217485+0000","last_peered":"2024-05-09T09:54:04.217485+0000","last_clean":"2024-05-09T09:54:04.217485+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:54:04.217485+0000","last_undegraded":"2024-05-09T09:54:04.217485+0000","last_fullsized":"2024-05-09T09:54:04.217485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202199+0000","last_change":"2024-05-09T09:53:11.120948+0000","last_active":"2024-05-09T09:54:03.202199+0000","last_peered":"2024-05-09T09:54:03.202199+0000","last_clean":"2024-05-09T09:54:03.202199+0000","last_became_active":"2024-05-09T09:53:11.120423+0000","last_became_peered":"2024-05-09T09:53:11.120423+0000","last_unstale":"2024-05-09T09:54:03.202199+0000","last_undegraded":"2024-05-09T09:54:03.202199+0000","last_fullsized":"2024-05-09T09:54:03.202199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:06.988958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":78,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574822+0000","last_change":"2024-05-09T09:53:28.787828+0000","last_active":"2024-05-09T09:54:03.574822+0000","last_peered":"2024-05-09T09:54:03.574822+0000","last_clean":"2024-05-09T09:54:03.574822+0000","last_became_active":"2024-05-09T09:53:28.753432+0000","last_became_peered":"2024-05-09T09:53:28.753432+0000","last_unstale":"2024-05-09T09:54:03.574822+0000","last_undegraded":"2024-05-09T09:54:03.574822+0000","last_fullsized":"2024-05-09T09:54:03.574822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219752+0000","last_change":"2024-05-09T09:53:28.773447+0000","last_active":"2024-05-09T09:54:04.219752+0000","last_peered":"2024-05-09T09:54:04.219752+0000","last_clean":"2024-05-09T09:54:04.219752+0000","last_became_active":"2024-05-09T09:53:28.767423+0000","last_became_peered":"2024-05-09T09:53:28.767423+0000","last_unstale":"2024-05-09T09:54:04.219752+0000","last_undegraded":"2024-05-09T09:54:04.219752+0000","last_fullsized":"2024-05-09T09:54:04.219752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:30.413262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217111+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:54:04.217111+0000","last_peered":"2024-05-09T09:54:04.217111+0000","last_clean":"2024-05-09T09:54:04.217111+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:54:04.217111+0000","last_undegraded":"2024-05-09T09:54:04.217111+0000","last_fullsized":"2024-05-09T09:54:04.217111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219108+0000","last_change":"2024-05-09T09:53:09.113086+0000","last_active":"2024-05-09T09:54:04.219108+0000","last_peered":"2024-05-09T09:54:04.219108+0000","last_clean":"2024-05-09T09:54:04.219108+0000","last_became_active":"2024-05-09T09:53:09.112715+0000","last_became_peered":"2024-05-09T09:53:09.112715+0000","last_unstale":"2024-05-09T09:54:04.219108+0000","last_undegraded":"2024-05-09T09:54:04.219108+0000","last_fullsized":"2024-05-09T09:54:04.219108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270158+0000","last_change":"2024-05-09T09:53:28.745367+0000","last_active":"2024-05-09T09:54:04.270158+0000","last_peered":"2024-05-09T09:54:04.270158+0000","last_clean":"2024-05-09T09:54:04.270158+0000","last_became_active":"2024-05-09T09:53:28.745077+0000","last_became_peered":"2024-05-09T09:53:28.745077+0000","last_unstale":"2024-05-09T09:54:04.270158+0000","last_undegraded":"2024-05-09T09:54:04.270158+0000","last_fullsized":"2024-05-09T09:54:04.270158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:33.351895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203441+0000","last_change":"2024-05-09T09:53:11.119863+0000","last_active":"2024-05-09T09:54:03.203441+0000","last_peered":"2024-05-09T09:54:03.203441+0000","last_clean":"2024-05-09T09:54:03.203441+0000","last_became_active":"2024-05-09T09:53:11.119093+0000","last_became_peered":"2024-05-09T09:53:11.119093+0000","last_unstale":"2024-05-09T09:54:03.203441+0000","last_undegraded":"2024-05-09T09:54:03.203441+0000","last_fullsized":"2024-05-09T09:54:03.203441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:27.928171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":88,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574174+0000","last_change":"2024-05-09T09:53:28.800370+0000","last_active":"2024-05-09T09:54:03.574174+0000","last_peered":"2024-05-09T09:54:03.574174+0000","last_clean":"2024-05-09T09:54:03.574174+0000","last_became_active":"2024-05-09T09:53:28.760579+0000","last_became_peered":"2024-05-09T09:53:28.760579+0000","last_unstale":"2024-05-09T09:54:03.574174+0000","last_undegraded":"2024-05-09T09:54:03.574174+0000","last_fullsized":"2024-05-09T09:54:03.574174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:29.935297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'2","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271559+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:54:04.271559+0000","last_peered":"2024-05-09T09:54:04.271559+0000","last_clean":"2024-05-09T09:54:04.271559+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:54:04.271559+0000","last_undegraded":"2024-05-09T09:54:04.271559+0000","last_fullsized":"2024-05-09T09:54:04.271559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573780+0000","last_change":"2024-05-09T09:53:28.751329+0000","last_active":"2024-05-09T09:54:03.573780+0000","last_peered":"2024-05-09T09:54:03.573780+0000","last_clean":"2024-05-09T09:54:03.573780+0000","last_became_active":"2024-05-09T09:53:28.750943+0000","last_became_peered":"2024-05-09T09:53:28.750943+0000","last_unstale":"2024-05-09T09:54:03.573780+0000","last_undegraded":"2024-05-09T09:54:03.573780+0000","last_fullsized":"2024-05-09T09:54:03.573780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:40.249137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202832+0000","last_change":"2024-05-09T09:53:09.133623+0000","last_active":"2024-05-09T09:54:03.202832+0000","last_peered":"2024-05-09T09:54:03.202832+0000","last_clean":"2024-05-09T09:54:03.202832+0000","last_became_active":"2024-05-09T09:53:09.133066+0000","last_became_peered":"2024-05-09T09:53:09.133066+0000","last_unstale":"2024-05-09T09:54:03.202832+0000","last_undegraded":"2024-05-09T09:54:03.202832+0000","last_fullsized":"2024-05-09T09:54:03.202832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:56.384209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320145+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:54:03.320145+0000","last_peered":"2024-05-09T09:54:03.320145+0000","last_clean":"2024-05-09T09:54:03.320145+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:54:03.320145+0000","last_undegraded":"2024-05-09T09:54:03.320145+0000","last_fullsized":"2024-05-09T09:54:03.320145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435591+0000","last_change":"2024-05-09T09:53:11.126737+0000","last_active":"2024-05-09T09:54:03.435591+0000","last_peered":"2024-05-09T09:54:03.435591+0000","last_clean":"2024-05-09T09:54:03.435591+0000","last_became_active":"2024-05-09T09:53:11.125702+0000","last_became_peered":"2024-05-09T09:53:11.125702+0000","last_unstale":"2024-05-09T09:54:03.435591+0000","last_undegraded":"2024-05-09T09:54:03.435591+0000","last_fullsized":"2024-05-09T09:54:03.435591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:31:04.360774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"30'9","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271291+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:54:04.271291+0000","last_peered":"2024-05-09T09:54:04.271291+0000","last_clean":"2024-05-09T09:54:04.271291+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:54:04.271291+0000","last_undegraded":"2024-05-09T09:54:04.271291+0000","last_fullsized":"2024-05-09T09:54:04.271291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"27'2","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201478+0000","last_change":"2024-05-09T09:53:15.173857+0000","last_active":"2024-05-09T09:54:03.201478+0000","last_peered":"2024-05-09T09:54:03.201478+0000","last_clean":"2024-05-09T09:54:03.201478+0000","last_became_active":"2024-05-09T09:53:15.172351+0000","last_became_peered":"2024-05-09T09:53:15.172351+0000","last_unstale":"2024-05-09T09:54:03.201478+0000","last_undegraded":"2024-05-09T09:54:03.201478+0000","last_fullsized":"2024-05-09T09:54:03.201478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:19.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434714+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:54:03.434714+0000","last_peered":"2024-05-09T09:54:03.434714+0000","last_clean":"2024-05-09T09:54:03.434714+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:54:03.434714+0000","last_undegraded":"2024-05-09T09:54:03.434714+0000","last_fullsized":"2024-05-09T09:54:03.434714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271405+0000","last_change":"2024-05-09T09:53:28.767146+0000","last_active":"2024-05-09T09:54:04.271405+0000","last_peered":"2024-05-09T09:54:04.271405+0000","last_clean":"2024-05-09T09:54:04.271405+0000","last_became_active":"2024-05-09T09:53:28.766702+0000","last_became_peered":"2024-05-09T09:53:28.766702+0000","last_unstale":"2024-05-09T09:54:04.271405+0000","last_undegraded":"2024-05-09T09:54:04.271405+0000","last_fullsized":"2024-05-09T09:54:04.271405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:21.693641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269288+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:54:04.269288+0000","last_peered":"2024-05-09T09:54:04.269288+0000","last_clean":"2024-05-09T09:54:04.269288+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:54:04.269288+0000","last_undegraded":"2024-05-09T09:54:04.269288+0000","last_fullsized":"2024-05-09T09:54:04.269288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"30'19","reported_seq":87,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434344+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:54:03.434344+0000","last_peered":"2024-05-09T09:54:03.434344+0000","last_clean":"2024-05-09T09:54:03.434344+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:54:03.434344+0000","last_undegraded":"2024-05-09T09:54:03.434344+0000","last_fullsized":"2024-05-09T09:54:03.434344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220920+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:54:04.220920+0000","last_peered":"2024-05-09T09:54:04.220920+0000","last_clean":"2024-05-09T09:54:04.220920+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:54:04.220920+0000","last_undegraded":"2024-05-09T09:54:04.220920+0000","last_fullsized":"2024-05-09T09:54:04.220920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":53,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435048+0000","last_change":"2024-05-09T09:53:28.760592+0000","last_active":"2024-05-09T09:54:03.435048+0000","last_peered":"2024-05-09T09:54:03.435048+0000","last_clean":"2024-05-09T09:54:03.435048+0000","last_became_active":"2024-05-09T09:53:28.760362+0000","last_became_peered":"2024-05-09T09:53:28.760362+0000","last_unstale":"2024-05-09T09:54:03.435048+0000","last_undegraded":"2024-05-09T09:54:03.435048+0000","last_fullsized":"2024-05-09T09:54:03.435048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:38:13.251841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.223638+0000","last_change":"2024-05-09T09:53:28.771994+0000","last_active":"2024-05-09T09:54:04.223638+0000","last_peered":"2024-05-09T09:54:04.223638+0000","last_clean":"2024-05-09T09:54:04.223638+0000","last_became_active":"2024-05-09T09:53:28.771491+0000","last_became_peered":"2024-05-09T09:53:28.771491+0000","last_unstale":"2024-05-09T09:54:04.223638+0000","last_undegraded":"2024-05-09T09:54:04.223638+0000","last_fullsized":"2024-05-09T09:54:04.223638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:32:58.387203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271328+0000","last_change":"2024-05-09T09:53:28.752919+0000","last_active":"2024-05-09T09:54:04.271328+0000","last_peered":"2024-05-09T09:54:04.271328+0000","last_clean":"2024-05-09T09:54:04.271328+0000","last_became_active":"2024-05-09T09:53:28.752541+0000","last_became_peered":"2024-05-09T09:53:28.752541+0000","last_unstale":"2024-05-09T09:54:04.271328+0000","last_undegraded":"2024-05-09T09:54:04.271328+0000","last_fullsized":"2024-05-09T09:54:04.271328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:00.224275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.575277+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:54:03.575277+0000","last_peered":"2024-05-09T09:54:03.575277+0000","last_clean":"2024-05-09T09:54:03.575277+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:54:03.575277+0000","last_undegraded":"2024-05-09T09:54:03.575277+0000","last_fullsized":"2024-05-09T09:54:03.575277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"30'9","reported_seq":71,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.207201+0000","last_change":"2024-05-09T09:53:13.139707+0000","last_active":"2024-05-09T09:54:03.207201+0000","last_peered":"2024-05-09T09:54:03.207201+0000","last_clean":"2024-05-09T09:54:03.207201+0000","last_became_active":"2024-05-09T09:53:13.138048+0000","last_became_peered":"2024-05-09T09:53:13.138048+0000","last_unstale":"2024-05-09T09:54:03.207201+0000","last_undegraded":"2024-05-09T09:54:03.207201+0000","last_fullsized":"2024-05-09T09:54:03.207201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:54.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202989+0000","last_change":"2024-05-09T09:53:15.173268+0000","last_active":"2024-05-09T09:54:03.202989+0000","last_peered":"2024-05-09T09:54:03.202989+0000","last_clean":"2024-05-09T09:54:03.202989+0000","last_became_active":"2024-05-09T09:53:15.172435+0000","last_became_peered":"2024-05-09T09:53:15.172435+0000","last_unstale":"2024-05-09T09:54:03.202989+0000","last_undegraded":"2024-05-09T09:54:03.202989+0000","last_fullsized":"2024-05-09T09:54:03.202989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:04.426998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":53,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321198+0000","last_change":"2024-05-09T09:53:28.742191+0000","last_active":"2024-05-09T09:54:03.321198+0000","last_peered":"2024-05-09T09:54:03.321198+0000","last_clean":"2024-05-09T09:54:03.321198+0000","last_became_active":"2024-05-09T09:53:28.741539+0000","last_became_peered":"2024-05-09T09:53:28.741539+0000","last_unstale":"2024-05-09T09:54:03.321198+0000","last_undegraded":"2024-05-09T09:54:03.321198+0000","last_fullsized":"2024-05-09T09:54:03.321198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:28.614319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320533+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:54:03.320533+0000","last_peered":"2024-05-09T09:54:03.320533+0000","last_clean":"2024-05-09T09:54:03.320533+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:54:03.320533+0000","last_undegraded":"2024-05-09T09:54:03.320533+0000","last_fullsized":"2024-05-09T09:54:03.320533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270526+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:54:04.270526+0000","last_peered":"2024-05-09T09:54:04.270526+0000","last_clean":"2024-05-09T09:54:04.270526+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:54:04.270526+0000","last_undegraded":"2024-05-09T09:54:04.270526+0000","last_fullsized":"2024-05-09T09:54:04.270526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574237+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:54:03.574237+0000","last_peered":"2024-05-09T09:54:03.574237+0000","last_clean":"2024-05-09T09:54:03.574237+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:54:03.574237+0000","last_undegraded":"2024-05-09T09:54:03.574237+0000","last_fullsized":"2024-05-09T09:54:03.574237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"30'15","reported_seq":83,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269097+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:54:04.269097+0000","last_peered":"2024-05-09T09:54:04.269097+0000","last_clean":"2024-05-09T09:54:04.269097+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:54:04.269097+0000","last_undegraded":"2024-05-09T09:54:04.269097+0000","last_fullsized":"2024-05-09T09:54:04.269097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"27'2","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216492+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:54:04.216492+0000","last_peered":"2024-05-09T09:54:04.216492+0000","last_clean":"2024-05-09T09:54:04.216492+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:54:04.216492+0000","last_undegraded":"2024-05-09T09:54:04.216492+0000","last_fullsized":"2024-05-09T09:54:04.216492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219576+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:54:04.219576+0000","last_peered":"2024-05-09T09:54:04.219576+0000","last_clean":"2024-05-09T09:54:04.219576+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:54:04.219576+0000","last_undegraded":"2024-05-09T09:54:04.219576+0000","last_fullsized":"2024-05-09T09:54:04.219576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218120+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:54:04.218120+0000","last_peered":"2024-05-09T09:54:04.218120+0000","last_clean":"2024-05-09T09:54:04.218120+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:54:04.218120+0000","last_undegraded":"2024-05-09T09:54:04.218120+0000","last_fullsized":"2024-05-09T09:54:04.218120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433645+0000","last_change":"2024-05-09T09:53:07.121861+0000","last_active":"2024-05-09T09:54:03.433645+0000","last_peered":"2024-05-09T09:54:03.433645+0000","last_clean":"2024-05-09T09:54:03.433645+0000","last_became_active":"2024-05-09T09:53:07.117776+0000","last_became_peered":"2024-05-09T09:53:07.117776+0000","last_unstale":"2024-05-09T09:54:03.433645+0000","last_undegraded":"2024-05-09T09:54:03.433645+0000","last_fullsized":"2024-05-09T09:54:03.433645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:31.804009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573699+0000","last_change":"2024-05-09T09:53:28.782906+0000","last_active":"2024-05-09T09:54:03.573699+0000","last_peered":"2024-05-09T09:54:03.573699+0000","last_clean":"2024-05-09T09:54:03.573699+0000","last_became_active":"2024-05-09T09:53:28.782399+0000","last_became_peered":"2024-05-09T09:53:28.782399+0000","last_unstale":"2024-05-09T09:54:03.573699+0000","last_undegraded":"2024-05-09T09:54:03.573699+0000","last_fullsized":"2024-05-09T09:54:03.573699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:01.845355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"30'12","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216723+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:54:04.216723+0000","last_peered":"2024-05-09T09:54:04.216723+0000","last_clean":"2024-05-09T09:54:04.216723+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:54:04.216723+0000","last_undegraded":"2024-05-09T09:54:04.216723+0000","last_fullsized":"2024-05-09T09:54:04.216723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.575140+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:54:03.575140+0000","last_peered":"2024-05-09T09:54:03.575140+0000","last_clean":"2024-05-09T09:54:03.575140+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:54:03.575140+0000","last_undegraded":"2024-05-09T09:54:03.575140+0000","last_fullsized":"2024-05-09T09:54:03.575140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220787+0000","last_change":"2024-05-09T09:53:17.180823+0000","last_active":"2024-05-09T09:54:04.220787+0000","last_peered":"2024-05-09T09:54:04.220787+0000","last_clean":"2024-05-09T09:54:04.220787+0000","last_became_active":"2024-05-09T09:53:17.180037+0000","last_became_peered":"2024-05-09T09:53:17.180037+0000","last_unstale":"2024-05-09T09:54:04.220787+0000","last_undegraded":"2024-05-09T09:54:04.220787+0000","last_fullsized":"2024-05-09T09:54:04.220787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:18.049912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202310+0000","last_change":"2024-05-09T09:53:28.750006+0000","last_active":"2024-05-09T09:54:03.202310+0000","last_peered":"2024-05-09T09:54:03.202310+0000","last_clean":"2024-05-09T09:54:03.202310+0000","last_became_active":"2024-05-09T09:53:28.746020+0000","last_became_peered":"2024-05-09T09:53:28.746020+0000","last_unstale":"2024-05-09T09:54:03.202310+0000","last_undegraded":"2024-05-09T09:54:03.202310+0000","last_fullsized":"2024-05-09T09:54:03.202310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:24.373466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203609+0000","last_change":"2024-05-09T09:53:07.104902+0000","last_active":"2024-05-09T09:54:03.203609+0000","last_peered":"2024-05-09T09:54:03.203609+0000","last_clean":"2024-05-09T09:54:03.203609+0000","last_became_active":"2024-05-09T09:53:07.102780+0000","last_became_peered":"2024-05-09T09:53:07.102780+0000","last_unstale":"2024-05-09T09:54:03.203609+0000","last_undegraded":"2024-05-09T09:54:03.203609+0000","last_fullsized":"2024-05-09T09:54:03.203609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573064+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:54:03.573064+0000","last_peered":"2024-05-09T09:54:03.573064+0000","last_clean":"2024-05-09T09:54:03.573064+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:54:03.573064+0000","last_undegraded":"2024-05-09T09:54:03.573064+0000","last_fullsized":"2024-05-09T09:54:03.573064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"30'11","reported_seq":94,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218550+0000","last_change":"2024-05-09T09:53:28.801179+0000","last_active":"2024-05-09T09:54:04.218550+0000","last_peered":"2024-05-09T09:54:04.218550+0000","last_clean":"2024-05-09T09:54:04.218550+0000","last_became_active":"2024-05-09T09:53:28.754551+0000","last_became_peered":"2024-05-09T09:53:28.754551+0000","last_unstale":"2024-05-09T09:54:04.218550+0000","last_undegraded":"2024-05-09T09:54:04.218550+0000","last_fullsized":"2024-05-09T09:54:04.218550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:58.465410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220061+0000","last_change":"2024-05-09T09:53:15.165179+0000","last_active":"2024-05-09T09:54:04.220061+0000","last_peered":"2024-05-09T09:54:04.220061+0000","last_clean":"2024-05-09T09:54:04.220061+0000","last_became_active":"2024-05-09T09:53:15.164441+0000","last_became_peered":"2024-05-09T09:53:15.164441+0000","last_unstale":"2024-05-09T09:54:04.220061+0000","last_undegraded":"2024-05-09T09:54:04.220061+0000","last_fullsized":"2024-05-09T09:54:04.220061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:48.243582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206230+0000","last_change":"2024-05-09T09:53:17.191808+0000","last_active":"2024-05-09T09:54:03.206230+0000","last_peered":"2024-05-09T09:54:03.206230+0000","last_clean":"2024-05-09T09:54:03.206230+0000","last_became_active":"2024-05-09T09:53:17.191148+0000","last_became_peered":"2024-05-09T09:53:17.191148+0000","last_unstale":"2024-05-09T09:54:03.206230+0000","last_undegraded":"2024-05-09T09:54:03.206230+0000","last_fullsized":"2024-05-09T09:54:03.206230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:36.468016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574439+0000","last_change":"2024-05-09T09:53:28.762435+0000","last_active":"2024-05-09T09:54:03.574439+0000","last_peered":"2024-05-09T09:54:03.574439+0000","last_clean":"2024-05-09T09:54:03.574439+0000","last_became_active":"2024-05-09T09:53:28.760397+0000","last_became_peered":"2024-05-09T09:53:28.760397+0000","last_unstale":"2024-05-09T09:54:03.574439+0000","last_undegraded":"2024-05-09T09:54:03.574439+0000","last_fullsized":"2024-05-09T09:54:03.574439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:12.839880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320783+0000","last_change":"2024-05-09T09:53:28.755939+0000","last_active":"2024-05-09T09:54:03.320783+0000","last_peered":"2024-05-09T09:54:03.320783+0000","last_clean":"2024-05-09T09:54:03.320783+0000","last_became_active":"2024-05-09T09:53:28.755617+0000","last_became_peered":"2024-05-09T09:53:28.755617+0000","last_unstale":"2024-05-09T09:54:03.320783+0000","last_undegraded":"2024-05-09T09:54:03.320783+0000","last_fullsized":"2024-05-09T09:54:03.320783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:48.530850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216737+0000","last_change":"2024-05-09T09:53:28.768514+0000","last_active":"2024-05-09T09:54:04.216737+0000","last_peered":"2024-05-09T09:54:04.216737+0000","last_clean":"2024-05-09T09:54:04.216737+0000","last_became_active":"2024-05-09T09:53:28.768249+0000","last_became_peered":"2024-05-09T09:53:28.768249+0000","last_unstale":"2024-05-09T09:54:04.216737+0000","last_undegraded":"2024-05-09T09:54:04.216737+0000","last_fullsized":"2024-05-09T09:54:04.216737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:00.329546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"30'15","reported_seq":81,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574908+0000","last_change":"2024-05-09T09:53:13.139144+0000","last_active":"2024-05-09T09:54:03.574908+0000","last_peered":"2024-05-09T09:54:03.574908+0000","last_clean":"2024-05-09T09:54:03.574908+0000","last_became_active":"2024-05-09T09:53:13.138683+0000","last_became_peered":"2024-05-09T09:53:13.138683+0000","last_unstale":"2024-05-09T09:54:03.574908+0000","last_undegraded":"2024-05-09T09:54:03.574908+0000","last_fullsized":"2024-05-09T09:54:03.574908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:36.290227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'2","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573271+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:54:03.573271+0000","last_peered":"2024-05-09T09:54:03.573271+0000","last_clean":"2024-05-09T09:54:03.573271+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:54:03.573271+0000","last_undegraded":"2024-05-09T09:54:03.573271+0000","last_fullsized":"2024-05-09T09:54:03.573271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.221183+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:54:04.221183+0000","last_peered":"2024-05-09T09:54:04.221183+0000","last_clean":"2024-05-09T09:54:04.221183+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:54:04.221183+0000","last_undegraded":"2024-05-09T09:54:04.221183+0000","last_fullsized":"2024-05-09T09:54:04.221183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321372+0000","last_change":"2024-05-09T09:53:28.758902+0000","last_active":"2024-05-09T09:54:03.321372+0000","last_peered":"2024-05-09T09:54:03.321372+0000","last_clean":"2024-05-09T09:54:03.321372+0000","last_became_active":"2024-05-09T09:53:28.758540+0000","last_became_peered":"2024-05-09T09:53:28.758540+0000","last_unstale":"2024-05-09T09:54:03.321372+0000","last_undegraded":"2024-05-09T09:54:03.321372+0000","last_fullsized":"2024-05-09T09:54:03.321372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:27:47.363363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573111+0000","last_change":"2024-05-09T09:53:28.752743+0000","last_active":"2024-05-09T09:54:03.573111+0000","last_peered":"2024-05-09T09:54:03.573111+0000","last_clean":"2024-05-09T09:54:03.573111+0000","last_became_active":"2024-05-09T09:53:28.751727+0000","last_became_peered":"2024-05-09T09:53:28.751727+0000","last_unstale":"2024-05-09T09:54:03.573111+0000","last_undegraded":"2024-05-09T09:54:03.573111+0000","last_fullsized":"2024-05-09T09:54:03.573111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:02.196032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":79,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436339+0000","last_change":"2024-05-09T09:53:28.771015+0000","last_active":"2024-05-09T09:54:03.436339+0000","last_peered":"2024-05-09T09:54:03.436339+0000","last_clean":"2024-05-09T09:54:03.436339+0000","last_became_active":"2024-05-09T09:53:28.748303+0000","last_became_peered":"2024-05-09T09:53:28.748303+0000","last_unstale":"2024-05-09T09:54:03.436339+0000","last_undegraded":"2024-05-09T09:54:03.436339+0000","last_fullsized":"2024-05-09T09:54:03.436339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:38.716671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":70,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201887+0000","last_change":"2024-05-09T09:53:13.149070+0000","last_active":"2024-05-09T09:54:03.201887+0000","last_peered":"2024-05-09T09:54:03.201887+0000","last_clean":"2024-05-09T09:54:03.201887+0000","last_became_active":"2024-05-09T09:53:13.148617+0000","last_became_peered":"2024-05-09T09:53:13.148617+0000","last_unstale":"2024-05-09T09:54:03.201887+0000","last_undegraded":"2024-05-09T09:54:03.201887+0000","last_fullsized":"2024-05-09T09:54:03.201887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:38.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'2","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321500+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:54:03.321500+0000","last_peered":"2024-05-09T09:54:03.321500+0000","last_clean":"2024-05-09T09:54:03.321500+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:54:03.321500+0000","last_undegraded":"2024-05-09T09:54:03.321500+0000","last_fullsized":"2024-05-09T09:54:03.321500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217199+0000","last_change":"2024-05-09T09:53:28.775511+0000","last_active":"2024-05-09T09:54:04.217199+0000","last_peered":"2024-05-09T09:54:04.217199+0000","last_clean":"2024-05-09T09:54:04.217199+0000","last_became_active":"2024-05-09T09:53:28.773612+0000","last_became_peered":"2024-05-09T09:53:28.773612+0000","last_unstale":"2024-05-09T09:54:04.217199+0000","last_undegraded":"2024-05-09T09:54:04.217199+0000","last_fullsized":"2024-05-09T09:54:04.217199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:05.916196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220177+0000","last_change":"2024-05-09T09:53:09.110661+0000","last_active":"2024-05-09T09:54:04.220177+0000","last_peered":"2024-05-09T09:54:04.220177+0000","last_clean":"2024-05-09T09:54:04.220177+0000","last_became_active":"2024-05-09T09:53:09.110341+0000","last_became_peered":"2024-05-09T09:53:09.110341+0000","last_unstale":"2024-05-09T09:54:04.220177+0000","last_undegraded":"2024-05-09T09:54:04.220177+0000","last_fullsized":"2024-05-09T09:54:04.220177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205649+0000","last_change":"2024-05-09T09:53:07.106510+0000","last_active":"2024-05-09T09:54:03.205649+0000","last_peered":"2024-05-09T09:54:03.205649+0000","last_clean":"2024-05-09T09:54:03.205649+0000","last_became_active":"2024-05-09T09:53:07.106159+0000","last_became_peered":"2024-05-09T09:53:07.106159+0000","last_unstale":"2024-05-09T09:54:03.205649+0000","last_undegraded":"2024-05-09T09:54:03.205649+0000","last_fullsized":"2024-05-09T09:54:03.205649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435888+0000","last_change":"2024-05-09T09:53:28.778309+0000","last_active":"2024-05-09T09:54:03.435888+0000","last_peered":"2024-05-09T09:54:03.435888+0000","last_clean":"2024-05-09T09:54:03.435888+0000","last_became_active":"2024-05-09T09:53:28.777865+0000","last_became_peered":"2024-05-09T09:53:28.777865+0000","last_unstale":"2024-05-09T09:54:03.435888+0000","last_undegraded":"2024-05-09T09:54:03.435888+0000","last_fullsized":"2024-05-09T09:54:03.435888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:19:44.556837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"30'17","reported_seq":84,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436223+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:54:03.436223+0000","last_peered":"2024-05-09T09:54:03.436223+0000","last_clean":"2024-05-09T09:54:03.436223+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:54:03.436223+0000","last_undegraded":"2024-05-09T09:54:03.436223+0000","last_fullsized":"2024-05-09T09:54:03.436223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320193+0000","last_change":"2024-05-09T09:53:15.172479+0000","last_active":"2024-05-09T09:54:03.320193+0000","last_peered":"2024-05-09T09:54:03.320193+0000","last_clean":"2024-05-09T09:54:03.320193+0000","last_became_active":"2024-05-09T09:53:15.171668+0000","last_became_peered":"2024-05-09T09:53:15.171668+0000","last_unstale":"2024-05-09T09:54:03.320193+0000","last_undegraded":"2024-05-09T09:54:03.320193+0000","last_fullsized":"2024-05-09T09:54:03.320193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:10.247676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220883+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:54:04.220883+0000","last_peered":"2024-05-09T09:54:04.220883+0000","last_clean":"2024-05-09T09:54:04.220883+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:54:04.220883+0000","last_undegraded":"2024-05-09T09:54:04.220883+0000","last_fullsized":"2024-05-09T09:54:04.220883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":69,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321824+0000","last_change":"2024-05-09T09:53:28.743912+0000","last_active":"2024-05-09T09:54:03.321824+0000","last_peered":"2024-05-09T09:54:03.321824+0000","last_clean":"2024-05-09T09:54:03.321824+0000","last_became_active":"2024-05-09T09:53:28.743471+0000","last_became_peered":"2024-05-09T09:53:28.743471+0000","last_unstale":"2024-05-09T09:54:03.321824+0000","last_undegraded":"2024-05-09T09:54:03.321824+0000","last_fullsized":"2024-05-09T09:54:03.321824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:05.292436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269317+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:54:04.269317+0000","last_peered":"2024-05-09T09:54:04.269317+0000","last_clean":"2024-05-09T09:54:04.269317+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:54:04.269317+0000","last_undegraded":"2024-05-09T09:54:04.269317+0000","last_fullsized":"2024-05-09T09:54:04.269317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435233+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:54:03.435233+0000","last_peered":"2024-05-09T09:54:03.435233+0000","last_clean":"2024-05-09T09:54:03.435233+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:54:03.435233+0000","last_undegraded":"2024-05-09T09:54:03.435233+0000","last_fullsized":"2024-05-09T09:54:03.435233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202634+0000","last_change":"2024-05-09T09:53:07.133344+0000","last_active":"2024-05-09T09:54:03.202634+0000","last_peered":"2024-05-09T09:54:03.202634+0000","last_clean":"2024-05-09T09:54:03.202634+0000","last_became_active":"2024-05-09T09:53:07.132983+0000","last_became_peered":"2024-05-09T09:53:07.132983+0000","last_unstale":"2024-05-09T09:54:03.202634+0000","last_undegraded":"2024-05-09T09:54:03.202634+0000","last_fullsized":"2024-05-09T09:54:03.202634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269856+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:54:04.269856+0000","last_peered":"2024-05-09T09:54:04.269856+0000","last_clean":"2024-05-09T09:54:04.269856+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:54:04.269856+0000","last_undegraded":"2024-05-09T09:54:04.269856+0000","last_fullsized":"2024-05-09T09:54:04.269856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"30'13","reported_seq":83,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436479+0000","last_change":"2024-05-09T09:53:13.142914+0000","last_active":"2024-05-09T09:54:03.436479+0000","last_peered":"2024-05-09T09:54:03.436479+0000","last_clean":"2024-05-09T09:54:03.436479+0000","last_became_active":"2024-05-09T09:53:13.142158+0000","last_became_peered":"2024-05-09T09:53:13.142158+0000","last_unstale":"2024-05-09T09:54:03.436479+0000","last_undegraded":"2024-05-09T09:54:03.436479+0000","last_fullsized":"2024-05-09T09:54:03.436479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:07:08.535414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219499+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:54:04.219499+0000","last_peered":"2024-05-09T09:54:04.219499+0000","last_clean":"2024-05-09T09:54:04.219499+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:54:04.219499+0000","last_undegraded":"2024-05-09T09:54:04.219499+0000","last_fullsized":"2024-05-09T09:54:04.219499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319780+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:54:03.319780+0000","last_peered":"2024-05-09T09:54:03.319780+0000","last_clean":"2024-05-09T09:54:03.319780+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:54:03.319780+0000","last_undegraded":"2024-05-09T09:54:03.319780+0000","last_fullsized":"2024-05-09T09:54:03.319780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219228+0000","last_change":"2024-05-09T09:53:54.476843+0000","last_active":"2024-05-09T09:54:04.219228+0000","last_peered":"2024-05-09T09:54:04.219228+0000","last_clean":"2024-05-09T09:54:04.219228+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:54:04.219228+0000","last_undegraded":"2024-05-09T09:54:04.219228+0000","last_fullsized":"2024-05-09T09:54:04.219228+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:48.486905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269027+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:54:04.269027+0000","last_peered":"2024-05-09T09:54:04.269027+0000","last_clean":"2024-05-09T09:54:04.269027+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:54:04.269027+0000","last_undegraded":"2024-05-09T09:54:04.269027+0000","last_fullsized":"2024-05-09T09:54:04.269027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216810+0000","last_change":"2024-05-09T09:53:28.760440+0000","last_active":"2024-05-09T09:54:04.216810+0000","last_peered":"2024-05-09T09:54:04.216810+0000","last_clean":"2024-05-09T09:54:04.216810+0000","last_became_active":"2024-05-09T09:53:28.759582+0000","last_became_peered":"2024-05-09T09:53:28.759582+0000","last_unstale":"2024-05-09T09:54:04.216810+0000","last_undegraded":"2024-05-09T09:54:04.216810+0000","last_fullsized":"2024-05-09T09:54:04.216810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:04.160509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436934+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:54:03.436934+0000","last_peered":"2024-05-09T09:54:03.436934+0000","last_clean":"2024-05-09T09:54:03.436934+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:54:03.436934+0000","last_undegraded":"2024-05-09T09:54:03.436934+0000","last_fullsized":"2024-05-09T09:54:03.436934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"30'23","reported_seq":109,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216647+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:54:04.216647+0000","last_peered":"2024-05-09T09:54:04.216647+0000","last_clean":"2024-05-09T09:54:04.216647+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:54:04.216647+0000","last_undegraded":"2024-05-09T09:54:04.216647+0000","last_fullsized":"2024-05-09T09:54:04.216647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271401+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:54:04.271401+0000","last_peered":"2024-05-09T09:54:04.271401+0000","last_clean":"2024-05-09T09:54:04.271401+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:54:04.271401+0000","last_undegraded":"2024-05-09T09:54:04.271401+0000","last_fullsized":"2024-05-09T09:54:04.271401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.223966+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:54:04.223966+0000","last_peered":"2024-05-09T09:54:04.223966+0000","last_clean":"2024-05-09T09:54:04.223966+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:54:04.223966+0000","last_undegraded":"2024-05-09T09:54:04.223966+0000","last_fullsized":"2024-05-09T09:54:04.223966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220254+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:54:04.220254+0000","last_peered":"2024-05-09T09:54:04.220254+0000","last_clean":"2024-05-09T09:54:04.220254+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:54:04.220254+0000","last_undegraded":"2024-05-09T09:54:04.220254+0000","last_fullsized":"2024-05-09T09:54:04.220254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573335+0000","last_change":"2024-05-09T09:53:01.049359+0000","last_active":"2024-05-09T09:54:03.573335+0000","last_peered":"2024-05-09T09:54:03.573335+0000","last_clean":"2024-05-09T09:54:03.573335+0000","last_became_active":"2024-05-09T09:53:01.048940+0000","last_became_peered":"2024-05-09T09:53:01.048940+0000","last_unstale":"2024-05-09T09:54:03.573335+0000","last_undegraded":"2024-05-09T09:54:03.573335+0000","last_fullsized":"2024-05-09T09:54:03.573335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.213882+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:54:04.213882+0000","last_peered":"2024-05-09T09:54:04.213882+0000","last_clean":"2024-05-09T09:54:04.213882+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:54:04.213882+0000","last_undegraded":"2024-05-09T09:54:04.213882+0000","last_fullsized":"2024-05-09T09:54:04.213882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":61,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573365+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:54:03.573365+0000","last_peered":"2024-05-09T09:54:03.573365+0000","last_clean":"2024-05-09T09:54:03.573365+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:54:03.573365+0000","last_undegraded":"2024-05-09T09:54:03.573365+0000","last_fullsized":"2024-05-09T09:54:03.573365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":89,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270991+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:54:04.270991+0000","last_peered":"2024-05-09T09:54:04.270991+0000","last_clean":"2024-05-09T09:54:04.270991+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:54:04.270991+0000","last_undegraded":"2024-05-09T09:54:04.270991+0000","last_fullsized":"2024-05-09T09:54:04.270991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217778+0000","last_change":"2024-05-09T09:53:28.759697+0000","last_active":"2024-05-09T09:54:04.217778+0000","last_peered":"2024-05-09T09:54:04.217778+0000","last_clean":"2024-05-09T09:54:04.217778+0000","last_became_active":"2024-05-09T09:53:28.754487+0000","last_became_peered":"2024-05-09T09:53:28.754487+0000","last_unstale":"2024-05-09T09:54:04.217778+0000","last_undegraded":"2024-05-09T09:54:04.217778+0000","last_fullsized":"2024-05-09T09:54:04.217778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:11:23.077295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206963+0000","last_change":"2024-05-09T09:53:28.771270+0000","last_active":"2024-05-09T09:54:03.206963+0000","last_peered":"2024-05-09T09:54:03.206963+0000","last_clean":"2024-05-09T09:54:03.206963+0000","last_became_active":"2024-05-09T09:53:28.766128+0000","last_became_peered":"2024-05-09T09:53:28.766128+0000","last_unstale":"2024-05-09T09:54:03.206963+0000","last_undegraded":"2024-05-09T09:54:03.206963+0000","last_fullsized":"2024-05-09T09:54:03.206963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:32:30.757143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216986+0000","last_change":"2024-05-09T09:53:09.108330+0000","last_active":"2024-05-09T09:54:04.216986+0000","last_peered":"2024-05-09T09:54:04.216986+0000","last_clean":"2024-05-09T09:54:04.216986+0000","last_became_active":"2024-05-09T09:53:09.107980+0000","last_became_peered":"2024-05-09T09:53:09.107980+0000","last_unstale":"2024-05-09T09:54:04.216986+0000","last_undegraded":"2024-05-09T09:54:04.216986+0000","last_fullsized":"2024-05-09T09:54:04.216986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435826+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:54:03.435826+0000","last_peered":"2024-05-09T09:54:03.435826+0000","last_clean":"2024-05-09T09:54:03.435826+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:54:03.435826+0000","last_undegraded":"2024-05-09T09:54:03.435826+0000","last_fullsized":"2024-05-09T09:54:03.435826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217860+0000","last_change":"2024-05-09T09:53:28.768510+0000","last_active":"2024-05-09T09:54:04.217860+0000","last_peered":"2024-05-09T09:54:04.217860+0000","last_clean":"2024-05-09T09:54:04.217860+0000","last_became_active":"2024-05-09T09:53:28.767365+0000","last_became_peered":"2024-05-09T09:53:28.767365+0000","last_unstale":"2024-05-09T09:54:04.217860+0000","last_undegraded":"2024-05-09T09:54:04.217860+0000","last_fullsized":"2024-05-09T09:54:04.217860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:15:29.736628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218433+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:54:04.218433+0000","last_peered":"2024-05-09T09:54:04.218433+0000","last_clean":"2024-05-09T09:54:04.218433+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:54:04.218433+0000","last_undegraded":"2024-05-09T09:54:04.218433+0000","last_fullsized":"2024-05-09T09:54:04.218433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":92,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201932+0000","last_change":"2024-05-09T09:53:28.810809+0000","last_active":"2024-05-09T09:54:03.201932+0000","last_peered":"2024-05-09T09:54:03.201932+0000","last_clean":"2024-05-09T09:54:03.201932+0000","last_became_active":"2024-05-09T09:53:28.745129+0000","last_became_peered":"2024-05-09T09:53:28.745129+0000","last_unstale":"2024-05-09T09:54:03.201932+0000","last_undegraded":"2024-05-09T09:54:03.201932+0000","last_fullsized":"2024-05-09T09:54:03.201932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:03.327328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322015+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:54:03.322015+0000","last_peered":"2024-05-09T09:54:03.322015+0000","last_clean":"2024-05-09T09:54:03.322015+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:54:03.322015+0000","last_undegraded":"2024-05-09T09:54:03.322015+0000","last_fullsized":"2024-05-09T09:54:03.322015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434069+0000","last_change":"2024-05-09T09:53:17.191919+0000","last_active":"2024-05-09T09:54:03.434069+0000","last_peered":"2024-05-09T09:54:03.434069+0000","last_clean":"2024-05-09T09:54:03.434069+0000","last_became_active":"2024-05-09T09:53:17.191273+0000","last_became_peered":"2024-05-09T09:53:17.191273+0000","last_unstale":"2024-05-09T09:54:03.434069+0000","last_undegraded":"2024-05-09T09:54:03.434069+0000","last_fullsized":"2024-05-09T09:54:03.434069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:41:14.437931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.214423+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:54:04.214423+0000","last_peered":"2024-05-09T09:54:04.214423+0000","last_clean":"2024-05-09T09:54:04.214423+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:54:04.214423+0000","last_undegraded":"2024-05-09T09:54:04.214423+0000","last_fullsized":"2024-05-09T09:54:04.214423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433656+0000","last_change":"2024-05-09T09:53:07.117502+0000","last_active":"2024-05-09T09:54:03.433656+0000","last_peered":"2024-05-09T09:54:03.433656+0000","last_clean":"2024-05-09T09:54:03.433656+0000","last_became_active":"2024-05-09T09:53:07.116656+0000","last_became_peered":"2024-05-09T09:53:07.116656+0000","last_unstale":"2024-05-09T09:54:03.433656+0000","last_undegraded":"2024-05-09T09:54:03.433656+0000","last_fullsized":"2024-05-09T09:54:03.433656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:36.827054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217203+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:54:04.217203+0000","last_peered":"2024-05-09T09:54:04.217203+0000","last_clean":"2024-05-09T09:54:04.217203+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:54:04.217203+0000","last_undegraded":"2024-05-09T09:54:04.217203+0000","last_fullsized":"2024-05-09T09:54:04.217203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217725+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:54:04.217725+0000","last_peered":"2024-05-09T09:54:04.217725+0000","last_clean":"2024-05-09T09:54:04.217725+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:54:04.217725+0000","last_undegraded":"2024-05-09T09:54:04.217725+0000","last_fullsized":"2024-05-09T09:54:04.217725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"30'18","reported_seq":90,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.216116+0000","last_change":"2024-05-09T09:53:13.138657+0000","last_active":"2024-05-09T09:54:04.216116+0000","last_peered":"2024-05-09T09:54:04.216116+0000","last_clean":"2024-05-09T09:54:04.216116+0000","last_became_active":"2024-05-09T09:53:13.138098+0000","last_became_peered":"2024-05-09T09:53:13.138098+0000","last_unstale":"2024-05-09T09:54:04.216116+0000","last_undegraded":"2024-05-09T09:54:04.216116+0000","last_fullsized":"2024-05-09T09:54:04.216116+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200175+0000","last_change":"2024-05-09T09:53:28.764677+0000","last_active":"2024-05-09T09:54:03.200175+0000","last_peered":"2024-05-09T09:54:03.200175+0000","last_clean":"2024-05-09T09:54:03.200175+0000","last_became_active":"2024-05-09T09:53:28.750831+0000","last_became_peered":"2024-05-09T09:53:28.750831+0000","last_unstale":"2024-05-09T09:54:03.200175+0000","last_undegraded":"2024-05-09T09:54:03.200175+0000","last_fullsized":"2024-05-09T09:54:03.200175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.042630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219829+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:54:04.219829+0000","last_peered":"2024-05-09T09:54:04.219829+0000","last_clean":"2024-05-09T09:54:04.219829+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:54:04.219829+0000","last_undegraded":"2024-05-09T09:54:04.219829+0000","last_fullsized":"2024-05-09T09:54:04.219829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218044+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:54:04.218044+0000","last_peered":"2024-05-09T09:54:04.218044+0000","last_clean":"2024-05-09T09:54:04.218044+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:54:04.218044+0000","last_undegraded":"2024-05-09T09:54:04.218044+0000","last_fullsized":"2024-05-09T09:54:04.218044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217059+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:54:04.217059+0000","last_peered":"2024-05-09T09:54:04.217059+0000","last_clean":"2024-05-09T09:54:04.217059+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:54:04.217059+0000","last_undegraded":"2024-05-09T09:54:04.217059+0000","last_fullsized":"2024-05-09T09:54:04.217059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270407+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:54:04.270407+0000","last_peered":"2024-05-09T09:54:04.270407+0000","last_clean":"2024-05-09T09:54:04.270407+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:54:04.270407+0000","last_undegraded":"2024-05-09T09:54:04.270407+0000","last_fullsized":"2024-05-09T09:54:04.270407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320268+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:54:03.320268+0000","last_peered":"2024-05-09T09:54:03.320268+0000","last_clean":"2024-05-09T09:54:03.320268+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:54:03.320268+0000","last_undegraded":"2024-05-09T09:54:03.320268+0000","last_fullsized":"2024-05-09T09:54:03.320268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.214235+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:54:04.214235+0000","last_peered":"2024-05-09T09:54:04.214235+0000","last_clean":"2024-05-09T09:54:04.214235+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:54:04.214235+0000","last_undegraded":"2024-05-09T09:54:04.214235+0000","last_fullsized":"2024-05-09T09:54:04.214235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'2","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434421+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:54:03.434421+0000","last_peered":"2024-05-09T09:54:03.434421+0000","last_clean":"2024-05-09T09:54:03.434421+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:54:03.434421+0000","last_undegraded":"2024-05-09T09:54:03.434421+0000","last_fullsized":"2024-05-09T09:54:03.434421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203130+0000","last_change":"2024-05-09T09:53:17.266084+0000","last_active":"2024-05-09T09:54:03.203130+0000","last_peered":"2024-05-09T09:54:03.203130+0000","last_clean":"2024-05-09T09:54:03.203130+0000","last_became_active":"2024-05-09T09:53:17.265259+0000","last_became_peered":"2024-05-09T09:53:17.265259+0000","last_unstale":"2024-05-09T09:54:03.203130+0000","last_undegraded":"2024-05-09T09:54:03.203130+0000","last_fullsized":"2024-05-09T09:54:03.203130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:37.896643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434981+0000","last_change":"2024-05-09T09:53:54.462031+0000","last_active":"2024-05-09T09:54:03.434981+0000","last_peered":"2024-05-09T09:54:03.434981+0000","last_clean":"2024-05-09T09:54:03.434981+0000","last_became_active":"2024-05-09T09:53:54.461208+0000","last_became_peered":"2024-05-09T09:53:54.461208+0000","last_unstale":"2024-05-09T09:54:03.434981+0000","last_undegraded":"2024-05-09T09:54:03.434981+0000","last_fullsized":"2024-05-09T09:54:03.434981+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.406756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202627+0000","last_change":"2024-05-09T09:53:07.126817+0000","last_active":"2024-05-09T09:54:03.202627+0000","last_peered":"2024-05-09T09:54:03.202627+0000","last_clean":"2024-05-09T09:54:03.202627+0000","last_became_active":"2024-05-09T09:53:07.126401+0000","last_became_peered":"2024-05-09T09:53:07.126401+0000","last_unstale":"2024-05-09T09:54:03.202627+0000","last_undegraded":"2024-05-09T09:54:03.202627+0000","last_fullsized":"2024-05-09T09:54:03.202627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218821+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:54:04.218821+0000","last_peered":"2024-05-09T09:54:04.218821+0000","last_clean":"2024-05-09T09:54:04.218821+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:54:04.218821+0000","last_undegraded":"2024-05-09T09:54:04.218821+0000","last_fullsized":"2024-05-09T09:54:04.218821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200043+0000","last_change":"2024-05-09T09:53:28.765354+0000","last_active":"2024-05-09T09:54:03.200043+0000","last_peered":"2024-05-09T09:54:03.200043+0000","last_clean":"2024-05-09T09:54:03.200043+0000","last_became_active":"2024-05-09T09:53:28.746277+0000","last_became_peered":"2024-05-09T09:53:28.746277+0000","last_unstale":"2024-05-09T09:54:03.200043+0000","last_undegraded":"2024-05-09T09:54:03.200043+0000","last_fullsized":"2024-05-09T09:54:03.200043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:59.736713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":87,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203218+0000","last_change":"2024-05-09T09:53:28.789938+0000","last_active":"2024-05-09T09:54:03.203218+0000","last_peered":"2024-05-09T09:54:03.203218+0000","last_clean":"2024-05-09T09:54:03.203218+0000","last_became_active":"2024-05-09T09:53:28.745262+0000","last_became_peered":"2024-05-09T09:53:28.745262+0000","last_unstale":"2024-05-09T09:54:03.203218+0000","last_undegraded":"2024-05-09T09:54:03.203218+0000","last_fullsized":"2024-05-09T09:54:03.203218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:52.500998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'2","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200189+0000","last_change":"2024-05-09T09:53:15.181187+0000","last_active":"2024-05-09T09:54:03.200189+0000","last_peered":"2024-05-09T09:54:03.200189+0000","last_clean":"2024-05-09T09:54:03.200189+0000","last_became_active":"2024-05-09T09:53:15.180486+0000","last_became_peered":"2024-05-09T09:53:15.180486+0000","last_unstale":"2024-05-09T09:54:03.200189+0000","last_undegraded":"2024-05-09T09:54:03.200189+0000","last_fullsized":"2024-05-09T09:54:03.200189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:33.941331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217864+0000","last_change":"2024-05-09T09:53:17.173663+0000","last_active":"2024-05-09T09:54:04.217864+0000","last_peered":"2024-05-09T09:54:04.217864+0000","last_clean":"2024-05-09T09:54:04.217864+0000","last_became_active":"2024-05-09T09:53:17.172903+0000","last_became_peered":"2024-05-09T09:53:17.172903+0000","last_unstale":"2024-05-09T09:54:04.217864+0000","last_undegraded":"2024-05-09T09:54:04.217864+0000","last_fullsized":"2024-05-09T09:54:04.217864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:13.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434863+0000","last_change":"2024-05-09T09:53:28.746682+0000","last_active":"2024-05-09T09:54:03.434863+0000","last_peered":"2024-05-09T09:54:03.434863+0000","last_clean":"2024-05-09T09:54:03.434863+0000","last_became_active":"2024-05-09T09:53:28.745900+0000","last_became_peered":"2024-05-09T09:53:28.745900+0000","last_unstale":"2024-05-09T09:54:03.434863+0000","last_undegraded":"2024-05-09T09:54:03.434863+0000","last_fullsized":"2024-05-09T09:54:03.434863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:44.945655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219022+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:54:04.219022+0000","last_peered":"2024-05-09T09:54:04.219022+0000","last_clean":"2024-05-09T09:54:04.219022+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:54:04.219022+0000","last_undegraded":"2024-05-09T09:54:04.219022+0000","last_fullsized":"2024-05-09T09:54:04.219022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322406+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:54:03.322406+0000","last_peered":"2024-05-09T09:54:03.322406+0000","last_clean":"2024-05-09T09:54:03.322406+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:54:03.322406+0000","last_undegraded":"2024-05-09T09:54:03.322406+0000","last_fullsized":"2024-05-09T09:54:03.322406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205967+0000","last_change":"2024-05-09T09:53:11.119230+0000","last_active":"2024-05-09T09:54:03.205967+0000","last_peered":"2024-05-09T09:54:03.205967+0000","last_clean":"2024-05-09T09:54:03.205967+0000","last_became_active":"2024-05-09T09:53:11.118785+0000","last_became_peered":"2024-05-09T09:53:11.118785+0000","last_unstale":"2024-05-09T09:54:03.205967+0000","last_undegraded":"2024-05-09T09:54:03.205967+0000","last_fullsized":"2024-05-09T09:54:03.205967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:01.845355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"30'19","reported_seq":94,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269326+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:54:04.269326+0000","last_peered":"2024-05-09T09:54:04.269326+0000","last_clean":"2024-05-09T09:54:04.269326+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:54:04.269326+0000","last_undegraded":"2024-05-09T09:54:04.269326+0000","last_fullsized":"2024-05-09T09:54:04.269326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202865+0000","last_change":"2024-05-09T09:53:15.168489+0000","last_active":"2024-05-09T09:54:03.202865+0000","last_peered":"2024-05-09T09:54:03.202865+0000","last_clean":"2024-05-09T09:54:03.202865+0000","last_became_active":"2024-05-09T09:53:15.167829+0000","last_became_peered":"2024-05-09T09:53:15.167829+0000","last_unstale":"2024-05-09T09:54:03.202865+0000","last_undegraded":"2024-05-09T09:54:03.202865+0000","last_fullsized":"2024-05-09T09:54:03.202865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:27:00.491112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435329+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:54:03.435329+0000","last_peered":"2024-05-09T09:54:03.435329+0000","last_clean":"2024-05-09T09:54:03.435329+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:54:03.435329+0000","last_undegraded":"2024-05-09T09:54:03.435329+0000","last_fullsized":"2024-05-09T09:54:03.435329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218549+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:54:04.218549+0000","last_peered":"2024-05-09T09:54:04.218549+0000","last_clean":"2024-05-09T09:54:04.218549+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:54:04.218549+0000","last_undegraded":"2024-05-09T09:54:04.218549+0000","last_fullsized":"2024-05-09T09:54:04.218549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320916+0000","last_change":"2024-05-09T09:53:28.758299+0000","last_active":"2024-05-09T09:54:03.320916+0000","last_peered":"2024-05-09T09:54:03.320916+0000","last_clean":"2024-05-09T09:54:03.320916+0000","last_became_active":"2024-05-09T09:53:28.757819+0000","last_became_peered":"2024-05-09T09:53:28.757819+0000","last_unstale":"2024-05-09T09:54:03.320916+0000","last_undegraded":"2024-05-09T09:54:03.320916+0000","last_fullsized":"2024-05-09T09:54:03.320916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:41.435444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270119+0000","last_change":"2024-05-09T09:53:28.744175+0000","last_active":"2024-05-09T09:54:04.270119+0000","last_peered":"2024-05-09T09:54:04.270119+0000","last_clean":"2024-05-09T09:54:04.270119+0000","last_became_active":"2024-05-09T09:53:28.743783+0000","last_became_peered":"2024-05-09T09:53:28.743783+0000","last_unstale":"2024-05-09T09:54:04.270119+0000","last_undegraded":"2024-05-09T09:54:04.270119+0000","last_fullsized":"2024-05-09T09:54:04.270119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:03.321447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.213885+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:54:04.213885+0000","last_peered":"2024-05-09T09:54:04.213885+0000","last_clean":"2024-05-09T09:54:04.213885+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:54:04.213885+0000","last_undegraded":"2024-05-09T09:54:04.213885+0000","last_fullsized":"2024-05-09T09:54:04.213885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"30'11","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.199925+0000","last_change":"2024-05-09T09:53:13.138669+0000","last_active":"2024-05-09T09:54:03.199925+0000","last_peered":"2024-05-09T09:54:03.199925+0000","last_clean":"2024-05-09T09:54:03.199925+0000","last_became_active":"2024-05-09T09:53:13.137815+0000","last_became_peered":"2024-05-09T09:53:13.137815+0000","last_unstale":"2024-05-09T09:54:03.199925+0000","last_undegraded":"2024-05-09T09:54:03.199925+0000","last_fullsized":"2024-05-09T09:54:03.199925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:14:09.306529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205201+0000","last_change":"2024-05-09T09:53:15.180530+0000","last_active":"2024-05-09T09:54:03.205201+0000","last_peered":"2024-05-09T09:54:03.205201+0000","last_clean":"2024-05-09T09:54:03.205201+0000","last_became_active":"2024-05-09T09:53:15.179752+0000","last_became_peered":"2024-05-09T09:53:15.179752+0000","last_unstale":"2024-05-09T09:54:03.205201+0000","last_undegraded":"2024-05-09T09:54:03.205201+0000","last_fullsized":"2024-05-09T09:54:03.205201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:14.853148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201659+0000","last_change":"2024-05-09T09:53:17.186939+0000","last_active":"2024-05-09T09:54:03.201659+0000","last_peered":"2024-05-09T09:54:03.201659+0000","last_clean":"2024-05-09T09:54:03.201659+0000","last_became_active":"2024-05-09T09:53:17.186138+0000","last_became_peered":"2024-05-09T09:53:17.186138+0000","last_unstale":"2024-05-09T09:54:03.201659+0000","last_undegraded":"2024-05-09T09:54:03.201659+0000","last_fullsized":"2024-05-09T09:54:03.201659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:52.756156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.214496+0000","last_change":"2024-05-09T09:53:09.116139+0000","last_active":"2024-05-09T09:54:04.214496+0000","last_peered":"2024-05-09T09:54:04.214496+0000","last_clean":"2024-05-09T09:54:04.214496+0000","last_became_active":"2024-05-09T09:53:09.115542+0000","last_became_peered":"2024-05-09T09:53:09.115542+0000","last_unstale":"2024-05-09T09:54:04.214496+0000","last_undegraded":"2024-05-09T09:54:04.214496+0000","last_fullsized":"2024-05-09T09:54:04.214496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:18.060153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270566+0000","last_change":"2024-05-09T09:53:07.123261+0000","last_active":"2024-05-09T09:54:04.270566+0000","last_peered":"2024-05-09T09:54:04.270566+0000","last_clean":"2024-05-09T09:54:04.270566+0000","last_became_active":"2024-05-09T09:53:07.122491+0000","last_became_peered":"2024-05-09T09:53:07.122491+0000","last_unstale":"2024-05-09T09:54:04.270566+0000","last_undegraded":"2024-05-09T09:54:04.270566+0000","last_fullsized":"2024-05-09T09:54:04.270566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:31.417620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206845+0000","last_change":"2024-05-09T09:53:11.117544+0000","last_active":"2024-05-09T09:54:03.206845+0000","last_peered":"2024-05-09T09:54:03.206845+0000","last_clean":"2024-05-09T09:54:03.206845+0000","last_became_active":"2024-05-09T09:53:11.116890+0000","last_became_peered":"2024-05-09T09:53:11.116890+0000","last_unstale":"2024-05-09T09:54:03.206845+0000","last_undegraded":"2024-05-09T09:54:03.206845+0000","last_fullsized":"2024-05-09T09:54:03.206845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:17.548338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'5","reported_seq":65,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.215972+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:54:04.215972+0000","last_peered":"2024-05-09T09:54:04.215972+0000","last_clean":"2024-05-09T09:54:04.215972+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:54:04.215972+0000","last_undegraded":"2024-05-09T09:54:04.215972+0000","last_fullsized":"2024-05-09T09:54:04.215972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269664+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:54:04.269664+0000","last_peered":"2024-05-09T09:54:04.269664+0000","last_clean":"2024-05-09T09:54:04.269664+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:54:04.269664+0000","last_undegraded":"2024-05-09T09:54:04.269664+0000","last_fullsized":"2024-05-09T09:54:04.269664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218332+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:54:04.218332+0000","last_peered":"2024-05-09T09:54:04.218332+0000","last_clean":"2024-05-09T09:54:04.218332+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:54:04.218332+0000","last_undegraded":"2024-05-09T09:54:04.218332+0000","last_fullsized":"2024-05-09T09:54:04.218332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201035+0000","last_change":"2024-05-09T09:53:09.136473+0000","last_active":"2024-05-09T09:54:03.201035+0000","last_peered":"2024-05-09T09:54:03.201035+0000","last_clean":"2024-05-09T09:54:03.201035+0000","last_became_active":"2024-05-09T09:53:09.136201+0000","last_became_peered":"2024-05-09T09:53:09.136201+0000","last_unstale":"2024-05-09T09:54:03.201035+0000","last_undegraded":"2024-05-09T09:54:03.201035+0000","last_fullsized":"2024-05-09T09:54:03.201035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436044+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:54:03.436044+0000","last_peered":"2024-05-09T09:54:03.436044+0000","last_clean":"2024-05-09T09:54:03.436044+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:54:03.436044+0000","last_undegraded":"2024-05-09T09:54:03.436044+0000","last_fullsized":"2024-05-09T09:54:03.436044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":73,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268438+0000","last_change":"2024-05-09T09:53:28.749167+0000","last_active":"2024-05-09T09:54:04.268438+0000","last_peered":"2024-05-09T09:54:04.268438+0000","last_clean":"2024-05-09T09:54:04.268438+0000","last_became_active":"2024-05-09T09:53:28.739510+0000","last_became_peered":"2024-05-09T09:53:28.739510+0000","last_unstale":"2024-05-09T09:54:04.268438+0000","last_undegraded":"2024-05-09T09:54:04.268438+0000","last_fullsized":"2024-05-09T09:54:04.268438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:42.520109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"30'11","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206608+0000","last_change":"2024-05-09T09:53:13.143103+0000","last_active":"2024-05-09T09:54:03.206608+0000","last_peered":"2024-05-09T09:54:03.206608+0000","last_clean":"2024-05-09T09:54:03.206608+0000","last_became_active":"2024-05-09T09:53:13.142107+0000","last_became_peered":"2024-05-09T09:53:13.142107+0000","last_unstale":"2024-05-09T09:54:03.206608+0000","last_undegraded":"2024-05-09T09:54:03.206608+0000","last_fullsized":"2024-05-09T09:54:03.206608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:38.201518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320063+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:54:03.320063+0000","last_peered":"2024-05-09T09:54:03.320063+0000","last_clean":"2024-05-09T09:54:03.320063+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:54:03.320063+0000","last_undegraded":"2024-05-09T09:54:03.320063+0000","last_fullsized":"2024-05-09T09:54:03.320063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434737+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:54:03.434737+0000","last_peered":"2024-05-09T09:54:03.434737+0000","last_clean":"2024-05-09T09:54:03.434737+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:54:03.434737+0000","last_undegraded":"2024-05-09T09:54:03.434737+0000","last_fullsized":"2024-05-09T09:54:03.434737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205792+0000","last_change":"2024-05-09T09:53:09.113837+0000","last_active":"2024-05-09T09:54:03.205792+0000","last_peered":"2024-05-09T09:54:03.205792+0000","last_clean":"2024-05-09T09:54:03.205792+0000","last_became_active":"2024-05-09T09:53:09.113332+0000","last_became_peered":"2024-05-09T09:53:09.113332+0000","last_unstale":"2024-05-09T09:54:03.205792+0000","last_undegraded":"2024-05-09T09:54:03.205792+0000","last_fullsized":"2024-05-09T09:54:03.205792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220427+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:54:04.220427+0000","last_peered":"2024-05-09T09:54:04.220427+0000","last_clean":"2024-05-09T09:54:04.220427+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:54:04.220427+0000","last_undegraded":"2024-05-09T09:54:04.220427+0000","last_fullsized":"2024-05-09T09:54:04.220427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320467+0000","last_change":"2024-05-09T09:53:28.742646+0000","last_active":"2024-05-09T09:54:03.320467+0000","last_peered":"2024-05-09T09:54:03.320467+0000","last_clean":"2024-05-09T09:54:03.320467+0000","last_became_active":"2024-05-09T09:53:28.741146+0000","last_became_peered":"2024-05-09T09:53:28.741146+0000","last_unstale":"2024-05-09T09:54:03.320467+0000","last_undegraded":"2024-05-09T09:54:03.320467+0000","last_fullsized":"2024-05-09T09:54:03.320467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:22.885815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"30'9","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268854+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:54:04.268854+0000","last_peered":"2024-05-09T09:54:04.268854+0000","last_clean":"2024-05-09T09:54:04.268854+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:54:04.268854+0000","last_undegraded":"2024-05-09T09:54:04.268854+0000","last_fullsized":"2024-05-09T09:54:04.268854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217391+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:54:04.217391+0000","last_peered":"2024-05-09T09:54:04.217391+0000","last_clean":"2024-05-09T09:54:04.217391+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:54:04.217391+0000","last_undegraded":"2024-05-09T09:54:04.217391+0000","last_fullsized":"2024-05-09T09:54:04.217391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322283+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:54:03.322283+0000","last_peered":"2024-05-09T09:54:03.322283+0000","last_clean":"2024-05-09T09:54:03.322283+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:54:03.322283+0000","last_undegraded":"2024-05-09T09:54:03.322283+0000","last_fullsized":"2024-05-09T09:54:03.322283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.205538+0000","last_change":"2024-05-09T09:53:07.103925+0000","last_active":"2024-05-09T09:54:03.205538+0000","last_peered":"2024-05-09T09:54:03.205538+0000","last_clean":"2024-05-09T09:54:03.205538+0000","last_became_active":"2024-05-09T09:53:07.103470+0000","last_became_peered":"2024-05-09T09:53:07.103470+0000","last_unstale":"2024-05-09T09:54:03.205538+0000","last_undegraded":"2024-05-09T09:54:03.205538+0000","last_fullsized":"2024-05-09T09:54:03.205538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219423+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:54:04.219423+0000","last_peered":"2024-05-09T09:54:04.219423+0000","last_clean":"2024-05-09T09:54:04.219423+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:54:04.219423+0000","last_undegraded":"2024-05-09T09:54:04.219423+0000","last_fullsized":"2024-05-09T09:54:04.219423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"30'12","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220581+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:54:04.220581+0000","last_peered":"2024-05-09T09:54:04.220581+0000","last_clean":"2024-05-09T09:54:04.220581+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:54:04.220581+0000","last_undegraded":"2024-05-09T09:54:04.220581+0000","last_fullsized":"2024-05-09T09:54:04.220581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433949+0000","last_change":"2024-05-09T09:53:15.165405+0000","last_active":"2024-05-09T09:54:03.433949+0000","last_peered":"2024-05-09T09:54:03.433949+0000","last_clean":"2024-05-09T09:54:03.433949+0000","last_became_active":"2024-05-09T09:53:15.164221+0000","last_became_peered":"2024-05-09T09:53:15.164221+0000","last_unstale":"2024-05-09T09:54:03.433949+0000","last_undegraded":"2024-05-09T09:54:03.433949+0000","last_fullsized":"2024-05-09T09:54:03.433949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:50.451431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.206393+0000","last_change":"2024-05-09T09:53:17.269258+0000","last_active":"2024-05-09T09:54:03.206393+0000","last_peered":"2024-05-09T09:54:03.206393+0000","last_clean":"2024-05-09T09:54:03.206393+0000","last_became_active":"2024-05-09T09:53:17.268496+0000","last_became_peered":"2024-05-09T09:53:17.268496+0000","last_unstale":"2024-05-09T09:54:03.206393+0000","last_undegraded":"2024-05-09T09:54:03.206393+0000","last_fullsized":"2024-05-09T09:54:03.206393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:01.756096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.219304+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:54:04.219304+0000","last_peered":"2024-05-09T09:54:04.219304+0000","last_clean":"2024-05-09T09:54:04.219304+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:54:04.219304+0000","last_undegraded":"2024-05-09T09:54:04.219304+0000","last_fullsized":"2024-05-09T09:54:04.219304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.223720+0000","last_change":"2024-05-09T09:53:54.475349+0000","last_active":"2024-05-09T09:54:04.223720+0000","last_peered":"2024-05-09T09:54:04.223720+0000","last_clean":"2024-05-09T09:54:04.223720+0000","last_became_active":"2024-05-09T09:53:54.474959+0000","last_became_peered":"2024-05-09T09:53:54.474959+0000","last_unstale":"2024-05-09T09:54:04.223720+0000","last_undegraded":"2024-05-09T09:54:04.223720+0000","last_fullsized":"2024-05-09T09:54:04.223720+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:26.396710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322125+0000","last_change":"2024-05-09T09:53:28.741150+0000","last_active":"2024-05-09T09:54:03.322125+0000","last_peered":"2024-05-09T09:54:03.322125+0000","last_clean":"2024-05-09T09:54:03.322125+0000","last_became_active":"2024-05-09T09:53:28.740892+0000","last_became_peered":"2024-05-09T09:53:28.740892+0000","last_unstale":"2024-05-09T09:54:03.322125+0000","last_undegraded":"2024-05-09T09:54:03.322125+0000","last_fullsized":"2024-05-09T09:54:03.322125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:26.374270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"30'15","reported_seq":83,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269687+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:54:04.269687+0000","last_peered":"2024-05-09T09:54:04.269687+0000","last_clean":"2024-05-09T09:54:04.269687+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:54:04.269687+0000","last_undegraded":"2024-05-09T09:54:04.269687+0000","last_fullsized":"2024-05-09T09:54:04.269687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220505+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:54:04.220505+0000","last_peered":"2024-05-09T09:54:04.220505+0000","last_clean":"2024-05-09T09:54:04.220505+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:54:04.220505+0000","last_undegraded":"2024-05-09T09:54:04.220505+0000","last_fullsized":"2024-05-09T09:54:04.220505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319757+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:54:03.319757+0000","last_peered":"2024-05-09T09:54:03.319757+0000","last_clean":"2024-05-09T09:54:03.319757+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:54:03.319757+0000","last_undegraded":"2024-05-09T09:54:03.319757+0000","last_fullsized":"2024-05-09T09:54:03.319757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203305+0000","last_change":"2024-05-09T09:53:09.113372+0000","last_active":"2024-05-09T09:54:03.203305+0000","last_peered":"2024-05-09T09:54:03.203305+0000","last_clean":"2024-05-09T09:54:03.203305+0000","last_became_active":"2024-05-09T09:53:09.113041+0000","last_became_peered":"2024-05-09T09:53:09.113041+0000","last_unstale":"2024-05-09T09:54:03.203305+0000","last_undegraded":"2024-05-09T09:54:03.203305+0000","last_fullsized":"2024-05-09T09:54:03.203305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:00.152062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.214346+0000","last_change":"2024-05-09T09:53:28.753324+0000","last_active":"2024-05-09T09:54:04.214346+0000","last_peered":"2024-05-09T09:54:04.214346+0000","last_clean":"2024-05-09T09:54:04.214346+0000","last_became_active":"2024-05-09T09:53:28.752392+0000","last_became_peered":"2024-05-09T09:53:28.752392+0000","last_unstale":"2024-05-09T09:54:04.214346+0000","last_undegraded":"2024-05-09T09:54:04.214346+0000","last_fullsized":"2024-05-09T09:54:04.214346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:32.264858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202013+0000","last_change":"2024-05-09T09:53:28.776777+0000","last_active":"2024-05-09T09:54:03.202013+0000","last_peered":"2024-05-09T09:54:03.202013+0000","last_clean":"2024-05-09T09:54:03.202013+0000","last_became_active":"2024-05-09T09:53:28.771962+0000","last_became_peered":"2024-05-09T09:53:28.771962+0000","last_unstale":"2024-05-09T09:54:03.202013+0000","last_undegraded":"2024-05-09T09:54:03.202013+0000","last_fullsized":"2024-05-09T09:54:03.202013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:14.948048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"30'11","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203318+0000","last_change":"2024-05-09T09:53:13.152997+0000","last_active":"2024-05-09T09:54:03.203318+0000","last_peered":"2024-05-09T09:54:03.203318+0000","last_clean":"2024-05-09T09:54:03.203318+0000","last_became_active":"2024-05-09T09:53:13.152490+0000","last_became_peered":"2024-05-09T09:53:13.152490+0000","last_unstale":"2024-05-09T09:54:03.203318+0000","last_undegraded":"2024-05-09T09:54:03.203318+0000","last_fullsized":"2024-05-09T09:54:03.203318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:45.449537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218420+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:54:04.218420+0000","last_peered":"2024-05-09T09:54:04.218420+0000","last_clean":"2024-05-09T09:54:04.218420+0000","last_became_active":"2024-05-09T09:53:15.167480+0000","last_became_peered":"2024-05-09T09:53:15.167480+0000","last_unstale":"2024-05-09T09:54:04.218420+0000","last_undegraded":"2024-05-09T09:54:04.218420+0000","last_fullsized":"2024-05-09T09:54:04.218420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:07.450989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":48,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434309+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:54:03.434309+0000","last_peered":"2024-05-09T09:54:03.434309+0000","last_clean":"2024-05-09T09:54:03.434309+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:54:03.434309+0000","last_undegraded":"2024-05-09T09:54:03.434309+0000","last_fullsized":"2024-05-09T09:54:03.434309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574439+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:54:03.574439+0000","last_peered":"2024-05-09T09:54:03.574439+0000","last_clean":"2024-05-09T09:54:03.574439+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:54:03.574439+0000","last_undegraded":"2024-05-09T09:54:03.574439+0000","last_fullsized":"2024-05-09T09:54:03.574439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217472+0000","last_change":"2024-05-09T09:53:28.761425+0000","last_active":"2024-05-09T09:54:04.217472+0000","last_peered":"2024-05-09T09:54:04.217472+0000","last_clean":"2024-05-09T09:54:04.217472+0000","last_became_active":"2024-05-09T09:53:28.761078+0000","last_became_peered":"2024-05-09T09:53:28.761078+0000","last_unstale":"2024-05-09T09:54:04.217472+0000","last_undegraded":"2024-05-09T09:54:04.217472+0000","last_fullsized":"2024-05-09T09:54:04.217472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:27.825337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220235+0000","last_change":"2024-05-09T09:53:28.769345+0000","last_active":"2024-05-09T09:54:04.220235+0000","last_peered":"2024-05-09T09:54:04.220235+0000","last_clean":"2024-05-09T09:54:04.220235+0000","last_became_active":"2024-05-09T09:53:28.769135+0000","last_became_peered":"2024-05-09T09:53:28.769135+0000","last_unstale":"2024-05-09T09:54:04.220235+0000","last_undegraded":"2024-05-09T09:54:04.220235+0000","last_fullsized":"2024-05-09T09:54:04.220235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:10.820319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":88,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321858+0000","last_change":"2024-05-09T09:53:28.776504+0000","last_active":"2024-05-09T09:54:03.321858+0000","last_peered":"2024-05-09T09:54:03.321858+0000","last_clean":"2024-05-09T09:54:03.321858+0000","last_became_active":"2024-05-09T09:53:28.743863+0000","last_became_peered":"2024-05-09T09:53:28.743863+0000","last_unstale":"2024-05-09T09:54:03.321858+0000","last_undegraded":"2024-05-09T09:54:03.321858+0000","last_fullsized":"2024-05-09T09:54:03.321858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:38.290799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"32'3","reported_seq":74,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321738+0000","last_change":"2024-05-09T09:53:28.778387+0000","last_active":"2024-05-09T09:54:03.321738+0000","last_peered":"2024-05-09T09:54:03.321738+0000","last_clean":"2024-05-09T09:54:03.321738+0000","last_became_active":"2024-05-09T09:53:28.740628+0000","last_became_peered":"2024-05-09T09:53:28.740628+0000","last_unstale":"2024-05-09T09:54:03.321738+0000","last_undegraded":"2024-05-09T09:54:03.321738+0000","last_fullsized":"2024-05-09T09:54:03.321738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:04.362375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268421+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:54:04.268421+0000","last_peered":"2024-05-09T09:54:04.268421+0000","last_clean":"2024-05-09T09:54:04.268421+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:54:04.268421+0000","last_undegraded":"2024-05-09T09:54:04.268421+0000","last_fullsized":"2024-05-09T09:54:04.268421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.207271+0000","last_change":"2024-05-09T09:53:28.770704+0000","last_active":"2024-05-09T09:54:03.207271+0000","last_peered":"2024-05-09T09:54:03.207271+0000","last_clean":"2024-05-09T09:54:03.207271+0000","last_became_active":"2024-05-09T09:53:28.765094+0000","last_became_peered":"2024-05-09T09:53:28.765094+0000","last_unstale":"2024-05-09T09:54:03.207271+0000","last_undegraded":"2024-05-09T09:54:03.207271+0000","last_fullsized":"2024-05-09T09:54:03.207271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:12.287035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574087+0000","last_change":"2024-05-09T09:53:54.471391+0000","last_active":"2024-05-09T09:54:03.574087+0000","last_peered":"2024-05-09T09:54:03.574087+0000","last_clean":"2024-05-09T09:54:03.574087+0000","last_became_active":"2024-05-09T09:53:54.471100+0000","last_became_peered":"2024-05-09T09:53:54.471100+0000","last_unstale":"2024-05-09T09:54:03.574087+0000","last_undegraded":"2024-05-09T09:54:03.574087+0000","last_fullsized":"2024-05-09T09:54:03.574087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.867000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268958+0000","last_change":"2024-05-09T09:53:28.756530+0000","last_active":"2024-05-09T09:54:04.268958+0000","last_peered":"2024-05-09T09:54:04.268958+0000","last_clean":"2024-05-09T09:54:04.268958+0000","last_became_active":"2024-05-09T09:53:28.756107+0000","last_became_peered":"2024-05-09T09:53:28.756107+0000","last_unstale":"2024-05-09T09:54:04.268958+0000","last_undegraded":"2024-05-09T09:54:04.268958+0000","last_fullsized":"2024-05-09T09:54:04.268958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:53.208895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"30'15","reported_seq":81,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434571+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:54:03.434571+0000","last_peered":"2024-05-09T09:54:03.434571+0000","last_clean":"2024-05-09T09:54:03.434571+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:54:03.434571+0000","last_undegraded":"2024-05-09T09:54:03.434571+0000","last_fullsized":"2024-05-09T09:54:03.434571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.215522+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:54:04.215522+0000","last_peered":"2024-05-09T09:54:04.215522+0000","last_clean":"2024-05-09T09:54:04.215522+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:54:04.215522+0000","last_undegraded":"2024-05-09T09:54:04.215522+0000","last_fullsized":"2024-05-09T09:54:04.215522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271655+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:54:04.271655+0000","last_peered":"2024-05-09T09:54:04.271655+0000","last_clean":"2024-05-09T09:54:04.271655+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:54:04.271655+0000","last_undegraded":"2024-05-09T09:54:04.271655+0000","last_fullsized":"2024-05-09T09:54:04.271655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203342+0000","last_change":"2024-05-09T09:53:28.778385+0000","last_active":"2024-05-09T09:54:03.203342+0000","last_peered":"2024-05-09T09:54:03.203342+0000","last_clean":"2024-05-09T09:54:03.203342+0000","last_became_active":"2024-05-09T09:53:28.777784+0000","last_became_peered":"2024-05-09T09:53:28.777784+0000","last_unstale":"2024-05-09T09:54:03.203342+0000","last_undegraded":"2024-05-09T09:54:03.203342+0000","last_fullsized":"2024-05-09T09:54:03.203342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:25.450368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436673+0000","last_change":"2024-05-09T09:53:28.740051+0000","last_active":"2024-05-09T09:54:03.436673+0000","last_peered":"2024-05-09T09:54:03.436673+0000","last_clean":"2024-05-09T09:54:03.436673+0000","last_became_active":"2024-05-09T09:53:28.739650+0000","last_became_peered":"2024-05-09T09:53:28.739650+0000","last_unstale":"2024-05-09T09:54:03.436673+0000","last_undegraded":"2024-05-09T09:54:03.436673+0000","last_fullsized":"2024-05-09T09:54:03.436673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:12:12.165204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434943+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:54:03.434943+0000","last_peered":"2024-05-09T09:54:03.434943+0000","last_clean":"2024-05-09T09:54:03.434943+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:54:03.434943+0000","last_undegraded":"2024-05-09T09:54:03.434943+0000","last_fullsized":"2024-05-09T09:54:03.434943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"30'9","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.215621+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:54:04.215621+0000","last_peered":"2024-05-09T09:54:04.215621+0000","last_clean":"2024-05-09T09:54:04.215621+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:54:04.215621+0000","last_undegraded":"2024-05-09T09:54:04.215621+0000","last_fullsized":"2024-05-09T09:54:04.215621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":52,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320068+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:54:03.320068+0000","last_peered":"2024-05-09T09:54:03.320068+0000","last_clean":"2024-05-09T09:54:03.320068+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:54:03.320068+0000","last_undegraded":"2024-05-09T09:54:03.320068+0000","last_fullsized":"2024-05-09T09:54:03.320068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":47,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201795+0000","last_change":"2024-05-09T09:53:17.266584+0000","last_active":"2024-05-09T09:54:03.201795+0000","last_peered":"2024-05-09T09:54:03.201795+0000","last_clean":"2024-05-09T09:54:03.201795+0000","last_became_active":"2024-05-09T09:53:17.265947+0000","last_became_peered":"2024-05-09T09:53:17.265947+0000","last_unstale":"2024-05-09T09:54:03.201795+0000","last_undegraded":"2024-05-09T09:54:03.201795+0000","last_fullsized":"2024-05-09T09:54:03.201795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.231815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201218+0000","last_change":"2024-05-09T09:53:09.121438+0000","last_active":"2024-05-09T09:54:03.201218+0000","last_peered":"2024-05-09T09:54:03.201218+0000","last_clean":"2024-05-09T09:54:03.201218+0000","last_became_active":"2024-05-09T09:53:09.121156+0000","last_became_peered":"2024-05-09T09:53:09.121156+0000","last_unstale":"2024-05-09T09:54:03.201218+0000","last_undegraded":"2024-05-09T09:54:03.201218+0000","last_fullsized":"2024-05-09T09:54:03.201218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:59.690822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":67,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.202184+0000","last_change":"2024-05-09T09:53:07.131445+0000","last_active":"2024-05-09T09:54:03.202184+0000","last_peered":"2024-05-09T09:54:03.202184+0000","last_clean":"2024-05-09T09:54:03.202184+0000","last_became_active":"2024-05-09T09:53:07.131006+0000","last_became_peered":"2024-05-09T09:53:07.131006+0000","last_unstale":"2024-05-09T09:54:03.202184+0000","last_undegraded":"2024-05-09T09:54:03.202184+0000","last_fullsized":"2024-05-09T09:54:03.202184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319586+0000","last_change":"2024-05-09T09:53:28.756572+0000","last_active":"2024-05-09T09:54:03.319586+0000","last_peered":"2024-05-09T09:54:03.319586+0000","last_clean":"2024-05-09T09:54:03.319586+0000","last_became_active":"2024-05-09T09:53:28.756123+0000","last_became_peered":"2024-05-09T09:53:28.756123+0000","last_unstale":"2024-05-09T09:54:03.319586+0000","last_undegraded":"2024-05-09T09:54:03.319586+0000","last_fullsized":"2024-05-09T09:54:03.319586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:36.194391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"30'5","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.207420+0000","last_change":"2024-05-09T09:53:13.140437+0000","last_active":"2024-05-09T09:54:03.207420+0000","last_peered":"2024-05-09T09:54:03.207420+0000","last_clean":"2024-05-09T09:54:03.207420+0000","last_became_active":"2024-05-09T09:53:13.138894+0000","last_became_peered":"2024-05-09T09:53:13.138894+0000","last_unstale":"2024-05-09T09:54:03.207420+0000","last_undegraded":"2024-05-09T09:54:03.207420+0000","last_fullsized":"2024-05-09T09:54:03.207420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:14.004547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319967+0000","last_change":"2024-05-09T09:53:28.735850+0000","last_active":"2024-05-09T09:54:03.319967+0000","last_peered":"2024-05-09T09:54:03.319967+0000","last_clean":"2024-05-09T09:54:03.319967+0000","last_became_active":"2024-05-09T09:53:28.734651+0000","last_became_peered":"2024-05-09T09:53:28.734651+0000","last_unstale":"2024-05-09T09:54:03.319967+0000","last_undegraded":"2024-05-09T09:54:03.319967+0000","last_fullsized":"2024-05-09T09:54:03.319967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:07.450989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":50,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.271132+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:54:04.271132+0000","last_peered":"2024-05-09T09:54:04.271132+0000","last_clean":"2024-05-09T09:54:04.271132+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:54:04.271132+0000","last_undegraded":"2024-05-09T09:54:04.271132+0000","last_fullsized":"2024-05-09T09:54:04.271132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319649+0000","last_change":"2024-05-09T09:53:28.755822+0000","last_active":"2024-05-09T09:54:03.319649+0000","last_peered":"2024-05-09T09:54:03.319649+0000","last_clean":"2024-05-09T09:54:03.319649+0000","last_became_active":"2024-05-09T09:53:28.755418+0000","last_became_peered":"2024-05-09T09:53:28.755418+0000","last_unstale":"2024-05-09T09:54:03.319649+0000","last_undegraded":"2024-05-09T09:54:03.319649+0000","last_fullsized":"2024-05-09T09:54:03.319649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:09.990454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220354+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:54:04.220354+0000","last_peered":"2024-05-09T09:54:04.220354+0000","last_clean":"2024-05-09T09:54:04.220354+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:54:04.220354+0000","last_undegraded":"2024-05-09T09:54:04.220354+0000","last_fullsized":"2024-05-09T09:54:04.220354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.221070+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:54:04.221070+0000","last_peered":"2024-05-09T09:54:04.221070+0000","last_clean":"2024-05-09T09:54:04.221070+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:54:04.221070+0000","last_undegraded":"2024-05-09T09:54:04.221070+0000","last_fullsized":"2024-05-09T09:54:04.221070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"30'9","reported_seq":87,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435356+0000","last_change":"2024-05-09T09:53:28.785207+0000","last_active":"2024-05-09T09:54:03.435356+0000","last_peered":"2024-05-09T09:54:03.435356+0000","last_clean":"2024-05-09T09:54:03.435356+0000","last_became_active":"2024-05-09T09:53:28.759010+0000","last_became_peered":"2024-05-09T09:53:28.759010+0000","last_unstale":"2024-05-09T09:54:03.435356+0000","last_undegraded":"2024-05-09T09:54:03.435356+0000","last_fullsized":"2024-05-09T09:54:03.435356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:29:11.862581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217303+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:54:04.217303+0000","last_peered":"2024-05-09T09:54:04.217303+0000","last_clean":"2024-05-09T09:54:04.217303+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:54:04.217303+0000","last_undegraded":"2024-05-09T09:54:04.217303+0000","last_fullsized":"2024-05-09T09:54:04.217303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":45,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217641+0000","last_change":"2024-05-09T09:53:28.767600+0000","last_active":"2024-05-09T09:54:04.217641+0000","last_peered":"2024-05-09T09:54:04.217641+0000","last_clean":"2024-05-09T09:54:04.217641+0000","last_became_active":"2024-05-09T09:53:28.766792+0000","last_became_peered":"2024-05-09T09:53:28.766792+0000","last_unstale":"2024-05-09T09:54:04.217641+0000","last_undegraded":"2024-05-09T09:54:04.217641+0000","last_fullsized":"2024-05-09T09:54:04.217641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:49.969409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220089+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:54:04.220089+0000","last_peered":"2024-05-09T09:54:04.220089+0000","last_clean":"2024-05-09T09:54:04.220089+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:54:04.220089+0000","last_undegraded":"2024-05-09T09:54:04.220089+0000","last_fullsized":"2024-05-09T09:54:04.220089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319912+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:54:03.319912+0000","last_peered":"2024-05-09T09:54:03.319912+0000","last_clean":"2024-05-09T09:54:03.319912+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:54:03.319912+0000","last_undegraded":"2024-05-09T09:54:03.319912+0000","last_fullsized":"2024-05-09T09:54:03.319912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.218633+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:54:04.218633+0000","last_peered":"2024-05-09T09:54:04.218633+0000","last_clean":"2024-05-09T09:54:04.218633+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:54:04.218633+0000","last_undegraded":"2024-05-09T09:54:04.218633+0000","last_fullsized":"2024-05-09T09:54:04.218633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573206+0000","last_change":"2024-05-09T09:53:54.474568+0000","last_active":"2024-05-09T09:54:03.573206+0000","last_peered":"2024-05-09T09:54:03.573206+0000","last_clean":"2024-05-09T09:54:03.573206+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:54:03.573206+0000","last_undegraded":"2024-05-09T09:54:03.573206+0000","last_fullsized":"2024-05-09T09:54:03.573206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:31.979515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.436338+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:54:03.436338+0000","last_peered":"2024-05-09T09:54:03.436338+0000","last_clean":"2024-05-09T09:54:03.436338+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:54:03.436338+0000","last_undegraded":"2024-05-09T09:54:03.436338+0000","last_fullsized":"2024-05-09T09:54:03.436338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433571+0000","last_change":"2024-05-09T09:53:07.124474+0000","last_active":"2024-05-09T09:54:03.433571+0000","last_peered":"2024-05-09T09:54:03.433571+0000","last_clean":"2024-05-09T09:54:03.433571+0000","last_became_active":"2024-05-09T09:53:07.123723+0000","last_became_peered":"2024-05-09T09:53:07.123723+0000","last_unstale":"2024-05-09T09:54:03.433571+0000","last_undegraded":"2024-05-09T09:54:03.433571+0000","last_fullsized":"2024-05-09T09:54:03.433571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:07.985561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217131+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:54:04.217131+0000","last_peered":"2024-05-09T09:54:04.217131+0000","last_clean":"2024-05-09T09:54:04.217131+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:54:04.217131+0000","last_undegraded":"2024-05-09T09:54:04.217131+0000","last_fullsized":"2024-05-09T09:54:04.217131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217632+0000","last_change":"2024-05-09T09:53:07.105696+0000","last_active":"2024-05-09T09:54:04.217632+0000","last_peered":"2024-05-09T09:54:04.217632+0000","last_clean":"2024-05-09T09:54:04.217632+0000","last_became_active":"2024-05-09T09:53:07.105002+0000","last_became_peered":"2024-05-09T09:53:07.105002+0000","last_unstale":"2024-05-09T09:54:04.217632+0000","last_undegraded":"2024-05-09T09:54:04.217632+0000","last_fullsized":"2024-05-09T09:54:04.217632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.207091+0000","last_change":"2024-05-09T09:53:09.133442+0000","last_active":"2024-05-09T09:54:03.207091+0000","last_peered":"2024-05-09T09:54:03.207091+0000","last_clean":"2024-05-09T09:54:03.207091+0000","last_became_active":"2024-05-09T09:53:09.133057+0000","last_became_peered":"2024-05-09T09:53:09.133057+0000","last_unstale":"2024-05-09T09:54:03.207091+0000","last_undegraded":"2024-05-09T09:54:03.207091+0000","last_fullsized":"2024-05-09T09:54:03.207091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:41.224127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":77,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201105+0000","last_change":"2024-05-09T09:53:54.470608+0000","last_active":"2024-05-09T09:54:03.201105+0000","last_peered":"2024-05-09T09:54:03.201105+0000","last_clean":"2024-05-09T09:54:03.201105+0000","last_became_active":"2024-05-09T09:53:54.470294+0000","last_became_peered":"2024-05-09T09:53:54.470294+0000","last_unstale":"2024-05-09T09:54:03.201105+0000","last_undegraded":"2024-05-09T09:54:03.201105+0000","last_fullsized":"2024-05-09T09:54:03.201105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:24:20.344478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.320514+0000","last_change":"2024-05-09T09:53:28.756097+0000","last_active":"2024-05-09T09:54:03.320514+0000","last_peered":"2024-05-09T09:54:03.320514+0000","last_clean":"2024-05-09T09:54:03.320514+0000","last_became_active":"2024-05-09T09:53:28.755747+0000","last_became_peered":"2024-05-09T09:53:28.755747+0000","last_unstale":"2024-05-09T09:54:03.320514+0000","last_undegraded":"2024-05-09T09:54:03.320514+0000","last_fullsized":"2024-05-09T09:54:03.320514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:08.997460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220032+0000","last_change":"2024-05-09T09:53:07.106145+0000","last_active":"2024-05-09T09:54:04.220032+0000","last_peered":"2024-05-09T09:54:04.220032+0000","last_clean":"2024-05-09T09:54:04.220032+0000","last_became_active":"2024-05-09T09:53:07.105747+0000","last_became_peered":"2024-05-09T09:53:07.105747+0000","last_unstale":"2024-05-09T09:54:04.220032+0000","last_undegraded":"2024-05-09T09:54:04.220032+0000","last_fullsized":"2024-05-09T09:54:04.220032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200923+0000","last_change":"2024-05-09T09:53:09.114575+0000","last_active":"2024-05-09T09:54:03.200923+0000","last_peered":"2024-05-09T09:54:03.200923+0000","last_clean":"2024-05-09T09:54:03.200923+0000","last_became_active":"2024-05-09T09:53:09.114298+0000","last_became_peered":"2024-05-09T09:53:09.114298+0000","last_unstale":"2024-05-09T09:54:03.200923+0000","last_undegraded":"2024-05-09T09:54:03.200923+0000","last_fullsized":"2024-05-09T09:54:03.200923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.322136+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:54:03.322136+0000","last_peered":"2024-05-09T09:54:03.322136+0000","last_clean":"2024-05-09T09:54:03.322136+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:54:03.322136+0000","last_undegraded":"2024-05-09T09:54:03.322136+0000","last_fullsized":"2024-05-09T09:54:03.322136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.319828+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:54:03.319828+0000","last_peered":"2024-05-09T09:54:03.319828+0000","last_clean":"2024-05-09T09:54:03.319828+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:54:03.319828+0000","last_undegraded":"2024-05-09T09:54:03.319828+0000","last_fullsized":"2024-05-09T09:54:03.319828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.203013+0000","last_change":"2024-05-09T09:53:28.772163+0000","last_active":"2024-05-09T09:54:03.203013+0000","last_peered":"2024-05-09T09:54:03.203013+0000","last_clean":"2024-05-09T09:54:03.203013+0000","last_became_active":"2024-05-09T09:53:28.771550+0000","last_became_peered":"2024-05-09T09:53:28.771550+0000","last_unstale":"2024-05-09T09:54:03.203013+0000","last_undegraded":"2024-05-09T09:54:03.203013+0000","last_fullsized":"2024-05-09T09:54:03.203013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:22.704330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220280+0000","last_change":"2024-05-09T09:53:09.113360+0000","last_active":"2024-05-09T09:54:04.220280+0000","last_peered":"2024-05-09T09:54:04.220280+0000","last_clean":"2024-05-09T09:54:04.220280+0000","last_became_active":"2024-05-09T09:53:09.112503+0000","last_became_peered":"2024-05-09T09:53:09.112503+0000","last_unstale":"2024-05-09T09:54:04.220280+0000","last_undegraded":"2024-05-09T09:54:04.220280+0000","last_fullsized":"2024-05-09T09:54:04.220280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.433541+0000","last_change":"2024-05-09T09:53:07.117804+0000","last_active":"2024-05-09T09:54:03.433541+0000","last_peered":"2024-05-09T09:54:03.433541+0000","last_clean":"2024-05-09T09:54:03.433541+0000","last_became_active":"2024-05-09T09:53:07.116606+0000","last_became_peered":"2024-05-09T09:53:07.116606+0000","last_unstale":"2024-05-09T09:54:03.433541+0000","last_undegraded":"2024-05-09T09:54:03.433541+0000","last_fullsized":"2024-05-09T09:54:03.433541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:45:54.495728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573456+0000","last_change":"2024-05-09T09:53:28.775930+0000","last_active":"2024-05-09T09:54:03.573456+0000","last_peered":"2024-05-09T09:54:03.573456+0000","last_clean":"2024-05-09T09:54:03.573456+0000","last_became_active":"2024-05-09T09:53:28.775613+0000","last_became_peered":"2024-05-09T09:53:28.775613+0000","last_unstale":"2024-05-09T09:54:03.573456+0000","last_undegraded":"2024-05-09T09:54:03.573456+0000","last_fullsized":"2024-05-09T09:54:03.573456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:36.298968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":72,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.201332+0000","last_change":"2024-05-09T09:53:28.770864+0000","last_active":"2024-05-09T09:54:03.201332+0000","last_peered":"2024-05-09T09:54:03.201332+0000","last_clean":"2024-05-09T09:54:03.201332+0000","last_became_active":"2024-05-09T09:53:28.765629+0000","last_became_peered":"2024-05-09T09:53:28.765629+0000","last_unstale":"2024-05-09T09:54:03.201332+0000","last_undegraded":"2024-05-09T09:54:03.201332+0000","last_fullsized":"2024-05-09T09:54:03.201332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:29.969514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.576596+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:54:03.576596+0000","last_peered":"2024-05-09T09:54:03.576596+0000","last_clean":"2024-05-09T09:54:03.576596+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:54:03.576596+0000","last_undegraded":"2024-05-09T09:54:03.576596+0000","last_fullsized":"2024-05-09T09:54:03.576596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435642+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:54:03.435642+0000","last_peered":"2024-05-09T09:54:03.435642+0000","last_clean":"2024-05-09T09:54:03.435642+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:54:03.435642+0000","last_undegraded":"2024-05-09T09:54:03.435642+0000","last_fullsized":"2024-05-09T09:54:03.435642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321163+0000","last_change":"2024-05-09T09:53:28.752616+0000","last_active":"2024-05-09T09:54:03.321163+0000","last_peered":"2024-05-09T09:54:03.321163+0000","last_clean":"2024-05-09T09:54:03.321163+0000","last_became_active":"2024-05-09T09:53:28.752302+0000","last_became_peered":"2024-05-09T09:53:28.752302+0000","last_unstale":"2024-05-09T09:54:03.321163+0000","last_undegraded":"2024-05-09T09:54:03.321163+0000","last_fullsized":"2024-05-09T09:54:03.321163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:33.991363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.574104+0000","last_change":"2024-05-09T09:53:54.475107+0000","last_active":"2024-05-09T09:54:03.574104+0000","last_peered":"2024-05-09T09:54:03.574104+0000","last_clean":"2024-05-09T09:54:03.574104+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:54:03.574104+0000","last_undegraded":"2024-05-09T09:54:03.574104+0000","last_fullsized":"2024-05-09T09:54:03.574104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:07.978606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.269745+0000","last_change":"2024-05-09T09:53:09.134867+0000","last_active":"2024-05-09T09:54:04.269745+0000","last_peered":"2024-05-09T09:54:04.269745+0000","last_clean":"2024-05-09T09:54:04.269745+0000","last_became_active":"2024-05-09T09:53:09.132179+0000","last_became_peered":"2024-05-09T09:53:09.132179+0000","last_unstale":"2024-05-09T09:54:04.269745+0000","last_undegraded":"2024-05-09T09:54:04.269745+0000","last_fullsized":"2024-05-09T09:54:04.269745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:16.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":73,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.321645+0000","last_change":"2024-05-09T09:53:28.769931+0000","last_active":"2024-05-09T09:54:03.321645+0000","last_peered":"2024-05-09T09:54:03.321645+0000","last_clean":"2024-05-09T09:54:03.321645+0000","last_became_active":"2024-05-09T09:53:28.769331+0000","last_became_peered":"2024-05-09T09:53:28.769331+0000","last_unstale":"2024-05-09T09:54:03.321645+0000","last_undegraded":"2024-05-09T09:54:03.321645+0000","last_fullsized":"2024-05-09T09:54:03.321645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:18.496459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.217030+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:54:04.217030+0000","last_peered":"2024-05-09T09:54:04.217030+0000","last_clean":"2024-05-09T09:54:04.217030+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:54:04.217030+0000","last_undegraded":"2024-05-09T09:54:04.217030+0000","last_fullsized":"2024-05-09T09:54:04.217030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.270705+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:54:04.270705+0000","last_peered":"2024-05-09T09:54:04.270705+0000","last_clean":"2024-05-09T09:54:04.270705+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:54:04.270705+0000","last_undegraded":"2024-05-09T09:54:04.270705+0000","last_fullsized":"2024-05-09T09:54:04.270705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.200815+0000","last_change":"2024-05-09T09:53:09.126958+0000","last_active":"2024-05-09T09:54:03.200815+0000","last_peered":"2024-05-09T09:54:03.200815+0000","last_clean":"2024-05-09T09:54:03.200815+0000","last_became_active":"2024-05-09T09:53:09.126577+0000","last_became_peered":"2024-05-09T09:53:09.126577+0000","last_unstale":"2024-05-09T09:54:03.200815+0000","last_undegraded":"2024-05-09T09:54:03.200815+0000","last_fullsized":"2024-05-09T09:54:03.200815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:43.085261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.573687+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:54:03.573687+0000","last_peered":"2024-05-09T09:54:03.573687+0000","last_clean":"2024-05-09T09:54:03.573687+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:54:03.573687+0000","last_undegraded":"2024-05-09T09:54:03.573687+0000","last_fullsized":"2024-05-09T09:54:03.573687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.268775+0000","last_change":"2024-05-09T09:53:09.136266+0000","last_active":"2024-05-09T09:54:04.268775+0000","last_peered":"2024-05-09T09:54:04.268775+0000","last_clean":"2024-05-09T09:54:04.268775+0000","last_became_active":"2024-05-09T09:53:09.135638+0000","last_became_peered":"2024-05-09T09:53:09.135638+0000","last_unstale":"2024-05-09T09:54:04.268775+0000","last_undegraded":"2024-05-09T09:54:04.268775+0000","last_fullsized":"2024-05-09T09:54:04.268775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.437104+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:54:03.437104+0000","last_peered":"2024-05-09T09:54:03.437104+0000","last_clean":"2024-05-09T09:54:03.437104+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:54:03.437104+0000","last_undegraded":"2024-05-09T09:54:03.437104+0000","last_fullsized":"2024-05-09T09:54:03.437104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":68,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.434756+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:54:03.434756+0000","last_peered":"2024-05-09T09:54:03.434756+0000","last_clean":"2024-05-09T09:54:03.434756+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:54:03.434756+0000","last_undegraded":"2024-05-09T09:54:03.434756+0000","last_fullsized":"2024-05-09T09:54:03.434756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.220203+0000","last_change":"2024-05-09T09:53:09.113504+0000","last_active":"2024-05-09T09:54:04.220203+0000","last_peered":"2024-05-09T09:54:04.220203+0000","last_clean":"2024-05-09T09:54:04.220203+0000","last_became_active":"2024-05-09T09:53:09.112750+0000","last_became_peered":"2024-05-09T09:53:09.112750+0000","last_unstale":"2024-05-09T09:54:04.220203+0000","last_undegraded":"2024-05-09T09:54:04.220203+0000","last_fullsized":"2024-05-09T09:54:04.220203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-09T09:54:04.223535+0000","last_change":"2024-05-09T09:53:28.740175+0000","last_active":"2024-05-09T09:54:04.223535+0000","last_peered":"2024-05-09T09:54:04.223535+0000","last_clean":"2024-05-09T09:54:04.223535+0000","last_became_active":"2024-05-09T09:53:28.739562+0000","last_became_peered":"2024-05-09T09:53:28.739562+0000","last_unstale":"2024-05-09T09:54:04.223535+0000","last_undegraded":"2024-05-09T09:54:04.223535+0000","last_fullsized":"2024-05-09T09:54:04.223535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:31.035254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":64,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-05-09T09:54:03.435923+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:54:03.435923+0000","last_peered":"2024-05-09T09:54:03.435923+0000","last_clean":"2024-05-09T09:54:03.435923+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:54:03.435923+0000","last_undegraded":"2024-05-09T09:54:03.435923+0000","last_fullsized":"2024-05-09T09:54:03.435923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":684,"num_read_kb":443,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":7624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1196032,"data_stored":880415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":289915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":622592,"data_stored":289658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":0,"seq":60129542161,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":589824,"data_stored":288790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":565248,"data_stored":288066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":593920,"data_stored":288754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1171456,"data_stored":878828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:54:06.245 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-09T09:54:06.246 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-09T09:54:06.246 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-05-09T09:54:06.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-05-09T09:54:06.247 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:54:06.267 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:06.268+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:06.320 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:06.320 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:06.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:06.383 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:06.382+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:06.449 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:06.447+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:06.456 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:06.456 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:06.470 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:06.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-05-09T09:54:06.562 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:06.563+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:06.639 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:06.639 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:06.651 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:06.651+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:06.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:06.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-05-09T09:54:06.758 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:06.759+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:06.795 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:06.795 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:06.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:06.852 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:06.850+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:06.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:06.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-05-09T09:54:06.952 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:06.951+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:06.971 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:06.971 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:06.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:07.078 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:07.079+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:07.098 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:07.098 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:07.131 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:07.131 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:07.154 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:07.151+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:07.164 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:07.165 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:07.194 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:07.195 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:07.200 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-05-09T09:54:07.201 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:07.201 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:07.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:07.201 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:07.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.201 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:07.201 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:07.201 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.998250554999998, 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.031240494000002, 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.210 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:54:07.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:54:07.215 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.001142010000002, 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.216 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:54:07.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:54:07.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:54:07.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.221 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.971489558000002, 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:54:07.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:54:07.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:54:07.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:54:07.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.227 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.956919167999999, 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:54:07.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:54:07.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:54:07.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:07.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.928568810000002, 2024-05-09T09:54:07.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:54:07.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.909844818000003, 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.239 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:54:07.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:54:07.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:54:07.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.872979739999998, 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:54:07.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:54:07.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:54:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:54:07.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.807796390999997, 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:54:07.250 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.255 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.804944116000001, 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.256 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:54:07.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.801804932000003, 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:54:07.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:54:07.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:54:07.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:54:07.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:54:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.676898690000002, 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:54:07.267 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:54:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.671889544999999, 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.477257137000002, 2024-05-09T09:54:07.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.283 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.473083441999997, 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.284 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:54:07.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:54:07.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:54:07.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:54:07.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.421196385000002, 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.289 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:07.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:54:07.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:54:07.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:54:07.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.294 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.416602175999998, 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.235306889999997, 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.300 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:07.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.231618140000002, 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:54:07.305 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1021 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.899427943999999, 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032568440000000001, 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1021 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299425+0000", 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9560000000000002e-06 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:07.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299441+0000", 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.539e-05 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299477+0000", 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5735999999999998e-05 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299494+0000", 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7195999999999999e-05 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:07.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299653+0000", 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015902900000000001 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299889+0000", 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023567799999999999 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.300250+0000", 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000361527 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:07.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.301419+0000", 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011689370000000001 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302515+0000", 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001096138 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302607+0000", 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2329000000000003e-05 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302679+0000", 2024-05-09T09:54:07.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1928000000000007e-05 2024-05-09T09:54:07.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.316 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:07.316 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:07.316 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:07.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:07.318 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:07.318 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:07.319 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:07.319 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:07.319 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:07.319 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:07.320 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:07.320 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:07.320 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:07.314+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:07.418 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:07.414+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:07.519 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:07.518+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:07.548 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:07.548 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:07.548 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:07.548 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:07.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-05-09T09:54:07.569 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:07.654 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:07.655+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:07.721 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:07.718+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:07.789 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:07.789 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:07.789 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:07.789 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:07.789 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:07.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-05-09T09:54:07.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:07.851 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:07.851+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:07.923 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:07.922+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 56.913638343000002, 2024-05-09T09:54:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:54:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:54:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:54:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.732281503000003, 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.728949980000003, 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:54:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:54:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.836634007000001, 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.816680149, 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:54:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:54:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.791922909999997, 2024-05-09T09:54:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:54:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:54:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:54:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:54:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.773564121, 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.741612277999998, 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:54:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:54:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:54:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:54:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.711661217, 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.654212108999999, 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.607381656999998, 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:08.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:54:08.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.540332755000001, 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.534753948999999, 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.094 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:08.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.314609062000002, 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:54:08.106 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.194485313999998, 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.107 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:54:08.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:54:08.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.112 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.031107077000001, 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.996027804000001, 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.118 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:08.123 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.992181189999997, 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:54:08.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:54:08.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:54:08.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:54:08.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.958908616999999, 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.129 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:08.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:54:08.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:08.134 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.924362453000001, 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.139 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.140 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.140 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:08.140 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:08.027+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:08.141 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:08.182 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:08.183+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:08.244 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:08.242+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:08.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:54:08.311 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:08.311 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:08.311 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:08.311 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:08.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:08.345 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:08.342+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:08.446 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:08.443+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:08.546 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:08.547+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:08.549 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:08.549 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:08.549 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:08.549 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:08.550 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:08.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:08.654 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:08.655+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:08.748 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:08.747+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.602869691000002, 2024-05-09T09:54:08.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:08.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:54:08.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:54:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:54:08.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.588353232999999, 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.787 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.792 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.487649896999997, 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:54:08.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:54:08.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:54:08.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:54:08.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.475792482999999, 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:54:08.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:54:08.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.122602895999997, 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:08.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:54:08.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:54:08.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:54:08.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.118671399, 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:54:08.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:54:08.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:54:08.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.815 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.988509190000002, 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:54:08.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:54:08.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:54:08.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:54:08.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:54:08.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.984559597000001, 2024-05-09T09:54:08.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.826 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.930335446999997, 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.827 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:54:08.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:54:08.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.926703328999999, 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:54:08.832 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.837 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.916207962000001, 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.838 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:54:08.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:54:08.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:54:08.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.912374954000001, 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.844 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.849 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.865513401000001, 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:08.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:54:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:54:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:54:08.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:54:08.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.861826587000003, 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.855 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:54:08.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:54:08.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.860 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.775176481999999, 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.771318848, 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.866 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:54:08.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.871 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.676033906999997, 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:08.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:54:08.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:54:08.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:54:08.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:54:08.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.671593260000002, 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:54:08.877 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.661153186, 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.883 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:54:08.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:54:08.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:54:08.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:08.888 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.657197977000003, 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:08.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:54:08.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:54:08.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:54:08.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:54:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:08.894 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:08.896 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:08.896 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:08.894+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:08.997 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:08.998+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:09.098 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:09.094+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:09.108 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:09.108 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:09.108 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:09.108 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:09.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:09.199 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:09.199+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:09.264 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:54:09.297 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:09.297 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:09.300 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:09.298+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:09.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:09.327 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:09.401 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:09.398+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:09.502 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:09.498+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:09.538 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:09.538 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:09.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:09.538 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:09.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.538 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.538 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:09.538 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.364916303999998, 2024-05-09T09:54:09.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:09.539 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.539 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.539 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.539 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.539 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:09.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:09.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:09.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.545 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.316104193000001, 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556879999999999, 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.546 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:09.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220488+0000", 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.596e-06 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220504+0000", 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5753e-05 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220541+0000", 2024-05-09T09:54:09.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999999e-05 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220559+0000", 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7465999999999998e-05 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220704+0000", 2024-05-09T09:54:09.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144754 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220947+0000", 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243386 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.221368+0000", 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420963 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.222994+0000", 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016260949999999999 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223686+0000", 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069151800000000002 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223771+0000", 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5822000000000006e-05 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223840+0000", 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8734999999999998e-05 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.276904064999997, 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032488740000000001, 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.553 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 227 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259687+0000", 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259699+0000", 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2199e-05 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259731+0000", 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2060000000000001e-05 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259747+0000", 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5832999999999999e-05 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259923+0000", 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017627699999999999 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260168+0000", 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024482200000000001 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260592+0000", 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042451899999999999 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262409+0000", 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018164889999999999 2024-05-09T09:54:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262778+0000", 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036952099999999999 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262863+0000", 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5121e-05 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262933+0000", 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9913000000000006e-05 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.269813593000002, 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032339780000000002, 2024-05-09T09:54:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 229 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266777+0000", 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1900000000000002e-06 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266789+0000", 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1365999999999999e-05 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266820+0000", 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1053000000000002e-05 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266838+0000", 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7963000000000001e-05 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266959+0000", 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121691 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267173+0000", 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021379999999999999 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267579+0000", 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040555300000000001 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269040+0000", 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014609549999999999 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269859+0000", 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081965300000000005 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269946+0000", 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6488000000000003e-05 2024-05-09T09:54:09.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270009+0000", 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3266e-05 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.262856392000003, 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003225641, 2024-05-09T09:54:09.565 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273734+0000", 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273747+0000", 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2363e-05 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273777+0000", 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273792+0000", 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5157000000000001e-05 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273906+0000", 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011372800000000001 2024-05-09T09:54:09.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274111+0000", 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000205556 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274578+0000", 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046704899999999998 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276012+0000", 2024-05-09T09:54:09.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001433805 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276811+0000", 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079894299999999998 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276891+0000", 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9948000000000001e-05 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276958+0000", 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6872999999999995e-05 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:438 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.177373803999998, 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044008270000000004, 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.571 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:09.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359216+0000", 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0389999999999999e-06 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359224+0000", 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1999999999999994e-06 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359237+0000", 2024-05-09T09:54:09.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2826999999999999e-05 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359243+0000", 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0129999999999999e-06 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359298+0000", 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5041999999999999e-05 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359388+0000", 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0174999999999996e-05 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359523+0000", 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135122 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.360060+0000", 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053657399999999995 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363514+0000", 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003454146 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363574+0000", 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.982e-05 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363616+0000", 2024-05-09T09:54:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1869000000000002e-05 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:443 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.172432641999997, 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041654989999999996, 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.577 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 443 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364157+0000", 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2299999999999999e-07 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364163+0000", 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9059999999999999e-06 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364177+0000", 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3890000000000001e-05 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364183+0000", 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8210000000000004e-06 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364250+0000", 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6965999999999995e-05 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364341+0000", 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0847999999999995e-05 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:09.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364524+0000", 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182778 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.365027+0000", 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050315500000000003 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368257+0000", 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293809999999999 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368293+0000", 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6612000000000001e-05 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368321+0000", 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8218999999999999e-05 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:476 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.152554608999999, 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030779259999999999, 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.584 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 476 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384035+0000", 2024-05-09T09:54:09.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.046e-06 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384041+0000", 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6899999999999997e-06 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384055+0000", 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4457999999999999e-05 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384062+0000", 2024-05-09T09:54:09.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3709999999999996e-06 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384143+0000", 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1678e-05 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384199+0000", 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5940999999999999e-05 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:09.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384322+0000", 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122617 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384970+0000", 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064774299999999999 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387007+0000", 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020371009999999999 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387067+0000", 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0234e-05 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387112+0000", 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5046999999999997e-05 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.930046978999997, 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003541209, 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 736 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606544+0000", 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606556+0000", 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.185e-05 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606586+0000", 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-05-09T09:54:09.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606602+0000", 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606759+0000", 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157594 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607123+0000", 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036346000000000002 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607703+0000", 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057985000000000003 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609215+0000", 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512071 2024-05-09T09:54:09.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609797+0000", 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058224999999999998 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609969+0000", 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171767 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.610083+0000", 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114221 2024-05-09T09:54:09.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.92552972, 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029874860000000001, 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.597 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 738 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:09.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611061+0000", 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1739999999999999e-06 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611073+0000", 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1619e-05 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611099+0000", 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6103000000000001e-05 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611112+0000", 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611252+0000", 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014065799999999999 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611494+0000", 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000241769 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611980+0000", 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000486331 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613227+0000", 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012462529999999999 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613772+0000", 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054489600000000001 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613927+0000", 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000155668 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.614046+0000", 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119065 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.848850446999997, 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003024648, 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 772 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687740+0000", 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687753+0000", 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2587e-05 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687785+0000", 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1942e-05 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687802+0000", 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-05-09T09:54:09.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687946+0000", 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014396100000000001 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688198+0000", 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025293499999999998 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688521+0000", 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032281500000000001 2024-05-09T09:54:09.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.689716+0000", 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011949160000000001 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690602+0000", 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088602799999999997 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690692+0000", 2024-05-09T09:54:09.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9468000000000005e-05 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690763+0000", 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1109e-05 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.721722335000003, 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002920887, 2024-05-09T09:54:09.608 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 826 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814868+0000", 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.193e-06 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814880+0000", 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1907e-05 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814912+0000", 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1165999999999999e-05 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814929+0000", 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7912999999999999e-05 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815074+0000", 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014431399999999999 2024-05-09T09:54:09.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815305+0000", 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023076300000000001 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815650+0000", 2024-05-09T09:54:09.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034591999999999999 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.816971+0000", 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001320508 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817634+0000", 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066317500000000001 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817720+0000", 2024-05-09T09:54:09.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6365000000000004e-05 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817787+0000", 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6662999999999995e-05 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.614 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.693544254999999, 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003347376, 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 838 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843046+0000", 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9870000000000002e-06 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843059+0000", 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3123e-05 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843090+0000", 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:09.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843105+0000", 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4956e-05 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843258+0000", 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015342099999999999 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843636+0000", 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377644 2024-05-09T09:54:09.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.844223+0000", 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058732299999999995 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.845580+0000", 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013567270000000001 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846218+0000", 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063835499999999996 2024-05-09T09:54:09.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846313+0000", 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4475000000000006e-05 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846392+0000", 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9202000000000005e-05 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.620 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.689272373999998, 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029984809999999999, 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 840 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847318+0000", 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7230000000000001e-06 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847328+0000", 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0233e-05 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847353+0000", 2024-05-09T09:54:09.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4719000000000002e-05 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847365+0000", 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2534000000000001e-05 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847493+0000", 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012747799999999999 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847627+0000", 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013396 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847937+0000", 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031040499999999998 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.848946+0000", 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010091029999999999 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850158+0000", 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001211349 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850239+0000", 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1079000000000001e-05 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850315+0000", 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5897999999999997e-05 2024-05-09T09:54:09.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.665025086999997, 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029954320000000001, 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.627 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871566+0000", 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.153e-06 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871578+0000", 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.184e-05 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871608+0000", 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0859999999999999e-05 2024-05-09T09:54:09.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871623+0000", 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4899000000000001e-05 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871760+0000", 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136685 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871990+0000", 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229559 2024-05-09T09:54:09.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.872322+0000", 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000332128 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.873500+0000", 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001178023 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874351+0000", 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085124199999999999 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874437+0000", 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6062000000000004e-05 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874559+0000", 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121981 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.632 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.628287723, 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029994549999999998, 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 865 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908303+0000", 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1560000000000002e-06 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908315+0000", 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908345+0000", 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0383e-05 2024-05-09T09:54:09.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908360+0000", 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5023e-05 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908507+0000", 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014646799999999999 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908728+0000", 2024-05-09T09:54:09.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022162899999999999 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.909067+0000", 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000338621 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.910282+0000", 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001215156 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911147+0000", 2024-05-09T09:54:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086497500000000003 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911229+0000", 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2472000000000006e-05 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911300+0000", 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0832000000000002e-05 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.559470699000002, 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033122170000000001, 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 895 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977120+0000", 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1100000000000001e-06 2024-05-09T09:54:09.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977132+0000", 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1552999999999999e-05 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977163+0000", 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1383000000000001e-05 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977178+0000", 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4807000000000001e-05 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977331+0000", 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152967 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977700+0000", 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036903700000000001 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.978266+0000", 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056619699999999995 2024-05-09T09:54:09.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.979467+0000", 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001201166 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980277+0000", 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081005900000000002 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980367+0000", 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0298999999999997e-05 2024-05-09T09:54:09.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980430+0000", 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2638999999999994e-05 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.555140367, 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029215339999999999, 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 897 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981450+0000", 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0099999999999998e-06 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981461+0000", 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0504e-05 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981488+0000", 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7503000000000001e-05 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981509+0000", 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0406000000000001e-05 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981602+0000", 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3828999999999999e-05 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981724+0000", 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121124 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981998+0000", 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027401500000000001 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.982980+0000", 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098280999999999998 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984221+0000", 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012405960000000001 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984306+0000", 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5074000000000006e-05 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984370+0000", 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3663000000000004e-05 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.649 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.466077808999998, 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029823219999999999, 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.650 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 934 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070513+0000", 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070525+0000", 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-05-09T09:54:09.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070558+0000", 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2651999999999998e-05 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070580+0000", 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.194e-05 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070713+0000", 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013299399999999999 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070937+0000", 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022408700000000001 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.071257+0000", 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032046100000000002 2024-05-09T09:54:09.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.072520+0000", 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001262448 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073338+0000", 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081789299999999998 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073425+0000", 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7127999999999997e-05 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073493+0000", 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8355999999999994e-05 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.459386246999998, 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029267099999999999, 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:09.657 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 937 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077204+0000", 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.804e-06 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077215+0000", 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0576e-05 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077244+0000", 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8866000000000001e-05 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077265+0000", 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1607000000000002e-05 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077410+0000", 2024-05-09T09:54:09.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014486699999999999 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077632+0000", 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022217600000000001 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077954+0000", 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321665 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.078933+0000", 2024-05-09T09:54:09.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097881899999999991 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.079959+0000", 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001026676 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080047+0000", 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7114999999999995e-05 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:09.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080129+0000", 2024-05-09T09:54:09.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539000000000004e-05 2024-05-09T09:54:09.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:09.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:09.663 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:09.665 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:09.665 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:09.665 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:09.666 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:09.666 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:09.666 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:09.667 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:09.667 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:09.667 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:09.667 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:09.662+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:09.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:09.689 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:09.719 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:09.719 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:09.736 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:09.737 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:09.755 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:09.755 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:09.765 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:09.763+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:09.799 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:09.799 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:09.813 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:09.866 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:09.867+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:09.937 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:09.937 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:09.951 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:09.999 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:09.998+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:10.069 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:10.067+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:10.075 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:10.075 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:10.090 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:10.175 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:10.174+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:10.253 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:10.253 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:10.268 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:10.311 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:10.310+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:10.371 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:10.371+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:10.436 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:10.436 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:10.450 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:10.472 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:10.471+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:10.571 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:10.571 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:10.573 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:10.570+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:10.585 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:10.674 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:10.670+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:10.751 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:10.752 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:10.765 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:10.807 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:10.806+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:10.876 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:10.874+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:10.931 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:10.932 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:10.947 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:10.977 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:10.975+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:11.078 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:11.074+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:11.115 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:11.115 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:11.130 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:11.215 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:11.214+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:11.279 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:11.279+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:11.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:54:11.293 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:11.293 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:11.307 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:11.395 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:11.394+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:11.474 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:11.474 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:11.481 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:11.478+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:11.488 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:11.583 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:11.582+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:11.653 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:11.653 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:11.668 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:11.711 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:11.710+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:11.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:11.819 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:11.819+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:11.840 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:11.840 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:11.860 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:11.902 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:11.903+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:11.973 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:11.973 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:11.986 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:11.982+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:12.004 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:12.004 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:12.035 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:12.035 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:12.066 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:12.066 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:12.076 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:12.076 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:12.076 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:12.076 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:12.076 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:12.087 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:12.087+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:12.094 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:12.100 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:12.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:12.134 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:12.167 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:12.167 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:12.188 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:12.186+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:12.200 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:12.200 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.072884533, 2024-05-09T09:54:12.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002440373, 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 60 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200600+0000", 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200602+0000", 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0269999999999998e-06 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200612+0000", 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8279999999999998e-06 2024-05-09T09:54:12.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200634+0000", 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2609999999999999e-05 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200647+0000", 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.269e-05 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200746+0000", 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9215000000000005e-05 2024-05-09T09:54:12.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.200896+0000", 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014940999999999999 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201054+0000", 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015864899999999999 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.201996+0000", 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00094191399999999997 2024-05-09T09:54:12.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202921+0000", 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092508800000000002 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.202975+0000", 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3578000000000001e-05 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.203040+0000", 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5364000000000006e-05 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.105874471999996, 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037948510000000001, 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.281 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167610+0000", 2024-05-09T09:54:12.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167613+0000", 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8899999999999999e-06 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167627+0000", 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4015999999999999e-05 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167661+0000", 2024-05-09T09:54:12.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3973000000000002e-05 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167680+0000", 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.931e-05 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.167903+0000", 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000222506 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168164+0000", 2024-05-09T09:54:12.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026131499999999997 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.168609+0000", 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044504899999999999 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.170347+0000", 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017377200000000001 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171209+0000", 2024-05-09T09:54:12.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086205899999999998 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171294+0000", 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5345000000000004e-05 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171405+0000", 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110668 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.075775987999997, 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039175859999999998, 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197708+0000", 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197712+0000", 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1930000000000002e-06 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197728+0000", 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6382999999999999e-05 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197768+0000", 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0343000000000003e-05 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197792+0000", 2024-05-09T09:54:12.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3672999999999998e-05 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.197966+0000", 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017425000000000001 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198206+0000", 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023943599999999999 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:12.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.198648+0000", 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044247200000000002 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.200160+0000", 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512001 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201471+0000", 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013104740000000001 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201560+0000", 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9435e-05 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.201626+0000", 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5926000000000005e-05 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.046123536000003, 2024-05-09T09:54:12.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003125709, 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 218 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227361+0000", 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227363+0000", 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.39e-06 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227375+0000", 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2133000000000001e-05 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227408+0000", 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2712000000000001e-05 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227430+0000", 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1387e-05 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227566+0000", 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013603399999999999 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.227793+0000", 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022777299999999999 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.228253+0000", 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046013199999999998 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.229715+0000", 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014610719999999999 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230328+0000", 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000613369 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230418+0000", 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9912000000000002e-05 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230487+0000", 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8794999999999994e-05 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.297 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.031553146, 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033621430000000002, 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 222 2024-05-09T09:54:12.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241931+0000", 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241934+0000", 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2170000000000001e-06 2024-05-09T09:54:12.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241947+0000", 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.314e-05 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241978+0000", 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1699000000000003e-05 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.241993+0000", 2024-05-09T09:54:12.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4786999999999999e-05 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242121+0000", 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012756099999999999 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242344+0000", 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022297300000000001 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:12.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.242778+0000", 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000434015 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.244405+0000", 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001626806 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245141+0000", 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073692099999999997 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245226+0000", 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4881000000000003e-05 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.245293+0000", 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7143000000000004e-05 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.003202788000003, 2024-05-09T09:54:12.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032377040000000001, 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 230 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:12.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270282+0000", 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270285+0000", 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3469999999999999e-06 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270297+0000", 2024-05-09T09:54:12.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1562999999999999e-05 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270327+0000", 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0772000000000003e-05 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270342+0000", 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4610000000000001e-05 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270460+0000", 2024-05-09T09:54:12.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117645 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270680+0000", 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022025300000000001 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.271113+0000", 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043265600000000001 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.272361+0000", 2024-05-09T09:54:12.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012486579999999999 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273314+0000", 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095274400000000005 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273399+0000", 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5065e-05 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273519+0000", 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012039100000000001 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.984478795999998, 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003939382, 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.309 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 235 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289006+0000", 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289008+0000", 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2330000000000001e-06 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289020+0000", 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.199e-05 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289051+0000", 2024-05-09T09:54:12.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1146000000000003e-05 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289066+0000", 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289225+0000", 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015950799999999999 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.289618+0000", 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039287000000000002 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.290425+0000", 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080637600000000003 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292266+0000", 2024-05-09T09:54:12.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001841435 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292788+0000", 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052180800000000002 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292879+0000", 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1272000000000003e-05 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.292945+0000", 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5955000000000001e-05 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.947613717999999, 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034340479999999999, 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.315 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 382 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325871+0000", 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325872+0000", 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325878+0000", 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9540000000000001e-06 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325892+0000", 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-05 2024-05-09T09:54:12.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325898+0000", 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4010000000000002e-06 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.325965+0000", 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.669e-05 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326080+0000", 2024-05-09T09:54:12.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011483400000000001 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326302+0000", 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229899999999999 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.326919+0000", 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061728300000000005 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329220+0000", 2024-05-09T09:54:12.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023004599999999998 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329256+0000", 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6176000000000001e-05 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.329305+0000", 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8693999999999998e-05 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:489 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.882430368999998, 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024547129999999999, 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 489 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391054+0000", 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391055+0000", 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1939999999999999e-06 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391062+0000", 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4579999999999998e-06 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391076+0000", 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4763000000000001e-05 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391084+0000", 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7389999999999999e-06 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391177+0000", 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3232000000000005e-05 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391275+0000", 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7893999999999995e-05 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.391548+0000", 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000272386 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.392220+0000", 2024-05-09T09:54:12.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067199000000000002 2024-05-09T09:54:12.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393392+0000", 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011721329999999999 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393459+0000", 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7317000000000006e-05 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393509+0000", 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9607000000000001e-05 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.328 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:495 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.879578094000003, 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026390810000000002, 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 495 2024-05-09T09:54:12.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393906+0000", 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393908+0000", 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1829999999999999e-06 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393915+0000", 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7659999999999998e-06 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393930+0000", 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.393939+0000", 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8859999999999993e-06 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394019+0000", 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0332000000000003e-05 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394206+0000", 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018642100000000001 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.394592+0000", 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038654500000000002 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.395319+0000", 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072631599999999996 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396425+0000", 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011068670000000001 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396484+0000", 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8403000000000003e-05 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.396545+0000", 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1644999999999997e-05 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:502 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.876438909999997, 2024-05-09T09:54:12.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002606573, 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 502 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397046+0000", 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397047+0000", 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0860000000000001e-06 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397053+0000", 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3790000000000003e-06 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397067+0000", 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3806e-05 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397074+0000", 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6860000000000006e-06 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397147+0000", 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2483000000000004e-05 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397233+0000", 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5779000000000007e-05 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.397419+0000", 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018653699999999999 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.398003+0000", 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058407399999999996 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399518+0000", 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015149359999999999 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399577+0000", 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8644999999999998e-05 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.399652+0000", 2024-05-09T09:54:12.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5161999999999996e-05 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:685 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.751532668000003, 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002354358, 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 685 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521952+0000", 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521954+0000", 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.765e-06 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521962+0000", 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4279999999999996e-06 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521982+0000", 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9913999999999999e-05 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.521991+0000", 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5289999999999997e-06 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522131+0000", 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522362+0000", 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023127799999999999 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.522497+0000", 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013452900000000001 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.523205+0000", 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070851400000000004 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524244+0000", 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001038602 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524279+0000", 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5636999999999998e-05 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.524306+0000", 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6851000000000001e-05 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:692 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.345 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.746523523, 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025352600000000001, 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 692 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526961+0000", 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526962+0000", 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0049999999999999e-06 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526968+0000", 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7969999999999997e-06 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526979+0000", 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1195e-05 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.526986+0000", 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9e-06 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527082+0000", 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5680000000000005e-05 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527282+0000", 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000200383 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.527638+0000", 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035658199999999998 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.528726+0000", 2024-05-09T09:54:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010871450000000001 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529363+0000", 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063766799999999998 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529435+0000", 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1896000000000004e-05 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.529496+0000", 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1008999999999998e-05 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.551891114999997, 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029330020000000001, 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 787 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721593+0000", 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721596+0000", 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.066e-06 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721611+0000", 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4212999999999999e-05 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721646+0000", 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4929999999999999e-05 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721661+0000", 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5639000000000001e-05 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.721783+0000", 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012198500000000001 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722000+0000", 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000216913 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.722325+0000", 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032488100000000001 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.723591+0000", 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012658109999999999 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724232+0000", 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064161600000000002 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724402+0000", 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016985399999999999 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.724526+0000", 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012409399999999999 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:12.356 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.547717419999998, 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00290091, 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 789 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725767+0000", 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725769+0000", 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0499999999999999e-06 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725780+0000", 2024-05-09T09:54:12.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1403000000000001e-05 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725812+0000", 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1949999999999997e-05 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725827+0000", 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4559000000000001e-05 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.725953+0000", 2024-05-09T09:54:12.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012557099999999999 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726178+0000", 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000225806 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.726670+0000", 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491392 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.727980+0000", 2024-05-09T09:54:12.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013106210000000001 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728459+0000", 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047831600000000001 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728549+0000", 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0511000000000001e-05 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.728668+0000", 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118731 2024-05-09T09:54:12.361 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.495830363000003, 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033001910000000001, 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.362 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 811 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777654+0000", 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777656+0000", 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777672+0000", 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5937e-05 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777704+0000", 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1535999999999998e-05 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777720+0000", 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6405999999999998e-05 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.777877+0000", 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015672400000000001 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778249+0000", 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371887 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.778823+0000", 2024-05-09T09:54:12.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057379700000000002 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780066+0000", 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001243662 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780742+0000", 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067590900000000004 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780833+0000", 2024-05-09T09:54:12.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0587999999999994e-05 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.780954+0000", 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121475 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.491236153999999, 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030071310000000001, 2024-05-09T09:54:12.367 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 813 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782248+0000", 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782250+0000", 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.536e-06 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782259+0000", 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1740000000000006e-06 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782282+0000", 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3071999999999999e-05 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782293+0000", 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.116e-05 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782431+0000", 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013778099999999999 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.782672+0000", 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024134300000000001 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.783181+0000", 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050910099999999998 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.784515+0000", 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001333264 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785099+0000", 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058447000000000002 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785189+0000", 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9421999999999999e-05 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.785255+0000", 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6808000000000001e-05 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.372 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.309940867999998, 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028573539999999999, 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 889 2024-05-09T09:54:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963544+0000", 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963546+0000", 2024-05-09T09:54:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5170000000000002e-06 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963559+0000", 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3332999999999999e-05 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963588+0000", 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963602+0000", 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4042999999999999e-05 2024-05-09T09:54:12.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963727+0000", 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124678 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.963939+0000", 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021184599999999999 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.964297+0000", 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035836700000000001 2024-05-09T09:54:12.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.965392+0000", 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010947120000000001 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966227+0000", 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083447899999999995 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966315+0000", 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8032e-05 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.966401+0000", 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6330999999999997e-05 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.306252118000003, 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031191109999999999, 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.378 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 891 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967232+0000", 2024-05-09T09:54:12.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967234+0000", 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.714e-06 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967244+0000", 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6600000000000007e-06 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967267+0000", 2024-05-09T09:54:12.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3413000000000001e-05 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967278+0000", 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1345999999999999e-05 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967420+0000", 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014160099999999999 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.967684+0000", 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026351899999999998 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.968252+0000", 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056871000000000005 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.969357+0000", 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001104275 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970193+0000", 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083668499999999999 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970285+0000", 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1324999999999997e-05 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.970351+0000", 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6863e-05 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1021 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.974061922000001, 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032568440000000001, 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1021 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299423+0000", 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299425+0000", 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9560000000000002e-06 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299441+0000", 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.539e-05 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299477+0000", 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5735999999999998e-05 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299494+0000", 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7195999999999999e-05 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299653+0000", 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015902900000000001 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.299889+0000", 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023567799999999999 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.300250+0000", 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000361527 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.301419+0000", 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011689370000000001 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302515+0000", 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001096138 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302607+0000", 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2329000000000003e-05 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:48.302679+0000", 2024-05-09T09:54:12.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1928000000000007e-05 2024-05-09T09:54:12.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.389 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.389 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.389 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:12.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:12.391 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:54:12.391 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:12.391+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:12.492 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:12.491+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:12.545 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:12.546 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:12.546 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:12.546 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:12.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:12.606 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:12.607+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:12.694 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:12.694+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:12.734 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:12.734 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:12.734 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:12.735 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:12.735 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:12.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:12.795 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:12.794+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:12.865 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:12.865 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:12.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:12.865 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:12.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.865 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:12.865 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.754848774999999, 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:54:12.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:12.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:54:12.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:54:12.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.573491935, 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:54:12.872 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:54:12.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:54:12.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:54:12.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:54:12.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:54:12.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.570160412, 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.879 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:12.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:54:12.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:54:12.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.677844438999998, 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.887 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:54:12.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.887 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:54:12.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:54:12.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:54:12.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:54:12.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:54:12.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:54:12.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:54:12.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:54:12.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:54:12.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:54:12.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.657890580999997, 2024-05-09T09:54:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:54:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.633133342000001, 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:54:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.614774552999997, 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:54:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.582822710000002, 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:54:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:54:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:54:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.552871648999997, 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.495422541000003, 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:54:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:54:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:54:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.448592089000002, 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.381543186999998, 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:54:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:54:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:54:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:54:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:54:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:54:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:54:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:54:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:54:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:54:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:54:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:54:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.375964381000003, 2024-05-09T09:54:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:54:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:54:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:54:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:54:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:54:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:54:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:54:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:54:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.155819493999999, 2024-05-09T09:54:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.035695746000002, 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:54:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:54:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:54:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:54:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.872317508999998, 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:54:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:54:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:54:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.837238235999997, 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:54:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.833391622000001, 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.800119049000003, 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.765572884999997, 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:54:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:54:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:54:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:54:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:12.997 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:12.998 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:12.999 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:12.998+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:13.104 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:13.102+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:13.146 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:13.146 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:13.147 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:13.147 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:13.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:13.228 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:13.227+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:13.285 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:13.285 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:13.286 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:13.286 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:13.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:13.304 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:13.302+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:13.401 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:13.399+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:13.497 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:13.498 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:13.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:13.498 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:13.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.498 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:13.499 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:13.499 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.317777671999998, 2024-05-09T09:54:13.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:54:13.499 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.499 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.499 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.500 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.500 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:13.500 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:13.500 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:54:13.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.500 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:13.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:54:13.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:54:13.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:54:13.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:54:13.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:54:13.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:54:13.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.508 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:13.508 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:13.508 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.303261214000003, 2024-05-09T09:54:13.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:54:13.509 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.509 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.509 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.509 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:54:13.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.510 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:13.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:54:13.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.202557878, 2024-05-09T09:54:13.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:54:13.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:54:13.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.190700464000003, 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.522 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:54:13.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:54:13.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:54:13.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.837510877, 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:13.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:54:13.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:54:13.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.833579380000003, 2024-05-09T09:54:13.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:54:13.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:54:13.538 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.703417170999998, 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.539 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:13.544 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.699467577999997, 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:54:13.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:54:13.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:54:13.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:54:13.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:54:13.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:54:13.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.645243428000001, 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.551 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:13.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.641611310000002, 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.558 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:54:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:54:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:54:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.631115942999998, 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.627282934999997, 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:54:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:54:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:54:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.580421381999997, 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:54:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:54:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.576734567999999, 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:54:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.490084463000002, 2024-05-09T09:54:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:54:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:54:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:54:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.486226829000003, 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.390941888, 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:54:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.386501240999998, 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:54:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:54:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.376061167000003, 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.372105957999999, 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:54:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:54:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:54:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:13.626 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:13.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:13.628 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:13.626+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:13.729 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:13.727+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:13.785 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:13.786 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:13.786 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:13.786 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:13.799 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:13.845 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:13.843+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:13.930 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:13.926+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:13.983 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:13.984 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:13.984 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:13.984 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:13.984 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:14.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:14.031 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:14.030+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:14.114 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:14.114 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:14.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:14.114 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:14.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.114 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.942191780999998, 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:14.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:14.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.893379670000002, 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556879999999999, 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.121 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220488+0000", 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.596e-06 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220504+0000", 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5753e-05 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220541+0000", 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999999e-05 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220559+0000", 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7465999999999998e-05 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220704+0000", 2024-05-09T09:54:14.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144754 2024-05-09T09:54:14.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220947+0000", 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243386 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.221368+0000", 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420963 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.222994+0000", 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016260949999999999 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223686+0000", 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069151800000000002 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223771+0000", 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5822000000000006e-05 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223840+0000", 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8734999999999998e-05 2024-05-09T09:54:14.127 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.854179541999997, 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032488740000000001, 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.128 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 227 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:14.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259687+0000", 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259699+0000", 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2199e-05 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259731+0000", 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2060000000000001e-05 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259747+0000", 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5832999999999999e-05 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259923+0000", 2024-05-09T09:54:14.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017627699999999999 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260168+0000", 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024482200000000001 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260592+0000", 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042451899999999999 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262409+0000", 2024-05-09T09:54:14.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018164889999999999 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262778+0000", 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036952099999999999 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262863+0000", 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5121e-05 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262933+0000", 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9913000000000006e-05 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.847089070000003, 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032339780000000002, 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.134 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 229 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266777+0000", 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1900000000000002e-06 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266789+0000", 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1365999999999999e-05 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266820+0000", 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1053000000000002e-05 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266838+0000", 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7963000000000001e-05 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266959+0000", 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121691 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267173+0000", 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021379999999999999 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267579+0000", 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040555300000000001 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269040+0000", 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014609549999999999 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269859+0000", 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081965300000000005 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269946+0000", 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6488000000000003e-05 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270009+0000", 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3266e-05 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.840131868999997, 2024-05-09T09:54:14.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003225641, 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273734+0000", 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273747+0000", 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2363e-05 2024-05-09T09:54:14.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273777+0000", 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273792+0000", 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5157000000000001e-05 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273906+0000", 2024-05-09T09:54:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011372800000000001 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274111+0000", 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000205556 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274578+0000", 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046704899999999998 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276012+0000", 2024-05-09T09:54:14.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001433805 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276811+0000", 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079894299999999998 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276891+0000", 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9948000000000001e-05 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276958+0000", 2024-05-09T09:54:14.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6872999999999995e-05 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:438 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.754649280999999, 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044008270000000004, 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359216+0000", 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0389999999999999e-06 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359224+0000", 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1999999999999994e-06 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359237+0000", 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2826999999999999e-05 2024-05-09T09:54:14.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359243+0000", 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0129999999999999e-06 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359298+0000", 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5041999999999999e-05 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359388+0000", 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0174999999999996e-05 2024-05-09T09:54:14.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359523+0000", 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135122 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.360060+0000", 2024-05-09T09:54:14.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053657399999999995 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363514+0000", 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003454146 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363574+0000", 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.982e-05 2024-05-09T09:54:14.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363616+0000", 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1869000000000002e-05 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:443 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.152 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.749708118999997, 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041654989999999996, 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 443 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364157+0000", 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2299999999999999e-07 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364163+0000", 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9059999999999999e-06 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364177+0000", 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3890000000000001e-05 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364183+0000", 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8210000000000004e-06 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364250+0000", 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6965999999999995e-05 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364341+0000", 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0847999999999995e-05 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364524+0000", 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182778 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.365027+0000", 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050315500000000003 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368257+0000", 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293809999999999 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368293+0000", 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6612000000000001e-05 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368321+0000", 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8218999999999999e-05 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:476 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.729830086, 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030779259999999999, 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.158 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 476 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:14.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384035+0000", 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.046e-06 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384041+0000", 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6899999999999997e-06 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384055+0000", 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4457999999999999e-05 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384062+0000", 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3709999999999996e-06 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384143+0000", 2024-05-09T09:54:14.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1678e-05 2024-05-09T09:54:14.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384199+0000", 2024-05-09T09:54:14.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5940999999999999e-05 2024-05-09T09:54:14.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384322+0000", 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122617 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384970+0000", 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064774299999999999 2024-05-09T09:54:14.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387007+0000", 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020371009999999999 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387067+0000", 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0234e-05 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387112+0000", 2024-05-09T09:54:14.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5046999999999997e-05 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.507322455999997, 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003541209, 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 736 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606544+0000", 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606556+0000", 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.185e-05 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606586+0000", 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606602+0000", 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606759+0000", 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157594 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607123+0000", 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036346000000000002 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607703+0000", 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057985000000000003 2024-05-09T09:54:14.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609215+0000", 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512071 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609797+0000", 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058224999999999998 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609969+0000", 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171767 2024-05-09T09:54:14.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.610083+0000", 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114221 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.502805197000001, 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029874860000000001, 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.173 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 738 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611061+0000", 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1739999999999999e-06 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611073+0000", 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1619e-05 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611099+0000", 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6103000000000001e-05 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611112+0000", 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611252+0000", 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014065799999999999 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611494+0000", 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000241769 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611980+0000", 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000486331 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613227+0000", 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012462529999999999 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613772+0000", 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054489600000000001 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613927+0000", 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000155668 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.614046+0000", 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119065 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.426125923999997, 2024-05-09T09:54:14.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003024648, 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 772 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.180 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687740+0000", 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687753+0000", 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2587e-05 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687785+0000", 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1942e-05 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687802+0000", 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687946+0000", 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014396100000000001 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688198+0000", 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025293499999999998 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688521+0000", 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032281500000000001 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.689716+0000", 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011949160000000001 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690602+0000", 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088602799999999997 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690692+0000", 2024-05-09T09:54:14.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9468000000000005e-05 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690763+0000", 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1109e-05 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:14.186 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.298997812000003, 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002920887, 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 826 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814868+0000", 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.193e-06 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814880+0000", 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1907e-05 2024-05-09T09:54:14.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814912+0000", 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1165999999999999e-05 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814929+0000", 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7912999999999999e-05 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815074+0000", 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014431399999999999 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815305+0000", 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023076300000000001 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815650+0000", 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034591999999999999 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.816971+0000", 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001320508 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817634+0000", 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066317500000000001 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817720+0000", 2024-05-09T09:54:14.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6365000000000004e-05 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817787+0000", 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6662999999999995e-05 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.270819732, 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003347376, 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 838 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843046+0000", 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9870000000000002e-06 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843059+0000", 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3123e-05 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843090+0000", 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843105+0000", 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4956e-05 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843258+0000", 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015342099999999999 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843636+0000", 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377644 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.844223+0000", 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058732299999999995 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.845580+0000", 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013567270000000001 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846218+0000", 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063835499999999996 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846313+0000", 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4475000000000006e-05 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846392+0000", 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9202000000000005e-05 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.266547850999999, 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029984809999999999, 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.199 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 840 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:14.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847318+0000", 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7230000000000001e-06 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847328+0000", 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0233e-05 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847353+0000", 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4719000000000002e-05 2024-05-09T09:54:14.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847365+0000", 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2534000000000001e-05 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847493+0000", 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012747799999999999 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847627+0000", 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013396 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847937+0000", 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031040499999999998 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.848946+0000", 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010091029999999999 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850158+0000", 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001211349 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850239+0000", 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1079000000000001e-05 2024-05-09T09:54:14.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850315+0000", 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5897999999999997e-05 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.242300563999997, 2024-05-09T09:54:14.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029954320000000001, 2024-05-09T09:54:14.206 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.206 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.206 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.206 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871566+0000", 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.153e-06 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871578+0000", 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.184e-05 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871608+0000", 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0859999999999999e-05 2024-05-09T09:54:14.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871623+0000", 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4899000000000001e-05 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871760+0000", 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136685 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871990+0000", 2024-05-09T09:54:14.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229559 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.872322+0000", 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000332128 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.873500+0000", 2024-05-09T09:54:14.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001178023 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874351+0000", 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085124199999999999 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874437+0000", 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6062000000000004e-05 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874559+0000", 2024-05-09T09:54:14.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121981 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.2055632, 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029994549999999998, 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 865 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908303+0000", 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1560000000000002e-06 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908315+0000", 2024-05-09T09:54:14.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908345+0000", 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0383e-05 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908360+0000", 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5023e-05 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908507+0000", 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014646799999999999 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908728+0000", 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022162899999999999 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.909067+0000", 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000338621 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.910282+0000", 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001215156 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911147+0000", 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086497500000000003 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911229+0000", 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2472000000000006e-05 2024-05-09T09:54:14.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911300+0000", 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0832000000000002e-05 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.136746176000003, 2024-05-09T09:54:14.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033122170000000001, 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 895 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977120+0000", 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1100000000000001e-06 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977132+0000", 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1552999999999999e-05 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977163+0000", 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1383000000000001e-05 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977178+0000", 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4807000000000001e-05 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977331+0000", 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152967 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977700+0000", 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036903700000000001 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.978266+0000", 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056619699999999995 2024-05-09T09:54:14.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.979467+0000", 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001201166 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980277+0000", 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081005900000000002 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980367+0000", 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0298999999999997e-05 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980430+0000", 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2638999999999994e-05 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.224 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.132415844000001, 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029215339999999999, 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 897 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981450+0000", 2024-05-09T09:54:14.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0099999999999998e-06 2024-05-09T09:54:14.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981461+0000", 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0504e-05 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981488+0000", 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7503000000000001e-05 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981509+0000", 2024-05-09T09:54:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0406000000000001e-05 2024-05-09T09:54:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981602+0000", 2024-05-09T09:54:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3828999999999999e-05 2024-05-09T09:54:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981724+0000", 2024-05-09T09:54:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121124 2024-05-09T09:54:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981998+0000", 2024-05-09T09:54:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027401500000000001 2024-05-09T09:54:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.982980+0000", 2024-05-09T09:54:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098280999999999998 2024-05-09T09:54:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984221+0000", 2024-05-09T09:54:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012405960000000001 2024-05-09T09:54:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984306+0000", 2024-05-09T09:54:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5074000000000006e-05 2024-05-09T09:54:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984370+0000", 2024-05-09T09:54:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3663000000000004e-05 2024-05-09T09:54:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.043353285999999, 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029823219999999999, 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 934 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070513+0000", 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070525+0000", 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070558+0000", 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2651999999999998e-05 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070580+0000", 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.194e-05 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070713+0000", 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013299399999999999 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070937+0000", 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022408700000000001 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.071257+0000", 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032046100000000002 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.072520+0000", 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001262448 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073338+0000", 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081789299999999998 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073425+0000", 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7127999999999997e-05 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073493+0000", 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8355999999999994e-05 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.036661723999998, 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029267099999999999, 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 937 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077204+0000", 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.804e-06 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077215+0000", 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0576e-05 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077244+0000", 2024-05-09T09:54:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8866000000000001e-05 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077265+0000", 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1607000000000002e-05 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077410+0000", 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014486699999999999 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077632+0000", 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022217600000000001 2024-05-09T09:54:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077954+0000", 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321665 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.078933+0000", 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097881899999999991 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.079959+0000", 2024-05-09T09:54:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001026676 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080047+0000", 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7114999999999995e-05 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080129+0000", 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539000000000004e-05 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:14.245 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:14.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:14.248 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:14.248 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:14.247+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:14.348 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:14.346+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:14.381 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:14.382 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:14.382 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:14.382 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:14.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:54:14.395 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:14.421 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:14.421 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:14.437 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:14.438 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:14.448 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:14.447+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:14.454 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:14.455 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:14.471 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:14.471 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:14.502 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:14.502 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:14.521 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:14.521 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:14.549 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:14.547+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:14.553 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:14.553 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:14.562 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:14.562 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:14.579 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:14.586 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:14.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:14.650 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:14.651+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:14.703 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:14.703 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:14.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:14.751 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:14.751+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:14.840 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:14.840 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:14.852 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:14.850+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:14.854 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:14.953 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:14.950+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:15.020 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:15.020 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:15.036 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:15.079 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:15.078+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:15.155 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:15.155+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:15.202 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:15.202 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:15.216 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:15.267 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:15.266+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:15.333 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:15.333 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:15.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:15.357 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:15.355+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:15.367 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:54:15.458 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:15.459+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:15.514 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:15.515 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:15.530 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:15.579 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:15.578+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:15.651 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:15.651 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:15.660 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:15.659+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:15.665 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:15.761 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:15.758+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:15.824 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:15.824 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:15.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:15.883 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:15.882+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:15.964 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:15.962+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:16.007 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:16.007 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:16.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:16.065 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:16.062+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:16.166 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:16.162+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:16.184 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:16.184 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:16.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:16.266 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:16.262+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:16.316 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:16.317 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:16.330 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:16.374 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:16.375+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:16.449 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:16.449 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:16.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:16.468 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:16.466+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:16.569 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:16.566+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:16.604 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:16.615 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:16.615 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:16.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:16.674 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:16.675+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:16.749 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:16.750 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:16.768 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:16.768 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:16.769 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:16.767+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:16.785 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:16.786 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:16.801 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:16.801 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:16.822 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:16.822 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:16.842 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:16.842 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:16.846 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:16.846 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:16.846 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:16.846 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:16.862 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:16.863 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:16.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:16.882 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:16.883 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:16.883 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:16.883+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:16.972 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:16.970+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:16.991 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:16.991 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:16.991 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:16.991 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:16.991 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:17.004 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:17.073 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:17.070+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:17.115 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:17.115 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:17.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:17.115 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:17.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:17.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:17.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.005653339000006, 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:17.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:54:17.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:54:17.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:17.121 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.824296498999999, 2024-05-09T09:54:17.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030889839999999999, 2024-05-09T09:54:17.122 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.122 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.122 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.122 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.122 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.122 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 193 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290355+0000", 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290357+0000", 2024-05-09T09:54:17.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:17.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290370+0000", 2024-05-09T09:54:17.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.254e-05 2024-05-09T09:54:17.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290401+0000", 2024-05-09T09:54:17.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1588999999999999e-05 2024-05-09T09:54:17.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290416+0000", 2024-05-09T09:54:17.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.433e-05 2024-05-09T09:54:17.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290561+0000", 2024-05-09T09:54:17.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145067 2024-05-09T09:54:17.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.290764+0000", 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000203296 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.291014+0000", 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025020499999999998 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.292460+0000", 2024-05-09T09:54:17.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014457820000000001 2024-05-09T09:54:17.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293282+0000", 2024-05-09T09:54:17.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082191499999999999 2024-05-09T09:54:17.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293374+0000", 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2027999999999994e-05 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293444+0000", 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0081999999999997e-05 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:194 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94540191553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.820964975999999, 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002847086, 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 194 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293686+0000", 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293689+0000", 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2859999999999998e-06 2024-05-09T09:54:17.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293698+0000", 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4469999999999995e-06 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293725+0000", 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6936000000000001e-05 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293740+0000", 2024-05-09T09:54:17.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4603000000000001e-05 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293833+0000", 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3327999999999998e-05 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.293968+0000", 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013477500000000001 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.294223+0000", 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025499499999999999 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.295407+0000", 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118439 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296337+0000", 2024-05-09T09:54:17.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092938000000000005 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296424+0000", 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7003999999999996e-05 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.296534+0000", 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109942 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.928649002999997, 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057812749999999998, 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.139 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 208 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186002+0000", 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186007+0000", 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3839999999999999e-06 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186025+0000", 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8488999999999999e-05 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186071+0000", 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5726000000000002e-05 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186088+0000", 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7156e-05 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186261+0000", 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172757 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.186609+0000", 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034819400000000002 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.187064+0000", 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045507000000000002 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.188713+0000", 2024-05-09T09:54:17.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016486719999999999 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191570+0000", 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028566469999999999 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191709+0000", 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013905100000000001 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.191784+0000", 2024-05-09T09:54:17.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5129000000000005e-05 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.908695145000003, 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038308449999999998, 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205956+0000", 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205959+0000", 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5469999999999999e-06 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.205971+0000", 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206000+0000", 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8983e-05 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206014+0000", 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3976e-05 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206179+0000", 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165131 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.206540+0000", 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036162 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.207276+0000", 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073537799999999996 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209049+0000", 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001773019 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209506+0000", 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045694900000000001 2024-05-09T09:54:17.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209654+0000", 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014817699999999999 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.209787+0000", 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013314199999999999 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.150 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.883937906, 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031101039999999998, 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 219 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230714+0000", 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230716+0000", 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.137e-06 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230726+0000", 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0530000000000001e-05 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230755+0000", 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9295999999999999e-05 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230771+0000", 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.230942+0000", 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017139 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231171+0000", 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.231600+0000", 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042917900000000002 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.232834+0000", 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012339919999999999 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233667+0000", 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083213000000000004 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233755+0000", 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8714000000000005e-05 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.233824+0000", 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8392999999999994e-05 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.865579117000003, 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029614060000000002, 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.156 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249072+0000", 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249074+0000", 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249085+0000", 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0713999999999999e-05 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249115+0000", 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0255000000000001e-05 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249130+0000", 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5109999999999999e-05 2024-05-09T09:54:17.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249269+0000", 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000138725 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249478+0000", 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000209209 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.249894+0000", 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041595 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251128+0000", 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012336059999999999 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251883+0000", 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075490699999999997 2024-05-09T09:54:17.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.251969+0000", 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5654000000000004e-05 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.252034+0000", 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5155999999999998e-05 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.162 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.833627274000001, 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039046689999999999, 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281024+0000", 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281026+0000", 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.356e-06 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281039+0000", 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2527000000000001e-05 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281070+0000", 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0959e-05 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281085+0000", 2024-05-09T09:54:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4836e-05 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281253+0000", 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016813099999999999 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.281625+0000", 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037174700000000002 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.282435+0000", 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081066600000000003 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284150+0000", 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017141509999999999 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284652+0000", 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050273099999999997 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284815+0000", 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016269400000000001 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.284929+0000", 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011387099999999999 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.169 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.803676213000003, 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004776621, 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 319 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:17.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310975+0000", 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310977+0000", 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.42e-06 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310983+0000", 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7460000000000003e-06 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.310998+0000", 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4878999999999999e-05 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311007+0000", 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3380000000000005e-06 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311072+0000", 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5912000000000002e-05 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311193+0000", 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012071 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.311349+0000", 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015559499999999999 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.312186+0000", 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083703 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315690+0000", 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035041849999999999 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315724+0000", 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3804999999999999e-05 2024-05-09T09:54:17.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.315752+0000", 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8000999999999998e-05 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:448 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:17.175 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.746227105000003, 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032962629999999998, 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 448 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368424+0000", 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368426+0000", 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.733e-06 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368433+0000", 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.934e-06 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368449+0000", 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6066000000000002e-05 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368460+0000", 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1250000000000001e-05 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368534+0000", 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4121000000000004e-05 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368641+0000", 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010661 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368818+0000", 2024-05-09T09:54:17.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017709099999999999 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.369474+0000", 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065565199999999995 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371620+0000", 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021459270000000002 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371677+0000", 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7397e-05 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.371721+0000", 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3482000000000001e-05 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:531 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.699396653000001, 2024-05-09T09:54:17.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003251543, 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 531 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415255+0000", 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3e-07 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415260+0000", 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3540000000000002e-06 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415271+0000", 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0869999999999999e-05 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415276+0000", 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9740000000000001e-06 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415321+0000", 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5849000000000001e-05 2024-05-09T09:54:17.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415372+0000", 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0949000000000003e-05 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415486+0000", 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113325 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.415983+0000", 2024-05-09T09:54:17.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049706299999999995 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418421+0000", 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024383629999999998 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418458+0000", 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6384000000000003e-05 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.418506+0000", 2024-05-09T09:54:17.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8782000000000002e-05 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:634 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.632347750999998, 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037987329999999999, 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 634 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482304+0000", 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482305+0000", 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6199999999999999e-06 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482312+0000", 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0169999999999999e-06 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482330+0000", 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7450000000000001e-05 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482339+0000", 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9840000000000007e-06 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482418+0000", 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9521e-05 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482473+0000", 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4950000000000001e-05 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.482586+0000", 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113274 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.483157+0000", 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057053099999999999 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.485972+0000", 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00281547 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486029+0000", 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6285000000000001e-05 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.486102+0000", 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3631e-05 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:639 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:17.192 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.626768945000002, 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030187959999999998, 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 639 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487882+0000", 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487883+0000", 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6600000000000005e-07 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487888+0000", 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.724e-06 2024-05-09T09:54:17.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487901+0000", 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.331e-05 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487911+0000", 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2699999999999993e-06 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.487983+0000", 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2698000000000001e-05 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488067+0000", 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3441000000000003e-05 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488281+0000", 2024-05-09T09:54:17.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021462400000000001 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.488949+0000", 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066732499999999997 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490773+0000", 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018238550000000001 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490828+0000", 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5813000000000002e-05 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.490901+0000", 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2869999999999999e-05 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.406624057999998, 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030804339999999999, 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 781 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708027+0000", 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708030+0000", 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3800000000000001e-06 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708043+0000", 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3740000000000001e-05 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708094+0000", 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0309000000000002e-05 2024-05-09T09:54:17.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708114+0000", 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0682999999999998e-05 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708240+0000", 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012506099999999999 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708461+0000", 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022108300000000001 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.708787+0000", 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032650099999999998 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.709870+0000", 2024-05-09T09:54:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001082532 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.710947+0000", 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010773180000000001 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711037+0000", 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0334999999999995e-05 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.711108+0000", 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0492000000000002e-05 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.286500310000001, 2024-05-09T09:54:17.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002945034, 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 832 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828151+0000", 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828153+0000", 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2469999999999998e-06 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828165+0000", 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1389999999999999e-05 2024-05-09T09:54:17.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828196+0000", 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1639e-05 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828211+0000", 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4790000000000001e-05 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828324+0000", 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113255 2024-05-09T09:54:17.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828536+0000", 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021130899999999999 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.828854+0000", 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031865799999999998 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830051+0000", 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011967099999999999 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.830943+0000", 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089203199999999996 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831028+0000", 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5080999999999994e-05 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.831096+0000", 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7922999999999993e-05 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.123122072999998, 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027902729999999998, 2024-05-09T09:54:17.211 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 901 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991529+0000", 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991532+0000", 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7769999999999998e-06 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991546+0000", 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3936e-05 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991578+0000", 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991593+0000", 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4976e-05 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991710+0000", 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636799999999999 2024-05-09T09:54:17.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.991921+0000", 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021098300000000001 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.992303+0000", 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038241399999999997 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.993452+0000", 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00114926 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994162+0000", 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00070955499999999995 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994252+0000", 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9802000000000005e-05 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.994320+0000", 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8062e-05 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.088042799999997, 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028884969999999999, 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.217 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 916 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026609+0000", 2024-05-09T09:54:17.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026611+0000", 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.984e-06 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026622+0000", 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0986e-05 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026652+0000", 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0278999999999999e-05 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026667+0000", 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5396999999999998e-05 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.026783+0000", 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115661 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027037+0000", 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025421599999999998 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.027379+0000", 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034214 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.028550+0000", 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001170817 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029354+0000", 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080400600000000001 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029434+0000", 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9732000000000002e-05 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.029497+0000", 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3279000000000002e-05 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.084196186, 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028943469999999998, 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 918 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030455+0000", 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030457+0000", 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4339999999999999e-06 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030466+0000", 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9160000000000007e-06 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030491+0000", 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5323000000000001e-05 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030503+0000", 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2255999999999999e-05 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030616+0000", 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011275199999999999 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.030746+0000", 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012997099999999999 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.031013+0000", 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026707800000000002 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.032079+0000", 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001066216 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033139+0000", 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010601479999999999 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033232+0000", 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3032e-05 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.033350+0000", 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011722099999999999 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.050923613000002, 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028392080000000002, 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.228 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 931 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063728+0000", 2024-05-09T09:54:17.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063730+0000", 2024-05-09T09:54:17.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9829999999999999e-06 2024-05-09T09:54:17.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063740+0000", 2024-05-09T09:54:17.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0667e-05 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063771+0000", 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0648999999999997e-05 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063786+0000", 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4912999999999999e-05 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.063970+0000", 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184057 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064209+0000", 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023906599999999999 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.064535+0000", 2024-05-09T09:54:17.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032545499999999999 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.065799+0000", 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012642549999999999 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066424+0000", 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062510500000000004 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066503+0000", 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9505999999999994e-05 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.066567+0000", 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3552000000000004e-05 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.016377448999997, 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028053660000000001, 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 946 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.239 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098274+0000", 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098276+0000", 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1469999999999999e-06 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098289+0000", 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2517000000000001e-05 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098317+0000", 2024-05-09T09:54:17.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8221999999999998e-05 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098332+0000", 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5017e-05 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098439+0000", 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010699799999999999 2024-05-09T09:54:17.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098650+0000", 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021133999999999999 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.098986+0000", 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00033566100000000001 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100148+0000", 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001162256 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.100922+0000", 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077416099999999999 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101008+0000", 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6107999999999996e-05 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.101079+0000", 2024-05-09T09:54:17.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0939000000000006e-05 2024-05-09T09:54:17.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.245 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.245 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.245 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:17.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:17.247 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:17.242+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:17.348 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:17.346+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:17.358 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:17.358 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:17.358 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:17.358 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:17.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:17.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:54:17.449 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:17.446+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:17.482 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:17.483 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:17.483 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:17.483 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:17.483 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:17.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:17.550 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:17.547+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.451674757000006, 2024-05-09T09:54:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:54:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.437158298999996, 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:54:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.336454963000001, 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:54:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.324597549000003, 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.971407962000001, 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:54:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:54:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.967476464999997, 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:54:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.837314255999999, 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.833364662999998, 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:54:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:54:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:54:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.779140513000002, 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:54:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.775508395000003, 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:54:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:54:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.765013027999998, 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.761180019999998, 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:54:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:54:17.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:54:17.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:54:17.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.714318466999998, 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:54:17.699 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:54:17.704 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.710631653, 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:54:17.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:54:17.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.623981548000003, 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:54:17.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.620123913999997, 2024-05-09T09:54:17.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.721 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.524838973000001, 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:54:17.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:54:17.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:54:17.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:54:17.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.520398325999999, 2024-05-09T09:54:17.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.509958251999997, 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.506003043, 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:17.738 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:17.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:54:17.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:54:17.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:54:17.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:17.743 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:17.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:17.745 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:17.743+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:17.847 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:17.847+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:17.894 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:17.894 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:17.894 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:17.894 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:17.907 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:17.954 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:17.955+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:18.051 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:18.050+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:18.081 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:18.081 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:18.081 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:18.081 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:18.081 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:18.098 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:18.152 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:18.150+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 60.040059538000001, 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:18.213 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:18.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:18.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:18.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:18.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.219 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.991247426999998, 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556879999999999, 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:18.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220488+0000", 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.596e-06 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220504+0000", 2024-05-09T09:54:18.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5753e-05 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220541+0000", 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999999e-05 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220559+0000", 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7465999999999998e-05 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220704+0000", 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144754 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220947+0000", 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243386 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.221368+0000", 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420963 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.222994+0000", 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016260949999999999 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223686+0000", 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069151800000000002 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223771+0000", 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5822000000000006e-05 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223840+0000", 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8734999999999998e-05 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.952047299, 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032488740000000001, 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 227 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259687+0000", 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259699+0000", 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2199e-05 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259731+0000", 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2060000000000001e-05 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259747+0000", 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5832999999999999e-05 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259923+0000", 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017627699999999999 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260168+0000", 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024482200000000001 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260592+0000", 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042451899999999999 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262409+0000", 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018164889999999999 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262778+0000", 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036952099999999999 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262863+0000", 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5121e-05 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262933+0000", 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9913000000000006e-05 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.944956826999999, 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032339780000000002, 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 229 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266777+0000", 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1900000000000002e-06 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266789+0000", 2024-05-09T09:54:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1365999999999999e-05 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266820+0000", 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1053000000000002e-05 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266838+0000", 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7963000000000001e-05 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266959+0000", 2024-05-09T09:54:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121691 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267173+0000", 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021379999999999999 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267579+0000", 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040555300000000001 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269040+0000", 2024-05-09T09:54:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014609549999999999 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269859+0000", 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081965300000000005 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269946+0000", 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6488000000000003e-05 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270009+0000", 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3266e-05 2024-05-09T09:54:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.937999626, 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003225641, 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-05-09T09:54:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273734+0000", 2024-05-09T09:54:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273747+0000", 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2363e-05 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273777+0000", 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273792+0000", 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5157000000000001e-05 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273906+0000", 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011372800000000001 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274111+0000", 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000205556 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274578+0000", 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046704899999999998 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276012+0000", 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001433805 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276811+0000", 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079894299999999998 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276891+0000", 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9948000000000001e-05 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276958+0000", 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6872999999999995e-05 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:438 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.852517038000002, 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044008270000000004, 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359216+0000", 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0389999999999999e-06 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359224+0000", 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1999999999999994e-06 2024-05-09T09:54:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359237+0000", 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2826999999999999e-05 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359243+0000", 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0129999999999999e-06 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359298+0000", 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5041999999999999e-05 2024-05-09T09:54:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359388+0000", 2024-05-09T09:54:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0174999999999996e-05 2024-05-09T09:54:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359523+0000", 2024-05-09T09:54:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135122 2024-05-09T09:54:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.360060+0000", 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053657399999999995 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363514+0000", 2024-05-09T09:54:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003454146 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363574+0000", 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.982e-05 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363616+0000", 2024-05-09T09:54:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1869000000000002e-05 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:443 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.847575876000001, 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041654989999999996, 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 443 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364157+0000", 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2299999999999999e-07 2024-05-09T09:54:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364163+0000", 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9059999999999999e-06 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364177+0000", 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3890000000000001e-05 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364183+0000", 2024-05-09T09:54:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8210000000000004e-06 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364250+0000", 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6965999999999995e-05 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364341+0000", 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0847999999999995e-05 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364524+0000", 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182778 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.365027+0000", 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050315500000000003 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368257+0000", 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293809999999999 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368293+0000", 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6612000000000001e-05 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368321+0000", 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8218999999999999e-05 2024-05-09T09:54:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:476 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.827697843000003, 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030779259999999999, 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 476 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384035+0000", 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.046e-06 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384041+0000", 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6899999999999997e-06 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384055+0000", 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4457999999999999e-05 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384062+0000", 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3709999999999996e-06 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384143+0000", 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1678e-05 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384199+0000", 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5940999999999999e-05 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384322+0000", 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122617 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384970+0000", 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064774299999999999 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387007+0000", 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020371009999999999 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387067+0000", 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0234e-05 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387112+0000", 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5046999999999997e-05 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.605190213, 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003541209, 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 736 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606544+0000", 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606556+0000", 2024-05-09T09:54:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.185e-05 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606586+0000", 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606602+0000", 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606759+0000", 2024-05-09T09:54:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157594 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607123+0000", 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036346000000000002 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607703+0000", 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057985000000000003 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609215+0000", 2024-05-09T09:54:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512071 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609797+0000", 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058224999999999998 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609969+0000", 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171767 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.610083+0000", 2024-05-09T09:54:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114221 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.600672953999997, 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029874860000000001, 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 738 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611061+0000", 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1739999999999999e-06 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611073+0000", 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1619e-05 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611099+0000", 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6103000000000001e-05 2024-05-09T09:54:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611112+0000", 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611252+0000", 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014065799999999999 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611494+0000", 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000241769 2024-05-09T09:54:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611980+0000", 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000486331 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613227+0000", 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012462529999999999 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613772+0000", 2024-05-09T09:54:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054489600000000001 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613927+0000", 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000155668 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.614046+0000", 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119065 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.523993681, 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003024648, 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 772 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687740+0000", 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687753+0000", 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2587e-05 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687785+0000", 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1942e-05 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687802+0000", 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687946+0000", 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014396100000000001 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688198+0000", 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025293499999999998 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688521+0000", 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032281500000000001 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.689716+0000", 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011949160000000001 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690602+0000", 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088602799999999997 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690692+0000", 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9468000000000005e-05 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690763+0000", 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1109e-05 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.396865568999999, 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002920887, 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 826 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814868+0000", 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.193e-06 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814880+0000", 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1907e-05 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814912+0000", 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1165999999999999e-05 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814929+0000", 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7912999999999999e-05 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815074+0000", 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014431399999999999 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815305+0000", 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023076300000000001 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815650+0000", 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034591999999999999 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.816971+0000", 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001320508 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817634+0000", 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066317500000000001 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817720+0000", 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6365000000000004e-05 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817787+0000", 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6662999999999995e-05 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.368687489000003, 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003347376, 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 838 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843046+0000", 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9870000000000002e-06 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843059+0000", 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3123e-05 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843090+0000", 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843105+0000", 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4956e-05 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843258+0000", 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015342099999999999 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843636+0000", 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377644 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.844223+0000", 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058732299999999995 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.845580+0000", 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013567270000000001 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846218+0000", 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063835499999999996 2024-05-09T09:54:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846313+0000", 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4475000000000006e-05 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846392+0000", 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9202000000000005e-05 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.364415608000002, 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029984809999999999, 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 840 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847318+0000", 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7230000000000001e-06 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847328+0000", 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0233e-05 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847353+0000", 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4719000000000002e-05 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847365+0000", 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2534000000000001e-05 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847493+0000", 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012747799999999999 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847627+0000", 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013396 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847937+0000", 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031040499999999998 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.848946+0000", 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010091029999999999 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850158+0000", 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001211349 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850239+0000", 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1079000000000001e-05 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850315+0000", 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5897999999999997e-05 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.340168321, 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029954320000000001, 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871566+0000", 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.153e-06 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871578+0000", 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.184e-05 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871608+0000", 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0859999999999999e-05 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871623+0000", 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4899000000000001e-05 2024-05-09T09:54:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871760+0000", 2024-05-09T09:54:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136685 2024-05-09T09:54:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871990+0000", 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229559 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.872322+0000", 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000332128 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.873500+0000", 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001178023 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874351+0000", 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085124199999999999 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874437+0000", 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6062000000000004e-05 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874559+0000", 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121981 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.303430957000003, 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029994549999999998, 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 865 2024-05-09T09:54:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908303+0000", 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1560000000000002e-06 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908315+0000", 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908345+0000", 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0383e-05 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908360+0000", 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5023e-05 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908507+0000", 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014646799999999999 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908728+0000", 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022162899999999999 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.909067+0000", 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000338621 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.910282+0000", 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001215156 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911147+0000", 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086497500000000003 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911229+0000", 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2472000000000006e-05 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911300+0000", 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0832000000000002e-05 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.234613932999999, 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033122170000000001, 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 895 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977120+0000", 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1100000000000001e-06 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977132+0000", 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1552999999999999e-05 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977163+0000", 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1383000000000001e-05 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977178+0000", 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4807000000000001e-05 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977331+0000", 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152967 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977700+0000", 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036903700000000001 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.978266+0000", 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056619699999999995 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.979467+0000", 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001201166 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980277+0000", 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081005900000000002 2024-05-09T09:54:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980367+0000", 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0298999999999997e-05 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980430+0000", 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2638999999999994e-05 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.230283600999996, 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029215339999999999, 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 897 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981450+0000", 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0099999999999998e-06 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981461+0000", 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0504e-05 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981488+0000", 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7503000000000001e-05 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981509+0000", 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0406000000000001e-05 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981602+0000", 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3828999999999999e-05 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981724+0000", 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121124 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981998+0000", 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027401500000000001 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.982980+0000", 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098280999999999998 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984221+0000", 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012405960000000001 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984306+0000", 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5074000000000006e-05 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984370+0000", 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3663000000000004e-05 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.141221043000002, 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029823219999999999, 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 934 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070513+0000", 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070525+0000", 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070558+0000", 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2651999999999998e-05 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070580+0000", 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.194e-05 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070713+0000", 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013299399999999999 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070937+0000", 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022408700000000001 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.071257+0000", 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032046100000000002 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.072520+0000", 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001262448 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073338+0000", 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081789299999999998 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073425+0000", 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7127999999999997e-05 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073493+0000", 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8355999999999994e-05 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.134529481000001, 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029267099999999999, 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 937 2024-05-09T09:54:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077204+0000", 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.804e-06 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077215+0000", 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0576e-05 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077244+0000", 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8866000000000001e-05 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077265+0000", 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1607000000000002e-05 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077410+0000", 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014486699999999999 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077632+0000", 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022217600000000001 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077954+0000", 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321665 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.078933+0000", 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097881899999999991 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.079959+0000", 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001026676 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080047+0000", 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7114999999999995e-05 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080129+0000", 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539000000000004e-05 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:18.334 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:18.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:18.336 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:18.335+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:18.379 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:54:18.436 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:18.435+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:18.470 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:18.471 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:18.471 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:18.471 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:18.485 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:18.537 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:18.534+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:18.608 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:18.608 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:18.608 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:18.608 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:18.608 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:18.622 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:18.638 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:18.639+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:18.739 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:18.739+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.673983575999998, 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019579709000000001, 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.797 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 43 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119950+0000", 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119985+0000", 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4941999999999999e-05 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120018+0000", 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179999999999997e-05 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120040+0000", 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2432000000000001e-05 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120194+0000", 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015399700000000001 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120215+0000", 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0886e-05 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139214+0000", 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018999381999999999 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139526+0000", 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031177000000000001 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.801 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.591733605999998, 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787665, 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 211 2024-05-09T09:54:18.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202200+0000", 2024-05-09T09:54:18.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202215+0000", 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5656999999999999e-05 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202254+0000", 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8506e-05 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202272+0000", 2024-05-09T09:54:18.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8300000000000001e-05 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202427+0000", 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015497699999999999 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202662+0000", 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234928 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.203104+0000", 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000442151 2024-05-09T09:54:18.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.204510+0000", 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014061329999999999 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205816+0000", 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013059009999999999 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205907+0000", 2024-05-09T09:54:18.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0841000000000007e-05 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205984+0000", 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7164999999999997e-05 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.516413782000001, 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034049729999999999, 2024-05-09T09:54:18.807 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 232 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277519+0000", 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277531+0000", 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2320000000000001e-05 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277564+0000", 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2669999999999997e-05 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277579+0000", 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5415999999999999e-05 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277729+0000", 2024-05-09T09:54:18.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014924 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277957+0000", 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022849599999999999 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.278368+0000", 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041114500000000002 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.279935+0000", 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015665290000000001 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280758+0000", 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082300099999999996 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280850+0000", 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1978000000000006e-05 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280921+0000", 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1527999999999997e-05 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:281 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.488085853999998, 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030930129999999999, 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 281 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305847+0000", 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3300000000000001e-06 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305858+0000", 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.099e-05 2024-05-09T09:54:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305882+0000", 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4026999999999999e-05 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305905+0000", 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3376000000000001e-05 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306060+0000", 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154757 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306388+0000", 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032792699999999999 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.307138+0000", 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074994099999999995 2024-05-09T09:54:18.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308466+0000", 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013284569999999999 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308604+0000", 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137677 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308776+0000", 2024-05-09T09:54:18.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017272000000000001 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308937+0000", 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016081099999999999 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:360 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:18.819 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.474792538999999, 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038853109999999998, 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 360 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319140+0000", 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.057e-06 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319151+0000", 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319180+0000", 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8578999999999999e-05 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319200+0000", 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0236000000000001e-05 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319337+0000", 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013646400000000001 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319617+0000", 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028014499999999998 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.320147+0000", 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052992600000000001 2024-05-09T09:54:18.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321598+0000", 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014515820000000001 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322829+0000", 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012307959999999999 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322925+0000", 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5494000000000004e-05 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323023+0000", 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8292e-05 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:378 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:18.825 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.469746591000003, 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036244110000000001, 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 378 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324187+0000", 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999999e-06 2024-05-09T09:54:18.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324203+0000", 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.609e-05 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324240+0000", 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7052999999999999e-05 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324262+0000", 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2195999999999999e-05 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324396+0000", 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013415700000000001 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324628+0000", 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023225200000000001 2024-05-09T09:54:18.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325138+0000", 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050956299999999999 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.326372+0000", 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012345489999999999 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327556+0000", 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011832430000000001 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327701+0000", 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014539699999999999 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327808+0000", 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106835 2024-05-09T09:54:18.831 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.454389024999998, 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876559999999998, 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.832 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 406 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339543+0000", 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2570000000000002e-06 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339553+0000", 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:54:18.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339576+0000", 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2857000000000002e-05 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339591+0000", 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4905e-05 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339738+0000", 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014698599999999999 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340100+0000", 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036169499999999999 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340703+0000", 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060361099999999999 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342128+0000", 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014245690000000001 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342467+0000", 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033892500000000001 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342554+0000", 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7527000000000004e-05 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342629+0000", 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4580999999999996e-05 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.838 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:438 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'3, mlcod=30'1)", 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.434000570000002, 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036072999999999999, 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359931+0000", 2024-05-09T09:54:18.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.891e-06 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359945+0000", 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359978+0000", 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2465000000000002e-05 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359996+0000", 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360123+0000", 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012710900000000001 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360164+0000", 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0719000000000001e-05 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363453+0000", 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003289555 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363537+0000", 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3535999999999994e-05 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:443 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'4, mlcod=30'2)", 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.429017768000001, 2024-05-09T09:54:18.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034263010000000001, 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364914+0000", 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-06 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364925+0000", 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628000000000001e-05 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364948+0000", 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3594000000000001e-05 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364960+0000", 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2017e-05 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365077+0000", 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116706 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365114+0000", 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6908e-05 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368217+0000", 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031027820000000001 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368339+0000", 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121989 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:18.847 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.398334097000003, 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028199750000000002, 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 499 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395598+0000", 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0470000000000001e-06 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395609+0000", 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1083e-05 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395631+0000", 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1953000000000001e-05 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395644+0000", 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2860000000000001e-05 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395771+0000", 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127231 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395990+0000", 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000218779 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.396428+0000", 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000437854 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.397598+0000", 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011703239999999999 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398222+0000", 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062386500000000003 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398324+0000", 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010160100000000001 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398416+0000", 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2378000000000002e-05 2024-05-09T09:54:18.852 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.311915640000002, 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085482570000000001, 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.853 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 633 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482016+0000", 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9300000000000002e-06 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482024+0000", 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0630000000000006e-06 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482042+0000", 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7713000000000001e-05 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482053+0000", 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1246e-05 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482171+0000", 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117465 2024-05-09T09:54:18.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482382+0000", 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000210719 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482853+0000", 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047157999999999998 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.485997+0000", 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031434620000000001 2024-05-09T09:54:18.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490455+0000", 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004458414 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490516+0000", 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0488000000000001e-05 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490563+0000", 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.242249352999998, 2024-05-09T09:54:18.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787257, 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 709 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551683+0000", 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4059999999999999e-06 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551696+0000", 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551725+0000", 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8890999999999998e-05 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551743+0000", 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7878999999999999e-05 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551889+0000", 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014628199999999999 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552237+0000", 2024-05-09T09:54:18.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034787300000000001 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552746+0000", 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050886300000000002 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.554142+0000", 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013964120000000001 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555320+0000", 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001177974 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555400+0000", 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9468000000000006e-05 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555468+0000", 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8511999999999997e-05 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.204405446999999, 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028728, 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 727 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589527+0000", 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356e-06 2024-05-09T09:54:18.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589538+0000", 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1463e-05 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589571+0000", 2024-05-09T09:54:18.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589592+0000", 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1219000000000001e-05 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589739+0000", 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147424 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590004+0000", 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264632 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590346+0000", 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034226299999999999 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592098+0000", 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001752116 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592249+0000", 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015033000000000001 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592335+0000", 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5890999999999995e-05 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592397+0000", 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2966000000000007e-05 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.200639332000002, 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031054329999999999, 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 729 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593292+0000", 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.344e-06 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593300+0000", 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5229999999999998e-06 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593321+0000", 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1299999999999999e-05 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593339+0000", 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8206000000000002e-05 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593428+0000", 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8928e-05 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593547+0000", 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118794 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593824+0000", 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027681500000000003 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.595408+0000", 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001584086 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596242+0000", 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083392999999999998 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596333+0000", 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0878000000000006e-05 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596396+0000", 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3628999999999997e-05 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.098858581999998, 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031859179999999998, 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.880 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 775 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695074+0000", 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.723e-06 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695086+0000", 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1457000000000001e-05 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695117+0000", 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1343000000000001e-05 2024-05-09T09:54:18.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695138+0000", 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0622999999999999e-05 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695261+0000", 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123621 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695596+0000", 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033511000000000001 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.696142+0000", 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054512500000000004 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.697459+0000", 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013177480000000001 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698089+0000", 2024-05-09T09:54:18.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063017800000000001 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698179+0000", 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9511000000000004e-05 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698257+0000", 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8479000000000005e-05 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 60.008087371000002, 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002852074, 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 814 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785845+0000", 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785856+0000", 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1323e-05 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785887+0000", 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0602999999999998e-05 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785901+0000", 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4612e-05 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786031+0000", 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012920100000000001 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786246+0000", 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021583299999999999 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786562+0000", 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031516999999999998 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.787822+0000", 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001260359 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788501+0000", 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067859300000000001 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788589+0000", 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7961999999999996e-05 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788695+0000", 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106258 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 59.850866625000002, 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029203889999999998, 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.891 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 880 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943067+0000", 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1870000000000001e-06 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943079+0000", 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2319e-05 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943111+0000", 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1779999999999997e-05 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943126+0000", 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285999999999999e-05 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943239+0000", 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112631 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943472+0000", 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023326299999999999 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943790+0000", 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031812600000000001 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.944926+0000", 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011362519999999999 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945815+0000", 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088909199999999996 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945906+0000", 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0997999999999998e-05 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945984+0000", 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7454999999999996e-05 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 59.843642000999999, 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028357909999999998, 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 883 2024-05-09T09:54:18.897 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950290+0000", 2024-05-09T09:54:18.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3e-06 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950303+0000", 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.261e-05 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950334+0000", 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950354+0000", 2024-05-09T09:54:18.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9865999999999999e-05 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950487+0000", 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950710+0000", 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223002 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.951056+0000", 2024-05-09T09:54:18.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034612999999999999 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952129+0000", 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010729820000000001 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952975+0000", 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00084584999999999999 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953059+0000", 2024-05-09T09:54:18.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4371999999999998e-05 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953124+0000", 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4412000000000006e-05 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 59.773939196000001, 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028784679999999999, 2024-05-09T09:54:18.902 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 913 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.903 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019993+0000", 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3769999999999999e-06 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020005+0000", 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1797000000000001e-05 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020036+0000", 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0876000000000001e-05 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020051+0000", 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4739000000000001e-05 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020163+0000", 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112432 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020385+0000", 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022189200000000001 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020709+0000", 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032386699999999998 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.021761+0000", 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051979 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022727+0000", 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096616099999999999 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022805+0000", 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8009000000000005e-05 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022869+0000", 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4338999999999995e-05 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 59.736984749999998, 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00285995, 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 928 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:18.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056947+0000", 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.81e-06 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056957+0000", 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5829999999999996e-06 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056980+0000", 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3278999999999999e-05 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056992+0000", 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2437e-05 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057171+0000", 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017842199999999999 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057393+0000", 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022195 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057705+0000", 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000311687 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.058914+0000", 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012093029999999999 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059652+0000", 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073784800000000004 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059738+0000", 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6231999999999997e-05 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:18.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059805+0000", 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7398999999999996e-05 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:18.913 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:18.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:18.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:18.916 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:18.910+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:19.016 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:19.014+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:19.042 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:19.059 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:19.060 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:19.077 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:19.086 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:19.086 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:19.086 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:19.086 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:19.094 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:19.094 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:19.100 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:19.114 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:19.115 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:19.143 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:19.142+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:19.145 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:19.145 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:19.180 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:19.180 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:19.213 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:19.213 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:19.216 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:19.215+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:19.269 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:19.269 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:19.283 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:19.331 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:19.330+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:19.404 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:19.404 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:19.418 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:19.419 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:19.414+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:19.519 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:19.518+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:19.588 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:19.588 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:19.603 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:19.620 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:19.619+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:19.721 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:19.719+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:19.771 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:19.771 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:19.785 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:19.831 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:19.830+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:19.901 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:19.901 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:19.915 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:19.963 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:19.962+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:20.025 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:20.022+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:20.088 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:20.088 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:20.101 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:20.125 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:20.123+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:20.226 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:20.226+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:20.264 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:20.264 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:20.278 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:20.327 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:20.327+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:20.406 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:20.443 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:20.450 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:20.451+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:20.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:20.528 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:20.527+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:20.590 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:20.590 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:20.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:20.630 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:20.626+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:20.731 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:20.730+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:20.757 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:20.757 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:20.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:20.832 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:20.831+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:20.891 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:20.891 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:20.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:20.951 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:20.951+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:21.034 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:21.034+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:21.064 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:21.064 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:21.078 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:21.135 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:21.134+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:21.194 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:21.194 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:21.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:21.235 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:21.254 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:21.255+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:21.336 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:21.336 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:21.336 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:21.335+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:21.349 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:21.387 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:21.388 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:21.407 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:54:21.410 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:21.410 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:21.432 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:21.432 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:21.436 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:21.435+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:21.450 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:21.450 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:21.470 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:21.470 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:21.490 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:21.491 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:21.502 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:21.502 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:21.502 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:21.502 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:21.510 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:21.510 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:21.515 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:21.531 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:21.531 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:21.540 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:21.538+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:21.640 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:21.639+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:21.651 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:21.651 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:21.651 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:21.651 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:21.651 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:21.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:21.754 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:21.755+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:21.835 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.654980301999998, 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:54:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:54:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:54:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:54:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.640463843999996, 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:21.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:54:21.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:54:21.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.846 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.539760508000001, 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:54:21.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:54:21.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:54:21.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:54:21.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.852 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.527903094000003, 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:54:21.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:54:21.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:54:21.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:54:21.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:54:21.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:54:21.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:54:21.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:21.859 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.174713507, 2024-05-09T09:54:21.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:54:21.860 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.860 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.860 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:54:21.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:54:21.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:21.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.170782010000003, 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:54:21.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:54:21.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:54:21.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:54:21.871 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.040619800999998, 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.872 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:54:21.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:54:21.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.036670207999997, 2024-05-09T09:54:21.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.982446058000001, 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.883 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:54:21.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:54:21.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.888 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.978813940000002, 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:54:21.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.968318572999998, 2024-05-09T09:54:21.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:54:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:54:21.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:54:21.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.900 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.964485564999997, 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:21.906 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.917624011999997, 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:54:21.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:54:21.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:54:21.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.913937197999999, 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.913 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.827287093000002, 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:54:21.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:54:21.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.823429459000003, 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.924 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:54:21.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:54:21.929 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.728144518000001, 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:54:21.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:54:21.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.723703870999998, 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:54:21.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:54:21.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:54:21.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:54:21.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.713263797000003, 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:54:21.941 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.946 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.709308587999999, 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:54:21.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:54:21.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:54:21.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:21.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:21.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:54:21.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:54:21.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:21.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:21.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:21.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:54:21.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:54:21.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.953 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.954 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:21.954 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:21.954 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:21.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:21.956 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:21.954+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:22.056 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:22.054+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:22.120 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:22.120 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:22.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:22.157 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:22.154+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:22.254 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:22.254 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:22.254 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:22.255 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:22.255 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:22.258 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:22.254+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:22.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:22.359 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:22.359+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:22.389 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.215499547999997, 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:22.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:22.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:22.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.166687436999993, 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556879999999999, 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220488+0000", 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.596e-06 2024-05-09T09:54:22.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220504+0000", 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5753e-05 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220541+0000", 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999999e-05 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220559+0000", 2024-05-09T09:54:22.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7465999999999998e-05 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220704+0000", 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144754 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220947+0000", 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243386 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:22.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.221368+0000", 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420963 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.222994+0000", 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016260949999999999 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223686+0000", 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069151800000000002 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223771+0000", 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5822000000000006e-05 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223840+0000", 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8734999999999998e-05 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.127487309000003, 2024-05-09T09:54:22.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032488740000000001, 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 227 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259687+0000", 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259699+0000", 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2199e-05 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259731+0000", 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2060000000000001e-05 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259747+0000", 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5832999999999999e-05 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259923+0000", 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017627699999999999 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260168+0000", 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024482200000000001 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260592+0000", 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042451899999999999 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262409+0000", 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018164889999999999 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262778+0000", 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036952099999999999 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262863+0000", 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5121e-05 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262933+0000", 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9913000000000006e-05 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.120396837000001, 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032339780000000002, 2024-05-09T09:54:22.408 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 229 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266777+0000", 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1900000000000002e-06 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266789+0000", 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1365999999999999e-05 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266820+0000", 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1053000000000002e-05 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266838+0000", 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7963000000000001e-05 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266959+0000", 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121691 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267173+0000", 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021379999999999999 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267579+0000", 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040555300000000001 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269040+0000", 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014609549999999999 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269859+0000", 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081965300000000005 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269946+0000", 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6488000000000003e-05 2024-05-09T09:54:22.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270009+0000", 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3266e-05 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.113439635999995, 2024-05-09T09:54:22.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003225641, 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273734+0000", 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273747+0000", 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2363e-05 2024-05-09T09:54:22.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273777+0000", 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273792+0000", 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5157000000000001e-05 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273906+0000", 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011372800000000001 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274111+0000", 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000205556 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274578+0000", 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046704899999999998 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276012+0000", 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001433805 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276811+0000", 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079894299999999998 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276891+0000", 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9948000000000001e-05 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276958+0000", 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6872999999999995e-05 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:438 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.027957048000005, 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044008270000000004, 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.420 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359216+0000", 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0389999999999999e-06 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359224+0000", 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1999999999999994e-06 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359237+0000", 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2826999999999999e-05 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359243+0000", 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0129999999999999e-06 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359298+0000", 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5041999999999999e-05 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359388+0000", 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0174999999999996e-05 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359523+0000", 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135122 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.360060+0000", 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053657399999999995 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363514+0000", 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003454146 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363574+0000", 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.982e-05 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363616+0000", 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1869000000000002e-05 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.425 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:443 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.023015885999996, 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041654989999999996, 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 443 2024-05-09T09:54:22.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364157+0000", 2024-05-09T09:54:22.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2299999999999999e-07 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364163+0000", 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9059999999999999e-06 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364177+0000", 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3890000000000001e-05 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364183+0000", 2024-05-09T09:54:22.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8210000000000004e-06 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364250+0000", 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6965999999999995e-05 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364341+0000", 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0847999999999995e-05 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364524+0000", 2024-05-09T09:54:22.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182778 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.365027+0000", 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050315500000000003 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368257+0000", 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293809999999999 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368293+0000", 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6612000000000001e-05 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368321+0000", 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8218999999999999e-05 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:476 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.003137852999998, 2024-05-09T09:54:22.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030779259999999999, 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 476 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384035+0000", 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.046e-06 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384041+0000", 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6899999999999997e-06 2024-05-09T09:54:22.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384055+0000", 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4457999999999999e-05 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384062+0000", 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3709999999999996e-06 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384143+0000", 2024-05-09T09:54:22.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1678e-05 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384199+0000", 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5940999999999999e-05 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384322+0000", 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122617 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384970+0000", 2024-05-09T09:54:22.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064774299999999999 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387007+0000", 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020371009999999999 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387067+0000", 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0234e-05 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387112+0000", 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5046999999999997e-05 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.780630223000003, 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003541209, 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 736 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606544+0000", 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606556+0000", 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.185e-05 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606586+0000", 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-05-09T09:54:22.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606602+0000", 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606759+0000", 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157594 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607123+0000", 2024-05-09T09:54:22.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036346000000000002 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607703+0000", 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057985000000000003 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609215+0000", 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512071 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609797+0000", 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058224999999999998 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609969+0000", 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171767 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.610083+0000", 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114221 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.776112963999999, 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029874860000000001, 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 738 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.443 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611061+0000", 2024-05-09T09:54:22.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1739999999999999e-06 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611073+0000", 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1619e-05 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611099+0000", 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6103000000000001e-05 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611112+0000", 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-05-09T09:54:22.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611252+0000", 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014065799999999999 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611494+0000", 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000241769 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611980+0000", 2024-05-09T09:54:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000486331 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613227+0000", 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012462529999999999 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613772+0000", 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054489600000000001 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613927+0000", 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000155668 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.614046+0000", 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119065 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.699433691000003, 2024-05-09T09:54:22.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003024648, 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 772 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687740+0000", 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687753+0000", 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2587e-05 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687785+0000", 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1942e-05 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687802+0000", 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687946+0000", 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014396100000000001 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688198+0000", 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025293499999999998 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688521+0000", 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032281500000000001 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.689716+0000", 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011949160000000001 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690602+0000", 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088602799999999997 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690692+0000", 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9468000000000005e-05 2024-05-09T09:54:22.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690763+0000", 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1109e-05 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.572305579000002, 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002920887, 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.454 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 826 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814866+0000", 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814868+0000", 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.193e-06 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814880+0000", 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1907e-05 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814912+0000", 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1165999999999999e-05 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.814929+0000", 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7912999999999999e-05 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815074+0000", 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014431399999999999 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815305+0000", 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023076300000000001 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.815650+0000", 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00034591999999999999 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.816971+0000", 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001320508 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817634+0000", 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066317500000000001 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817720+0000", 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6365000000000004e-05 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.817787+0000", 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6662999999999995e-05 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.459 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.544127498999998, 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003347376, 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 838 2024-05-09T09:54:22.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843046+0000", 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9870000000000002e-06 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843059+0000", 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3123e-05 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843090+0000", 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843105+0000", 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4956e-05 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843258+0000", 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015342099999999999 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843636+0000", 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377644 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.844223+0000", 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058732299999999995 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.845580+0000", 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013567270000000001 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846218+0000", 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063835499999999996 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846313+0000", 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4475000000000006e-05 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846392+0000", 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9202000000000005e-05 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.465 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.539855617999997, 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029984809999999999, 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 840 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:22.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847318+0000", 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7230000000000001e-06 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847328+0000", 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0233e-05 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847353+0000", 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4719000000000002e-05 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847365+0000", 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2534000000000001e-05 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847493+0000", 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012747799999999999 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847627+0000", 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013396 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847937+0000", 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031040499999999998 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.848946+0000", 2024-05-09T09:54:22.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010091029999999999 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850158+0000", 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001211349 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850239+0000", 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1079000000000001e-05 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850315+0000", 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5897999999999997e-05 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.515608331000003, 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029954320000000001, 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871566+0000", 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.153e-06 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871578+0000", 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.184e-05 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871608+0000", 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0859999999999999e-05 2024-05-09T09:54:22.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871623+0000", 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4899000000000001e-05 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871760+0000", 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136685 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871990+0000", 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229559 2024-05-09T09:54:22.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.872322+0000", 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000332128 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.873500+0000", 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001178023 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874351+0000", 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085124199999999999 2024-05-09T09:54:22.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874437+0000", 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6062000000000004e-05 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874559+0000", 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121981 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.478870966999999, 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029994549999999998, 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 865 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908303+0000", 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1560000000000002e-06 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908315+0000", 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908345+0000", 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0383e-05 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908360+0000", 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5023e-05 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908507+0000", 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014646799999999999 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908728+0000", 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022162899999999999 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.909067+0000", 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000338621 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.910282+0000", 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001215156 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911147+0000", 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086497500000000003 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911229+0000", 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2472000000000006e-05 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911300+0000", 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0832000000000002e-05 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.410053943000001, 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033122170000000001, 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.482 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 895 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977120+0000", 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1100000000000001e-06 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977132+0000", 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1552999999999999e-05 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977163+0000", 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1383000000000001e-05 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977178+0000", 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4807000000000001e-05 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977331+0000", 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152967 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977700+0000", 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036903700000000001 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.978266+0000", 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056619699999999995 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.979467+0000", 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001201166 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980277+0000", 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081005900000000002 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980367+0000", 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0298999999999997e-05 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980430+0000", 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2638999999999994e-05 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.487 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.405723610999999, 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029215339999999999, 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 897 2024-05-09T09:54:22.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981448+0000", 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981450+0000", 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0099999999999998e-06 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981461+0000", 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0504e-05 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981488+0000", 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7503000000000001e-05 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981509+0000", 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0406000000000001e-05 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981602+0000", 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3828999999999999e-05 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981724+0000", 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121124 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.981998+0000", 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027401500000000001 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.982980+0000", 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00098280999999999998 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984221+0000", 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012405960000000001 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984306+0000", 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5074000000000006e-05 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.984370+0000", 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3663000000000004e-05 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:22.493 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.316661052999997, 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029823219999999999, 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 934 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:22.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070513+0000", 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070525+0000", 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-05-09T09:54:22.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070558+0000", 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2651999999999998e-05 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070580+0000", 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.194e-05 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070713+0000", 2024-05-09T09:54:22.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013299399999999999 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070937+0000", 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022408700000000001 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.071257+0000", 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032046100000000002 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.072520+0000", 2024-05-09T09:54:22.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001262448 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073338+0000", 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081789299999999998 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073425+0000", 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7127999999999997e-05 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073493+0000", 2024-05-09T09:54:22.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8355999999999994e-05 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.309969490999997, 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029267099999999999, 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:22.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 937 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077204+0000", 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.804e-06 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077215+0000", 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0576e-05 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077244+0000", 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8866000000000001e-05 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077265+0000", 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1607000000000002e-05 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077410+0000", 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014486699999999999 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077632+0000", 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022217600000000001 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077954+0000", 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321665 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.078933+0000", 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097881899999999991 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.079959+0000", 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001026676 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080047+0000", 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7114999999999995e-05 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080129+0000", 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539000000000004e-05 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:22.504 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:22.506 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:22.506 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:22.502+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:22.607 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:22.607+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:22.640 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:22.640 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:22.640 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:22.640 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:22.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:22.708 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:22.706+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:22.778 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:22.779 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:22.779 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:22.779 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:22.779 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:22.785 INFO:tasks.workunit.client.0.smithi032.stderr:Updating files: 99% (12015/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-05-09T09:54:22.793 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:22.808 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:22.807+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:22.910 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:22.906+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.840526242999999, 2024-05-09T09:54:22.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019579709000000001, 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 43 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119950+0000", 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119985+0000", 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4941999999999999e-05 2024-05-09T09:54:22.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120018+0000", 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179999999999997e-05 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120040+0000", 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2432000000000001e-05 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120194+0000", 2024-05-09T09:54:22.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015399700000000001 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120215+0000", 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0886e-05 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139214+0000", 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018999381999999999 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:22.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139526+0000", 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031177000000000001 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.758276273000007, 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787665, 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:22.968 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 211 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202200+0000", 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202215+0000", 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5656999999999999e-05 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202254+0000", 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8506e-05 2024-05-09T09:54:22.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202272+0000", 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8300000000000001e-05 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202427+0000", 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015497699999999999 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202662+0000", 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234928 2024-05-09T09:54:22.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.203104+0000", 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000442151 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.204510+0000", 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014061329999999999 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205816+0000", 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013059009999999999 2024-05-09T09:54:22.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205907+0000", 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0841000000000007e-05 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205984+0000", 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7164999999999997e-05 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.682956449000002, 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034049729999999999, 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 232 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:22.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277519+0000", 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277531+0000", 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2320000000000001e-05 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277564+0000", 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2669999999999997e-05 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277579+0000", 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5415999999999999e-05 2024-05-09T09:54:22.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277729+0000", 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014924 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277957+0000", 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022849599999999999 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.278368+0000", 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041114500000000002 2024-05-09T09:54:22.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.279935+0000", 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015665290000000001 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280758+0000", 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082300099999999996 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280850+0000", 2024-05-09T09:54:22.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1978000000000006e-05 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280921+0000", 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1527999999999997e-05 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:281 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.654628521000006, 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030930129999999999, 2024-05-09T09:54:22.979 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 281 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305847+0000", 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3300000000000001e-06 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305858+0000", 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.099e-05 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305882+0000", 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4026999999999999e-05 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305905+0000", 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3376000000000001e-05 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:22.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306060+0000", 2024-05-09T09:54:22.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154757 2024-05-09T09:54:22.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:22.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306388+0000", 2024-05-09T09:54:22.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032792699999999999 2024-05-09T09:54:22.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.307138+0000", 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074994099999999995 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308466+0000", 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013284569999999999 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308604+0000", 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137677 2024-05-09T09:54:22.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308776+0000", 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017272000000000001 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308937+0000", 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016081099999999999 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:360 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.641335205999994, 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038853109999999998, 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 360 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:22.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319140+0000", 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.057e-06 2024-05-09T09:54:22.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319151+0000", 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319180+0000", 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8578999999999999e-05 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319200+0000", 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0236000000000001e-05 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319337+0000", 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013646400000000001 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319617+0000", 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028014499999999998 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.320147+0000", 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052992600000000001 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321598+0000", 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014515820000000001 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322829+0000", 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012307959999999999 2024-05-09T09:54:22.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322925+0000", 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5494000000000004e-05 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323023+0000", 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8292e-05 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:378 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.636289258000005, 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036244110000000001, 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 378 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:22.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324187+0000", 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999999e-06 2024-05-09T09:54:22.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324203+0000", 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.609e-05 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324240+0000", 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7052999999999999e-05 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324262+0000", 2024-05-09T09:54:22.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2195999999999999e-05 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324396+0000", 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013415700000000001 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324628+0000", 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023225200000000001 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325138+0000", 2024-05-09T09:54:22.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050956299999999999 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.326372+0000", 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012345489999999999 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327556+0000", 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011832430000000001 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327701+0000", 2024-05-09T09:54:22.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014539699999999999 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327808+0000", 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106835 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.620931691999999, 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876559999999998, 2024-05-09T09:54:22.997 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 406 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339543+0000", 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2570000000000002e-06 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339553+0000", 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:22.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339576+0000", 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2857000000000002e-05 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339591+0000", 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4905e-05 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339738+0000", 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014698599999999999 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340100+0000", 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036169499999999999 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340703+0000", 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060361099999999999 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342128+0000", 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014245690000000001 2024-05-09T09:54:23.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342467+0000", 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033892500000000001 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342554+0000", 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7527000000000004e-05 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342629+0000", 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4580999999999996e-05 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:438 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'3, mlcod=30'1)", 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.600543236999997, 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036072999999999999, 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.003 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359931+0000", 2024-05-09T09:54:23.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.891e-06 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359945+0000", 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359978+0000", 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2465000000000002e-05 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359996+0000", 2024-05-09T09:54:23.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360123+0000", 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012710900000000001 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360164+0000", 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0719000000000001e-05 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363453+0000", 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003289555 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363537+0000", 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3535999999999994e-05 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:443 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'4, mlcod=30'2)", 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.595560434999996, 2024-05-09T09:54:23.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034263010000000001, 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364914+0000", 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-06 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364925+0000", 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628000000000001e-05 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364948+0000", 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3594000000000001e-05 2024-05-09T09:54:23.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364960+0000", 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2017e-05 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365077+0000", 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116706 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365114+0000", 2024-05-09T09:54:23.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6908e-05 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368217+0000", 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031027820000000001 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368339+0000", 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121989 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.564876764000005, 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028199750000000002, 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 499 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395598+0000", 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0470000000000001e-06 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395609+0000", 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1083e-05 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395631+0000", 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1953000000000001e-05 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395644+0000", 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2860000000000001e-05 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395771+0000", 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127231 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395990+0000", 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000218779 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.396428+0000", 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000437854 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.397598+0000", 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011703239999999999 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398222+0000", 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062386500000000003 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398324+0000", 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010160100000000001 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398416+0000", 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2378000000000002e-05 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.478458306999997, 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085482570000000001, 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 633 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482016+0000", 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9300000000000002e-06 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482024+0000", 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0630000000000006e-06 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482042+0000", 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7713000000000001e-05 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482053+0000", 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1246e-05 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482171+0000", 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117465 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482382+0000", 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000210719 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482853+0000", 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047157999999999998 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.485997+0000", 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031434620000000001 2024-05-09T09:54:23.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490455+0000", 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004458414 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490516+0000", 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0488000000000001e-05 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490563+0000", 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-05-09T09:54:23.022 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.408792020000007, 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787257, 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.023 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 709 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551683+0000", 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4059999999999999e-06 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551696+0000", 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551725+0000", 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8890999999999998e-05 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551743+0000", 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7878999999999999e-05 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551889+0000", 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014628199999999999 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552237+0000", 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034787300000000001 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552746+0000", 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050886300000000002 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.554142+0000", 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013964120000000001 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555320+0000", 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001177974 2024-05-09T09:54:23.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555400+0000", 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9468000000000006e-05 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555468+0000", 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8511999999999997e-05 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.028 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.370948114000001, 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028728, 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 727 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589527+0000", 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356e-06 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589538+0000", 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1463e-05 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589571+0000", 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589592+0000", 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1219000000000001e-05 2024-05-09T09:54:23.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589739+0000", 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147424 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590004+0000", 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264632 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590346+0000", 2024-05-09T09:54:23.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034226299999999999 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592098+0000", 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001752116 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592249+0000", 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015033000000000001 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592335+0000", 2024-05-09T09:54:23.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5890999999999995e-05 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592397+0000", 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2966000000000007e-05 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.367181998999996, 2024-05-09T09:54:23.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031054329999999999, 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 729 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593292+0000", 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.344e-06 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593300+0000", 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5229999999999998e-06 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593321+0000", 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1299999999999999e-05 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593339+0000", 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8206000000000002e-05 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593428+0000", 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8928e-05 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593547+0000", 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118794 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593824+0000", 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027681500000000003 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.595408+0000", 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001584086 2024-05-09T09:54:23.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596242+0000", 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083392999999999998 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596333+0000", 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0878000000000006e-05 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596396+0000", 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3628999999999997e-05 2024-05-09T09:54:23.039 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.265401249000007, 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031859179999999998, 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.040 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 775 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695074+0000", 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.723e-06 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695086+0000", 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1457000000000001e-05 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695117+0000", 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1343000000000001e-05 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695138+0000", 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0622999999999999e-05 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695261+0000", 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123621 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695596+0000", 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033511000000000001 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.696142+0000", 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054512500000000004 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.697459+0000", 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013177480000000001 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698089+0000", 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063017800000000001 2024-05-09T09:54:23.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698179+0000", 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9511000000000004e-05 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698257+0000", 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8479000000000005e-05 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.045 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.174630038000004, 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002852074, 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 814 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785845+0000", 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785856+0000", 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1323e-05 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785887+0000", 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0602999999999998e-05 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785901+0000", 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4612e-05 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786031+0000", 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012920100000000001 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786246+0000", 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021583299999999999 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786562+0000", 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031516999999999998 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.787822+0000", 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001260359 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788501+0000", 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067859300000000001 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788589+0000", 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7961999999999996e-05 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788695+0000", 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106258 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.017409291999996, 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029203889999999998, 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 880 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943067+0000", 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1870000000000001e-06 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943079+0000", 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2319e-05 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943111+0000", 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1779999999999997e-05 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943126+0000", 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285999999999999e-05 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943239+0000", 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112631 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943472+0000", 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023326299999999999 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943790+0000", 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031812600000000001 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.944926+0000", 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011362519999999999 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945815+0000", 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088909199999999996 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945906+0000", 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0997999999999998e-05 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945984+0000", 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7454999999999996e-05 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.010184667999994, 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028357909999999998, 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 883 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950290+0000", 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3e-06 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950303+0000", 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.261e-05 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950334+0000", 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950354+0000", 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9865999999999999e-05 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950487+0000", 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950710+0000", 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223002 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.951056+0000", 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034612999999999999 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952129+0000", 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010729820000000001 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952975+0000", 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00084584999999999999 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953059+0000", 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4371999999999998e-05 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953124+0000", 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4412000000000006e-05 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.062 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.940481863000002, 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028784679999999999, 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 913 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019993+0000", 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3769999999999999e-06 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020005+0000", 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1797000000000001e-05 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020036+0000", 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0876000000000001e-05 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020051+0000", 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4739000000000001e-05 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020163+0000", 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112432 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020385+0000", 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022189200000000001 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020709+0000", 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032386699999999998 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.021761+0000", 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051979 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022727+0000", 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096616099999999999 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022805+0000", 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8009000000000005e-05 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022869+0000", 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4338999999999995e-05 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 63.903527416999999, 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00285995, 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 928 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:23.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056947+0000", 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.81e-06 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056957+0000", 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5829999999999996e-06 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056980+0000", 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3278999999999999e-05 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056992+0000", 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2437e-05 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057171+0000", 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017842199999999999 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057393+0000", 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022195 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057705+0000", 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000311687 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.058914+0000", 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012093029999999999 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059652+0000", 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073784800000000004 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059738+0000", 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6231999999999997e-05 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059805+0000", 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7398999999999996e-05 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.074 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.074 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:23.075 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:23.075 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:23.074+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:23.176 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:23.174+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:23.246 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:23.246 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:23.246 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:23.246 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:23.260 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:23.303 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:23.302+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:23.378 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:23.379+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:23.427 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:23.427 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:23.427 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:23.427 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:23.427 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:23.430 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:54:23.441 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:23.487 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:23.486+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:23.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:23.562 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:23.562 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.163802+0000", 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.396172985000007, 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037921919999999998, 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 205 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163802+0000", 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163802+0000", 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163806+0000", 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.05e-06 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163822+0000", 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6693000000000001e-05 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163856+0000", 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4199000000000002e-05 2024-05-09T09:54:23.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.163875+0000", 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9037000000000001e-05 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.164016+0000", 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014050400000000001 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.164281+0000", 2024-05-09T09:54:23.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000265235 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.164708+0000", 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042678799999999999 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.166381+0000", 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00167341 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.167431+0000", 2024-05-09T09:54:23.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010500100000000001 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.167523+0000", 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1393999999999999e-05 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.167595+0000", 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1872000000000006e-05 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:208 6.4 e30/24 6:2166d8e1:gc::gc.3:head v 30'3, mlcod=27'1)", 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.187937+0000", 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.372038094000004, 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034467550000000001, 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187937+0000", 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187937+0000", 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187939+0000", 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4130000000000001e-06 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187949+0000", 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0703000000000001e-05 2024-05-09T09:54:23.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.187990+0000", 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0105999999999999e-05 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.188009+0000", 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9585999999999998e-05 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.188283+0000", 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027405499999999999 2024-05-09T09:54:23.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.188337+0000", 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3538999999999997e-05 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.191305+0000", 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029679849999999998 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.191384+0000", 2024-05-09T09:54:23.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9368000000000003e-05 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.234399+0000", 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.3255762, 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003636285, 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 220 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234399+0000", 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234399+0000", 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234402+0000", 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3860000000000001e-06 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234412+0000", 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0553999999999999e-05 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234439+0000", 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7146000000000001e-05 2024-05-09T09:54:23.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234459+0000", 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9989000000000001e-05 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234619+0000", 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015993100000000001 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.234823+0000", 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000204129 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.235206+0000", 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00038309200000000002 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.236598+0000", 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013912830000000001 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.237892+0000", 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012940740000000001 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.237972+0000", 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0025999999999996e-05 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.238036+0000", 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3675000000000003e-05 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.578 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.252580+0000", 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.307395831999997, 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035035700000000001, 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 225 2024-05-09T09:54:23.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252580+0000", 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252580+0000", 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252581+0000", 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.64e-06 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252589+0000", 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8699999999999992e-06 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252614+0000", 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4383e-05 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252632+0000", 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8726e-05 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252783+0000", 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015036100000000001 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.252994+0000", 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021187199999999999 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.253408+0000", 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041345500000000002 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.254766+0000", 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001357586 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.255932+0000", 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011661499999999999 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256020+0000", 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8225000000000003e-05 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256083+0000", 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3301999999999998e-05 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.584 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.256491+0000", 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.303484646000001, 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003134305, 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 226 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256491+0000", 2024-05-09T09:54:23.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256491+0000", 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256492+0000", 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6729999999999999e-06 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256501+0000", 2024-05-09T09:54:23.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5769999999999994e-06 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256526+0000", 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4788999999999999e-05 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256544+0000", 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8110000000000001e-05 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256681+0000", 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013663999999999999 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.256912+0000", 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023169299999999999 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.257331+0000", 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000418315 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.259053+0000", 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0017228320000000001 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.259480+0000", 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042617499999999999 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.259562+0000", 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2582000000000003e-05 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.259625+0000", 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2918999999999998e-05 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.591 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.591 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.285517+0000", 2024-05-09T09:54:23.591 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.274458847999995, 2024-05-09T09:54:23.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034583679999999999, 2024-05-09T09:54:23.591 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 234 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285517+0000", 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285517+0000", 2024-05-09T09:54:23.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285519+0000", 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4030000000000001e-06 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285531+0000", 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1497e-05 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285562+0000", 2024-05-09T09:54:23.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1439000000000002e-05 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285577+0000", 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4589999999999999e-05 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285761+0000", 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018437600000000001 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.285980+0000", 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021893600000000001 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.286400+0000", 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041973500000000002 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.287812+0000", 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001412155 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.288820+0000", 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010084339999999999 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.288907+0000", 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7242000000000003e-05 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.288975+0000", 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7560999999999999e-05 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:371 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.321253+0000", 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.238722921999994, 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034533379999999998, 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 371 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321253+0000", 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321253+0000", 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321255+0000", 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4430000000000002e-06 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321282+0000", 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6806000000000001e-05 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321317+0000", 2024-05-09T09:54:23.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5666e-05 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321365+0000", 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7411999999999999e-05 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321490+0000", 2024-05-09T09:54:23.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012506799999999999 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321752+0000", 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026243499999999999 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322120+0000", 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000367532 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323435+0000", 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001314768 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324483+0000", 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001048149 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324625+0000", 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014206700000000001 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324706+0000", 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0992e-05 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:427 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.350781+0000", 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.209194917000005, 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034929649999999998, 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.604 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 427 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350781+0000", 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350781+0000", 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350782+0000", 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.237e-06 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350788+0000", 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7050000000000002e-06 2024-05-09T09:54:23.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350802+0000", 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.382e-05 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350811+0000", 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6859999999999995e-06 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.350908+0000", 2024-05-09T09:54:23.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7198e-05 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351125+0000", 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000216407 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.351473+0000", 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034830700000000001 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353992+0000", 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025194570000000001 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.354144+0000", 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015172800000000001 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.354220+0000", 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5456000000000004e-05 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.354274+0000", 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3964e-05 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:431 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.353395+0000", 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.206580160000001, 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041234790000000002, 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.610 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 431 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353395+0000", 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353395+0000", 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353397+0000", 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5400000000000001e-06 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353404+0000", 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4109999999999999e-06 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353422+0000", 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199999999999999e-05 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353432+0000", 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0569999999999999e-06 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353654+0000", 2024-05-09T09:54:23.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022289400000000001 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.353874+0000", 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021933200000000001 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.354358+0000", 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048414399999999999 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355441+0000", 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00108307 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357365+0000", 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001923721 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357454+0000", 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9438000000000007e-05 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357519+0000", 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4671999999999993e-05 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:434 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.355034+0000", 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.204941109000004, 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043073540000000002, 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 434 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355034+0000", 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355034+0000", 2024-05-09T09:54:23.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355036+0000", 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.751e-06 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355046+0000", 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7229999999999999e-06 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355067+0000", 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1619000000000001e-05 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355083+0000", 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5696999999999999e-05 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355184+0000", 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100649 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355287+0000", 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103361 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.355587+0000", 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00029994599999999999 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.357862+0000", 2024-05-09T09:54:23.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022752380000000002 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359117+0000", 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001254935 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359240+0000", 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012276 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359342+0000", 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101675 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:437 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.201471521000002, 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056446969999999997, 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.622 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 437 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:54:23.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358506+0000", 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7060000000000001e-06 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358516+0000", 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8600000000000005e-06 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358536+0000", 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0231e-05 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358552+0000", 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6141999999999999e-05 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359405+0000", 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085275200000000002 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359539+0000", 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426000000000001 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359975+0000", 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043652300000000002 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363582+0000", 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036068459999999999 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364013+0000", 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043084500000000001 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364091+0000", 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7816000000000002e-05 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364149+0000", 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7716000000000001e-05 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:440 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.198392467999994, 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073055910000000002, 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 440 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.628 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361584+0000", 2024-05-09T09:54:23.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.486e-06 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361591+0000", 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9829999999999999e-06 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361611+0000", 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9925e-05 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361622+0000", 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0297e-05 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361730+0000", 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010856100000000001 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361848+0000", 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117909 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362099+0000", 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025122099999999999 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368320+0000", 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062206800000000001 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368752+0000", 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431629 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368831+0000", 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9369999999999994e-05 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368889+0000", 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.753e-05 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:447 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.633 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.367049+0000", 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.192926671999999, 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047844200000000002, 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 447 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367049+0000", 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367049+0000", 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367055+0000", 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9109999999999998e-06 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367062+0000", 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4460000000000004e-06 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367081+0000", 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8371000000000001e-05 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367091+0000", 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9879999999999999e-06 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367164+0000", 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3900999999999996e-05 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367278+0000", 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113435 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.367546+0000", 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026797099999999999 2024-05-09T09:54:23.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371044+0000", 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034983150000000001 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371696+0000", 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00065214199999999998 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371771+0000", 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4935e-05 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.371833+0000", 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2005e-05 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:633 6.1a e30/24 6:5ae4284b:::obj_delete_at_hint.0000000032:head v 30'7, mlcod=30'5)", 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 65.076898697000004, 2024-05-09T09:54:23.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007079526, 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483078+0000", 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.703e-06 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483093+0000", 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4589999999999999e-05 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483120+0000", 2024-05-09T09:54:23.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7172999999999999e-05 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483134+0000", 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3559e-05 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483241+0000", 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010755399999999999 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483272+0000", 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0933999999999999e-05 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490066+0000", 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067936860000000002 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490156+0000", 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0327000000000004e-05 2024-05-09T09:54:23.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.665298+0000", 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.894677682999998, 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003752816, 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 763 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665298+0000", 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665298+0000", 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665300+0000", 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2299999999999998e-06 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665311+0000", 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1269e-05 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665343+0000", 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1683000000000001e-05 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665357+0000", 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4493e-05 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665531+0000", 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017319300000000001 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.665754+0000", 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022297300000000001 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.666064+0000", 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031020400000000001 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.667915+0000", 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001851103 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.668895+0000", 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00098046099999999996 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.668986+0000", 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0988000000000004e-05 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.669051+0000", 2024-05-09T09:54:23.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.810979+0000", 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.748996840000004, 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003764543, 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.650 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 825 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.810979+0000", 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.810979+0000", 2024-05-09T09:54:23.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.810980+0000", 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2899999999999999e-06 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.810986+0000", 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5300000000000002e-06 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811005+0000", 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8335999999999999e-05 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811015+0000", 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7839999999999998e-06 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811128+0000", 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113854 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811346+0000", 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021784500000000001 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.811825+0000", 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047905099999999998 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.813506+0000", 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016806869999999999 2024-05-09T09:54:23.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.814591+0000", 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010850359999999999 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.814668+0000", 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6551000000000006e-05 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.814743+0000", 2024-05-09T09:54:23.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5579000000000003e-05 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.835394+0000", 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.724581568000005, 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034723390000000001, 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.656 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 835 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835394+0000", 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835394+0000", 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835396+0000", 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2699999999999999e-06 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835408+0000", 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1447000000000001e-05 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835438+0000", 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0559000000000003e-05 2024-05-09T09:54:23.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835453+0000", 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4466e-05 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835604+0000", 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151404 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.835975+0000", 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037109000000000003 2024-05-09T09:54:23.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.836525+0000", 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00055013900000000005 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.837875+0000", 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013496339999999999 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.838595+0000", 2024-05-09T09:54:23.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00072041900000000003 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.838753+0000", 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015748300000000001 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.838866+0000", 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113428 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.885564+0000", 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.674411304000003, 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033792380000000001, 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 856 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.662 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885564+0000", 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885564+0000", 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885567+0000", 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4140000000000001e-06 2024-05-09T09:54:23.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885580+0000", 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3295999999999999e-05 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885612+0000", 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1973e-05 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885627+0000", 2024-05-09T09:54:23.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4776e-05 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.885783+0000", 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015667099999999999 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.886144+0000", 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000360949 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.886718+0000", 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00057373899999999998 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.888008+0000", 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001289838 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.888720+0000", 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00071207599999999996 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.888826+0000", 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106591 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.888943+0000", 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116915 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.667 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.041331+0000", 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.518644128000005, 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003291642, 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 922 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041331+0000", 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041331+0000", 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041334+0000", 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6199999999999999e-06 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041346+0000", 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2113000000000001e-05 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041378+0000", 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1508999999999999e-05 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041392+0000", 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4446e-05 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041545+0000", 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015279099999999999 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.041896+0000", 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00035107299999999998 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.042437+0000", 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054111299999999997 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.043623+0000", 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001186133 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.044355+0000", 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073215499999999996 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.044506+0000", 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015090700000000001 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.044623+0000", 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011678199999999999 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.046089+0000", 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 64.513886651999997, 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033164150000000001, 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:23.673 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 924 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046089+0000", 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046089+0000", 2024-05-09T09:54:23.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046091+0000", 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.323e-06 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046103+0000", 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1634000000000001e-05 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:23.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046136+0000", 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3225000000000001e-05 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046155+0000", 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.88e-05 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046277+0000", 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000122028 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:23.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046498+0000", 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022132200000000001 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.046952+0000", 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045405800000000002 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.048286+0000", 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013334239999999999 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.049137+0000", 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085153300000000002 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.049292+0000", 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154427 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.049405+0000", 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011364100000000001 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.678 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.679 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:23.679 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:23.679 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:23.680 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:23.681 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:23.679+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:23.697 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:23.697 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:23.713 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:23.713 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:23.729 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:23.730 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:23.746 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:23.746 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr:Note: switching to '2d4f3997312aba36846da54fe4ed144c644dd8fc'. 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr: git switch -c 2024-05-09T09:54:23.763 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-09T09:54:23.764 INFO:tasks.workunit.client.0.smithi032.stderr:Or undo this operation with: 2024-05-09T09:54:23.764 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-09T09:54:23.764 INFO:tasks.workunit.client.0.smithi032.stderr: git switch - 2024-05-09T09:54:23.764 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-09T09:54:23.764 INFO:tasks.workunit.client.0.smithi032.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T09:54:23.764 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-05-09T09:54:23.764 INFO:tasks.workunit.client.0.smithi032.stderr:HEAD is now at 2d4f3997312 Adds (shared) libs: rgw_sal_rados (librgw_sal_rados) rados plugin rgw_sal_d3n (librgw_sal_d3n) d3n plugin rgw_sal_motr (librgw_sal_motr) motr plugin rgw_sal_daos (librgw_sal_daos) daos plugin rgw_sal_dbstore (librgw_sal_dbstore) dbstore plugin rados_sal library (librados_sal), below the line shlib for rgw_sal_rados and rgw_sal_d3n 2024-05-09T09:54:23.765 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:23.765 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:23.771 DEBUG:teuthology.orchestra.run.smithi032:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T09:54:23.783 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:23.783 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:23.783 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:23.783+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:23.787 INFO:tasks.workunit.client.0.smithi032.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T09:54:23.789 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T09:54:23.789 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T09:54:23.802 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:23.803 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:23.821 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:23.822 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:23.851 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:23.851 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:23.865 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:23.911 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:23.910+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:23.984 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:23.983+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:23.987 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:23.988 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:24.002 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:24.085 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:24.083+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:24.170 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:24.171 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:24.186 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:24.187 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:24.187+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:24.288 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:24.286+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:24.311 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:24.311 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:24.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:24.389 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:24.387+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:24.411 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:54:24.489 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:24.487+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:24.495 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:24.495 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:24.510 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:24.590 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:24.586+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:24.628 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:24.628 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:24.642 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:24.644 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T09:54:24.693 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:24.690+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:24.723 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T09:54:24.768 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:24.769 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:24.769 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T09:54:24.770 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T09:54:24.770 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T09:54:24.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:24.793 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:24.790+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:24.813 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T09:54:24.816 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-05-09T09:54:24.816 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T09:54:24.866 INFO:tasks.workunit:Running workunits matching rgw/s3_multipart_upload.pl on client.0... 2024-05-09T09:54:24.867 INFO:tasks.workunit:Running workunit rgw/s3_multipart_upload.pl... 2024-05-09T09:54:24.867 DEBUG:teuthology.orchestra.run.smithi032:workunit test rgw/s3_multipart_upload.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d4f3997312aba36846da54fe4ed144c644dd8fc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_multipart_upload.pl 2024-05-09T09:54:24.893 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:24.893 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:24.895 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:24.894+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:24.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:24.996 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:24.994+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:25.064 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:25.064 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:25.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:25.122 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:25.123+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:25.196 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:25.196 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:25.197 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:25.195+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:25.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:25.298 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:25.299+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:25.376 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:25.376 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:25.389 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:25.399 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:25.398+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:25.500 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:25.499+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:25.519 INFO:tasks.workunit.client.0.smithi032.stdout:Bucket Created: buck_2024_04_9_09_54_25 2024-05-09T09:54:25.519 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 1 2024-05-09T09:54:25.553 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:25.553 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:25.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:25.591 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:25.591 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:25.591 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.070536 s, 1.5 GB/s 2024-05-09T09:54:25.601 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:25.598+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:25.702 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:25.703+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:25.715 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:25.715 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:25.729 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:25.803 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:25.802+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:25.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:25.904 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:25.903+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:25.926 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:25.927 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:25.947 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:26.005 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:26.002+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:26.044 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:26.044 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:26.075 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:26.076 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:26.092 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:26.093 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:26.106 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:26.102+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:26.108 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:26.108 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:26.130 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.130 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 74.951696339999998, 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033515720000000001, 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.131 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177996+0000", 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.177998+0000", 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178011+0000", 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2893e-05 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178044+0000", 2024-05-09T09:54:26.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3296000000000001e-05 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178060+0000", 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5328999999999998e-05 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178140+0000", 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9793e-05 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178256+0000", 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011652800000000001 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.178378+0000", 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012196700000000001 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.179558+0000", 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001179542 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181129+0000", 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015709020000000001 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181226+0000", 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7448000000000006e-05 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.181347+0000", 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121354 2024-05-09T09:54:26.136 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:53 7.e 7:7759931f:::notify.3:head [watch watch cookie 94540191543312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.937179881999995, 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024888850000000001, 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.137 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 53 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192512+0000", 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192514+0000", 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5e-06 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192523+0000", 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1139999999999995e-06 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192544+0000", 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1605999999999999e-05 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192555+0000", 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0370999999999999e-05 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192623+0000", 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8361999999999994e-05 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192696+0000", 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2657000000000006e-05 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.192826+0000", 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130452 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.193511+0000", 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068468100000000003 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194675+0000", 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011641589999999999 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.194812+0000", 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137226 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:15.195001+0000", 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018875700000000001 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:26.142 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.836476546, 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031466670000000001, 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293216+0000", 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293218+0000", 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4729999999999999e-06 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293231+0000", 2024-05-09T09:54:26.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293263+0000", 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293278+0000", 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5622000000000001e-05 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293415+0000", 2024-05-09T09:54:26.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013639500000000001 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.293620+0000", 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020557999999999999 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.294040+0000", 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041986600000000002 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.295593+0000", 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0015532339999999999 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296205+0000", 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061175599999999998 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296291+0000", 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6155000000000004e-05 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.296362+0000", 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0876000000000004e-05 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.824619131999995, 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026795909999999998, 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.148 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 279 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305073+0000", 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305074+0000", 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.540000000000001e-07 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305080+0000", 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1449999999999996e-06 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305098+0000", 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8173999999999999e-05 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305108+0000", 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5009999999999993e-06 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305167+0000", 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8808999999999999e-05 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305252+0000", 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5507999999999995e-05 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.305428+0000", 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017611699999999999 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.306018+0000", 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058978000000000004 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307660+0000", 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00164179 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307717+0000", 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.307753+0000", 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:26.154 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.471429545000007, 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029004539999999998, 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 760 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658263+0000", 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658265+0000", 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.057e-06 2024-05-09T09:54:26.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658276+0000", 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0977e-05 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658307+0000", 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1118999999999998e-05 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658322+0000", 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5063e-05 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658502+0000", 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018059 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.658718+0000", 2024-05-09T09:54:26.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021575300000000001 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.659070+0000", 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035228400000000002 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.660205+0000", 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001135088 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661012+0000", 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080654200000000004 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661095+0000", 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3388999999999997e-05 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.661163+0000", 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7591999999999999e-05 2024-05-09T09:54:26.160 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.467498047999996, 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026020409999999998, 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.161 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 762 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662194+0000", 2024-05-09T09:54:26.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662196+0000", 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.883e-06 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662206+0000", 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0506000000000001e-05 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662238+0000", 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1155999999999998e-05 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662255+0000", 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7784000000000001e-05 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662350+0000", 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4924000000000001e-05 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662478+0000", 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127992 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.662753+0000", 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027508799999999999 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.663778+0000", 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010248729999999999 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664584+0000", 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00080591300000000001 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664669+0000", 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5271000000000004e-05 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.664796+0000", 2024-05-09T09:54:26.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000126651 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.337335839000005, 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029373630000000001, 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 817 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792356+0000", 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792359+0000", 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792372+0000", 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.344e-05 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792403+0000", 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1269999999999997e-05 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792419+0000", 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5478999999999999e-05 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792568+0000", 2024-05-09T09:54:26.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149584 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.792791+0000", 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022229300000000001 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.793163+0000", 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000372197 2024-05-09T09:54:26.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.794448+0000", 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001284985 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795091+0000", 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064284900000000002 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795176+0000", 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5354999999999998e-05 2024-05-09T09:54:26.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.795294+0000", 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011759100000000001 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.174 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.333386246000003, 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027621120000000002, 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 819 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796306+0000", 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796308+0000", 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8199999999999999e-06 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796318+0000", 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0052e-05 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796344+0000", 2024-05-09T09:54:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6403000000000001e-05 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796357+0000", 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.257e-05 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796470+0000", 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113408 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796602+0000", 2024-05-09T09:54:26.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131815 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.796887+0000", 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028487500000000003 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.797904+0000", 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010167349999999999 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798869+0000", 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096535800000000004 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.798953+0000", 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3848000000000001e-05 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.799068+0000", 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115228 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.279162095999993, 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002720377, 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 841 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850530+0000", 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850532+0000", 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850555+0000", 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3139999999999999e-05 2024-05-09T09:54:26.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850587+0000", 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1983000000000002e-05 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850604+0000", 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7159e-05 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850717+0000", 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112781 2024-05-09T09:54:26.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850932+0000", 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214904 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.851253+0000", 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032118099999999997 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.852337+0000", 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001083681 2024-05-09T09:54:26.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853048+0000", 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00071104399999999998 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853136+0000", 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7503000000000006e-05 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.853250+0000", 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011484099999999999 2024-05-09T09:54:26.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.275529977999994, 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023783189999999998, 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.187 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 843 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854162+0000", 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854164+0000", 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6959999999999999e-06 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854173+0000", 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4939999999999992e-06 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854198+0000", 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4958999999999999e-05 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854210+0000", 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2123000000000001e-05 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854307+0000", 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6759e-05 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854442+0000", 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134797 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.854712+0000", 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000269673 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.855665+0000", 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095350000000000003 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856391+0000", 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072566700000000004 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856476+0000", 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5432000000000005e-05 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.856540+0000", 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4219000000000003e-05 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.192 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.265034611000004, 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028868499999999998, 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 847 2024-05-09T09:54:26.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864657+0000", 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864660+0000", 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1169999999999998e-06 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864671+0000", 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1503e-05 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864703+0000", 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864718+0000", 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5400000000000002e-05 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.864828+0000", 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110095 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865036+0000", 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020765599999999999 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.865341+0000", 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030457500000000002 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.866648+0000", 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013069379999999999 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867338+0000", 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069031400000000003 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867424+0000", 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5629000000000003e-05 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.867544+0000", 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012073700000000001 2024-05-09T09:54:26.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.261201603000004, 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028401569999999998, 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 849 2024-05-09T09:54:26.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868491+0000", 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868492+0000", 2024-05-09T09:54:26.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.703e-06 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868501+0000", 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0869999999999996e-06 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868524+0000", 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2909e-05 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868536+0000", 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1803e-05 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868644+0000", 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107722 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.868769+0000", 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125377 2024-05-09T09:54:26.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.869048+0000", 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027873200000000001 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.870112+0000", 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010642150000000001 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871128+0000", 2024-05-09T09:54:26.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001015567 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871214+0000", 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6438000000000001e-05 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871331+0000", 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116604 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.214340050000004, 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026876840000000001, 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 868 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915352+0000", 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915354+0000", 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0770000000000002e-06 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915366+0000", 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1756999999999999e-05 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915395+0000", 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9322000000000001e-05 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915414+0000", 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915531+0000", 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117192 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.915747+0000", 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215799 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.916062+0000", 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031545800000000001 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917310+0000", 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012477359999999999 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917829+0000", 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051891800000000005 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.917915+0000", 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6524e-05 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.918040+0000", 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012445800000000001 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:26.210 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.210653235999999, 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026646109999999999, 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 870 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:26.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919039+0000", 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919041+0000", 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.81e-06 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919051+0000", 2024-05-09T09:54:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919083+0000", 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1362999999999998e-05 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919103+0000", 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0245999999999999e-05 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919211+0000", 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108342 2024-05-09T09:54:26.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919339+0000", 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012744399999999999 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.919612+0000", 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027361200000000001 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.920723+0000", 2024-05-09T09:54:26.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001110448 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921494+0000", 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077099299999999998 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921582+0000", 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8712e-05 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.921703+0000", 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121098 2024-05-09T09:54:26.215 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.124003130999995, 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002880461, 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.216 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 907 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005689+0000", 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005691+0000", 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2529999999999999e-06 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005704+0000", 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2310000000000001e-05 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005735+0000", 2024-05-09T09:54:26.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1526000000000003e-05 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005750+0000", 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.005886+0000", 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135957 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006119+0000", 2024-05-09T09:54:26.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0002329 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.006459+0000", 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000339537 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.007793+0000", 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001334387 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008416+0000", 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062320599999999996 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008503+0000", 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6751999999999999e-05 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.008569+0000", 2024-05-09T09:54:26.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6526000000000006e-05 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.120145496999996, 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028443510000000002, 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.222 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 909 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009547+0000", 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009548+0000", 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7799999999999999e-06 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009562+0000", 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3416e-05 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009593+0000", 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1099999999999997e-05 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009613+0000", 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9680000000000001e-05 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009730+0000", 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011721400000000001 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.009866+0000", 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013664699999999999 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.010140+0000", 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027330900000000001 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.011195+0000", 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010549890000000001 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012239+0000", 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010440289999999999 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012325+0000", 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6180999999999994e-05 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.012391+0000", 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6006000000000005e-05 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.227 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.024860555999993, 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031830019999999999, 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 949 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.228 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104832+0000", 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104834+0000", 2024-05-09T09:54:26.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2960000000000001e-06 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104846+0000", 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2147000000000001e-05 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104879+0000", 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2589000000000003e-05 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.104895+0000", 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6005999999999999e-05 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105013+0000", 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118792 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105237+0000", 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000223179 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.105559+0000", 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032286499999999998 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.106743+0000", 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00118345 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107801+0000", 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010579210000000001 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.107891+0000", 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9876000000000005e-05 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.108015+0000", 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123881 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.233 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.020419908999997, 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030565480000000001, 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 951 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109272+0000", 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109274+0000", 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8530000000000001e-06 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109285+0000", 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0720000000000001e-05 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109316+0000", 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0923000000000002e-05 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109333+0000", 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6869000000000001e-05 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109464+0000", 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000131042 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.109697+0000", 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023341900000000001 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.110194+0000", 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049715399999999998 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.111325+0000", 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011306980000000001 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112116+0000", 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079122299999999997 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112205+0000", 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9215000000000006e-05 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.112329+0000", 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012343200000000001 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.009979834999996, 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029928989999999998, 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.239 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 955 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119712+0000", 2024-05-09T09:54:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119714+0000", 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0870000000000001e-06 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119726+0000", 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1623e-05 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119755+0000", 2024-05-09T09:54:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8819e-05 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119770+0000", 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.508e-05 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.119879+0000", 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109181 2024-05-09T09:54:26.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120116+0000", 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023681599999999999 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.120550+0000", 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043399600000000002 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.121922+0000", 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013721829999999999 2024-05-09T09:54:26.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122551+0000", 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062889900000000004 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122636+0000", 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4555999999999995e-05 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.122705+0000", 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9659000000000005e-05 2024-05-09T09:54:26.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.006024625999999, 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030221419999999998, 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.245 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 957 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123667+0000", 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123669+0000", 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7630000000000001e-06 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123680+0000", 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-05 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123710+0000", 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0565999999999998e-05 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123731+0000", 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0910000000000001e-05 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123826+0000", 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4817999999999999e-05 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.123959+0000", 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013323100000000001 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.124322+0000", 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000363097 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.125662+0000", 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013395670000000001 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126540+0000", 2024-05-09T09:54:26.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087770899999999995 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126627+0000", 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7255000000000004e-05 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.126690+0000", 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2656000000000005e-05 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.251 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.251 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.251 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:26.252 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:26.252 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:26.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:26.253 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:26.254 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:26.254 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.1 2024-05-09T09:54:26.254 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:26.254 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 2 2024-05-09T09:54:26.254 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:26.255 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:26.255 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:26.257 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:26.257 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:26.258 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:26.258 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0663352 s, 1.6 GB/s 2024-05-09T09:54:26.258 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:26.251+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:26.353 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:26.351+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:26.409 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:26.409 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:26.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:26.439 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:54:26.454 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:26.454+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:26.555 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:26.555+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:26.612 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:26.612 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:26.612 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:26.612 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:26.612 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:26.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:26.656 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:26.654+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:26.757 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:26.754+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:26.772 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.2 2024-05-09T09:54:26.772 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:26.772 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 3 2024-05-09T09:54:26.809 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.636099764999997, 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.587287653999994, 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033556879999999999, 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220484+0000", 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220488+0000", 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.596e-06 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220504+0000", 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5753e-05 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220541+0000", 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7599999999999999e-05 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220559+0000", 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7465999999999998e-05 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220704+0000", 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144754 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.220947+0000", 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243386 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.221368+0000", 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420963 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.222994+0000", 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016260949999999999 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223686+0000", 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069151800000000002 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223771+0000", 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5822000000000006e-05 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.223840+0000", 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8734999999999998e-05 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.548087526000003, 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032488740000000001, 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 227 2024-05-09T09:54:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259685+0000", 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259687+0000", 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.12e-06 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259699+0000", 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2199e-05 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259731+0000", 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2060000000000001e-05 2024-05-09T09:54:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259747+0000", 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5832999999999999e-05 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.259923+0000", 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017627699999999999 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260168+0000", 2024-05-09T09:54:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024482200000000001 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.260592+0000", 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042451899999999999 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262409+0000", 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018164889999999999 2024-05-09T09:54:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262778+0000", 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036952099999999999 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262863+0000", 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5121e-05 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.262933+0000", 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9913000000000006e-05 2024-05-09T09:54:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.540997054000002, 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032339780000000002, 2024-05-09T09:54:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 229 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266775+0000", 2024-05-09T09:54:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266777+0000", 2024-05-09T09:54:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1900000000000002e-06 2024-05-09T09:54:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266789+0000", 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1365999999999999e-05 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266820+0000", 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1053000000000002e-05 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266838+0000", 2024-05-09T09:54:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7963000000000001e-05 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.266959+0000", 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121691 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267173+0000", 2024-05-09T09:54:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021379999999999999 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.267579+0000", 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040555300000000001 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269040+0000", 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014609549999999999 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269859+0000", 2024-05-09T09:54:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081965300000000005 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.269946+0000", 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6488000000000003e-05 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.270009+0000", 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3266e-05 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.534039852999996, 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003225641, 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273732+0000", 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273734+0000", 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-05-09T09:54:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273747+0000", 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2363e-05 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273777+0000", 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273792+0000", 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5157000000000001e-05 2024-05-09T09:54:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.273906+0000", 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011372800000000001 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274111+0000", 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000205556 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.274578+0000", 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046704899999999998 2024-05-09T09:54:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276012+0000", 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001433805 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276811+0000", 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00079894299999999998 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276891+0000", 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9948000000000001e-05 2024-05-09T09:54:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.276958+0000", 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6872999999999995e-05 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:438 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.448557265000005, 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044008270000000004, 2024-05-09T09:54:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 438 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359215+0000", 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359216+0000", 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0389999999999999e-06 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359224+0000", 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1999999999999994e-06 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359237+0000", 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2826999999999999e-05 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359243+0000", 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0129999999999999e-06 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359298+0000", 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5041999999999999e-05 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359388+0000", 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0174999999999996e-05 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.359523+0000", 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135122 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.360060+0000", 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053657399999999995 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363514+0000", 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003454146 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363574+0000", 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.982e-05 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.363616+0000", 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1869000000000002e-05 2024-05-09T09:54:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:443 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.443616102999997, 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041654989999999996, 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 443 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364156+0000", 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364157+0000", 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2299999999999999e-07 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364163+0000", 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9059999999999999e-06 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364177+0000", 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3890000000000001e-05 2024-05-09T09:54:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364183+0000", 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8210000000000004e-06 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364250+0000", 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6965999999999995e-05 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364341+0000", 2024-05-09T09:54:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0847999999999995e-05 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.364524+0000", 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182778 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.365027+0000", 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050315500000000003 2024-05-09T09:54:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368257+0000", 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032293809999999999 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368293+0000", 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6612000000000001e-05 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.368321+0000", 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8218999999999999e-05 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:476 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.423738069999999, 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030779259999999999, 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 476 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384034+0000", 2024-05-09T09:54:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384035+0000", 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.046e-06 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384041+0000", 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6899999999999997e-06 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384055+0000", 2024-05-09T09:54:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4457999999999999e-05 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384062+0000", 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3709999999999996e-06 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384143+0000", 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1678e-05 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384199+0000", 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5940999999999999e-05 2024-05-09T09:54:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384322+0000", 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122617 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.384970+0000", 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064774299999999999 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387007+0000", 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020371009999999999 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387067+0000", 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0234e-05 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.387112+0000", 2024-05-09T09:54:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5046999999999997e-05 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.201230440000003, 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003541209, 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 736 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606542+0000", 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606544+0000", 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606556+0000", 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.185e-05 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606586+0000", 2024-05-09T09:54:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0916e-05 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606602+0000", 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.606759+0000", 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157594 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607123+0000", 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036346000000000002 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.607703+0000", 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057985000000000003 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609215+0000", 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001512071 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609797+0000", 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058224999999999998 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.609969+0000", 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171767 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.610083+0000", 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114221 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.865 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.196713181000007, 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029874860000000001, 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.866 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 738 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611059+0000", 2024-05-09T09:54:26.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611061+0000", 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1739999999999999e-06 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611073+0000", 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1619e-05 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611099+0000", 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6103000000000001e-05 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611112+0000", 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.295e-05 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611252+0000", 2024-05-09T09:54:26.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014065799999999999 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611494+0000", 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000241769 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.611980+0000", 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000486331 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613227+0000", 2024-05-09T09:54:26.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012462529999999999 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613772+0000", 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054489600000000001 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.613927+0000", 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000155668 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.614046+0000", 2024-05-09T09:54:26.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119065 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.120033907999996, 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003024648, 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.872 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 772 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687738+0000", 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687740+0000", 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1500000000000002e-06 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687753+0000", 2024-05-09T09:54:26.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2587e-05 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687785+0000", 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1942e-05 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687802+0000", 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736999999999999e-05 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.687946+0000", 2024-05-09T09:54:26.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014396100000000001 2024-05-09T09:54:26.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688198+0000", 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025293499999999998 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.688521+0000", 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032281500000000001 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.689716+0000", 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011949160000000001 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690602+0000", 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088602799999999997 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690692+0000", 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9468000000000005e-05 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.690763+0000", 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1109e-05 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.964727715999999, 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003347376, 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.880 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 838 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843044+0000", 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843046+0000", 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9870000000000002e-06 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843059+0000", 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3123e-05 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843090+0000", 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0162999999999999e-05 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843105+0000", 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4956e-05 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843258+0000", 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015342099999999999 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.843636+0000", 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000377644 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.844223+0000", 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058732299999999995 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.845580+0000", 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013567270000000001 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846218+0000", 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063835499999999996 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846313+0000", 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4475000000000006e-05 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.846392+0000", 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9202000000000005e-05 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:26.886 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.960455835000005, 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029984809999999999, 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 840 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847316+0000", 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847318+0000", 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7230000000000001e-06 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847328+0000", 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0233e-05 2024-05-09T09:54:26.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847353+0000", 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4719000000000002e-05 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847365+0000", 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2534000000000001e-05 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847493+0000", 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012747799999999999 2024-05-09T09:54:26.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847627+0000", 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013396 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.847937+0000", 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031040499999999998 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.848946+0000", 2024-05-09T09:54:26.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010091029999999999 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850158+0000", 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001211349 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850239+0000", 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1079000000000001e-05 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.850315+0000", 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5897999999999997e-05 2024-05-09T09:54:26.891 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.936208547999996, 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029954320000000001, 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.892 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871564+0000", 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871566+0000", 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.153e-06 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871578+0000", 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.184e-05 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871608+0000", 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0859999999999999e-05 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871623+0000", 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4899000000000001e-05 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871760+0000", 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000136685 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.871990+0000", 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000229559 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.872322+0000", 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000332128 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.873500+0000", 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001178023 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874351+0000", 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085124199999999999 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874437+0000", 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6062000000000004e-05 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.874559+0000", 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121981 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.897 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.899471184000006, 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029994549999999998, 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 865 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908301+0000", 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908303+0000", 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1560000000000002e-06 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908315+0000", 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908345+0000", 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0383e-05 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908360+0000", 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5023e-05 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908507+0000", 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014646799999999999 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.908728+0000", 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022162899999999999 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.909067+0000", 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000338621 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.910282+0000", 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001215156 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911147+0000", 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086497500000000003 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911229+0000", 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2472000000000006e-05 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.911300+0000", 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0832000000000002e-05 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.830654159999995, 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033122170000000001, 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.903 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 895 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977118+0000", 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977120+0000", 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1100000000000001e-06 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977132+0000", 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1552999999999999e-05 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977163+0000", 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1383000000000001e-05 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977178+0000", 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4807000000000001e-05 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977331+0000", 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152967 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.977700+0000", 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036903700000000001 2024-05-09T09:54:26.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.978266+0000", 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056619699999999995 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.979467+0000", 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001201166 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980277+0000", 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081005900000000002 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980367+0000", 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0298999999999997e-05 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.980430+0000", 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2638999999999994e-05 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.737261270000005, 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029823219999999999, 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 934 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070511+0000", 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070513+0000", 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070525+0000", 2024-05-09T09:54:26.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070558+0000", 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2651999999999998e-05 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070580+0000", 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.194e-05 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070713+0000", 2024-05-09T09:54:26.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013299399999999999 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.070937+0000", 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022408700000000001 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.071257+0000", 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032046100000000002 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.072520+0000", 2024-05-09T09:54:26.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001262448 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073338+0000", 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081789299999999998 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073425+0000", 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7127999999999997e-05 2024-05-09T09:54:26.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.073493+0000", 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8355999999999994e-05 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 67.730569708000004, 2024-05-09T09:54:26.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029267099999999999, 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 937 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077202+0000", 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077204+0000", 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.804e-06 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077215+0000", 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0576e-05 2024-05-09T09:54:26.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077244+0000", 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8866000000000001e-05 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077265+0000", 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1607000000000002e-05 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077410+0000", 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014486699999999999 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077632+0000", 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022217600000000001 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.077954+0000", 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321665 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.078933+0000", 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097881899999999991 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.079959+0000", 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001026676 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080047+0000", 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7114999999999995e-05 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:19.080129+0000", 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2539000000000004e-05 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1163 3.25 e57/18 3:a4ddbff3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_7:head v 57'1, mlcod=0'0)", 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.547136+0000", 2024-05-09T09:54:26.921 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.26063604600000001, 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091294749999999997, 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.547136+0000", 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.547136+0000", 2024-05-09T09:54:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.547139+0000", 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2370000000000001e-06 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.548918+0000", 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017791339999999999 2024-05-09T09:54:26.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.548945+0000", 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6653999999999999e-05 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.548959+0000", 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4432e-05 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.549041+0000", 2024-05-09T09:54:26.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1692000000000003e-05 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.549079+0000", 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7387e-05 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.556213+0000", 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071348289999999997 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.556265+0000", 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2110000000000001e-05 2024-05-09T09:54:26.925 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1170 3.33 3:cee14352:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.17636754599999999, 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020472503, 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:26.926 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1170 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631408+0000", 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.106e-06 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634073+0000", 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026654909999999999 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634103+0000", 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9717999999999999e-05 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634119+0000", 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6231000000000001e-05 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:26.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634204+0000", 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4588999999999999e-05 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634365+0000", 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634467+0000", 2024-05-09T09:54:26.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102076 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.640780+0000", 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063121749999999997 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651757+0000", 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010977489 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:26.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651824+0000", 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6907000000000002e-05 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651877+0000", 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3063999999999999e-05 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:26.932 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:26.934 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:26.934 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:26.934 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:26.934 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0655848 s, 1.6 GB/s 2024-05-09T09:54:26.935 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:26.930+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:27.035 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:27.035+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:27.068 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:27.068 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:27.068 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:27.068 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:27.085 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:27.135 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:27.134+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:27.218 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:27.219 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:27.219 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:27.219 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:27.219 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:27.237 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:27.238 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:27.235+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:27.337 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:27.335+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:27.416 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:27.416 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:27.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:27.416 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:27.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 74.293479570000002, 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019579709000000001, 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 43 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119950+0000", 2024-05-09T09:54:27.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119985+0000", 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4941999999999999e-05 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120018+0000", 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179999999999997e-05 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120040+0000", 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2432000000000001e-05 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120194+0000", 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015399700000000001 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120215+0000", 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0886e-05 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139214+0000", 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018999381999999999 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139526+0000", 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031177000000000001 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.421 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.211229599999996, 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787665, 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 211 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202200+0000", 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202215+0000", 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5656999999999999e-05 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202254+0000", 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8506e-05 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202272+0000", 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8300000000000001e-05 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202427+0000", 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015497699999999999 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202662+0000", 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234928 2024-05-09T09:54:27.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.203104+0000", 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000442151 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.204510+0000", 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014061329999999999 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205816+0000", 2024-05-09T09:54:27.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013059009999999999 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205907+0000", 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0841000000000007e-05 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205984+0000", 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7164999999999997e-05 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.427 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.135909776000005, 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034049729999999999, 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.428 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 232 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277519+0000", 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277531+0000", 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2320000000000001e-05 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277564+0000", 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2669999999999997e-05 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277579+0000", 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5415999999999999e-05 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277729+0000", 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014924 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277957+0000", 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022849599999999999 2024-05-09T09:54:27.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.278368+0000", 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041114500000000002 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.279935+0000", 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015665290000000001 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280758+0000", 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082300099999999996 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280850+0000", 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1978000000000006e-05 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280921+0000", 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1527999999999997e-05 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.433 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:281 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.107581847999995, 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030930129999999999, 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 281 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305847+0000", 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3300000000000001e-06 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305858+0000", 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.099e-05 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305882+0000", 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4026999999999999e-05 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305905+0000", 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3376000000000001e-05 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306060+0000", 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154757 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306388+0000", 2024-05-09T09:54:27.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032792699999999999 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.307138+0000", 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074994099999999995 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308466+0000", 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013284569999999999 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308604+0000", 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137677 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308776+0000", 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017272000000000001 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308937+0000", 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016081099999999999 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.439 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:360 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.094288532999997, 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038853109999999998, 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 360 2024-05-09T09:54:27.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319140+0000", 2024-05-09T09:54:27.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.057e-06 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319151+0000", 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319180+0000", 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8578999999999999e-05 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319200+0000", 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0236000000000001e-05 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319337+0000", 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013646400000000001 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319617+0000", 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028014499999999998 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.320147+0000", 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052992600000000001 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321598+0000", 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014515820000000001 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322829+0000", 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012307959999999999 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322925+0000", 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5494000000000004e-05 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323023+0000", 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8292e-05 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:378 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.089242584999994, 2024-05-09T09:54:27.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036244110000000001, 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 378 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324187+0000", 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999999e-06 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324203+0000", 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.609e-05 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324240+0000", 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7052999999999999e-05 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324262+0000", 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2195999999999999e-05 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324396+0000", 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013415700000000001 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324628+0000", 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023225200000000001 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325138+0000", 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050956299999999999 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.326372+0000", 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012345489999999999 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327556+0000", 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011832430000000001 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327701+0000", 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014539699999999999 2024-05-09T09:54:27.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327808+0000", 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106835 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.073885019000002, 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876559999999998, 2024-05-09T09:54:27.451 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 406 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339543+0000", 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2570000000000002e-06 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339553+0000", 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339576+0000", 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2857000000000002e-05 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339591+0000", 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4905e-05 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339738+0000", 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014698599999999999 2024-05-09T09:54:27.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340100+0000", 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036169499999999999 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340703+0000", 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060361099999999999 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342128+0000", 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014245690000000001 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342467+0000", 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033892500000000001 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342554+0000", 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7527000000000004e-05 2024-05-09T09:54:27.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342629+0000", 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4580999999999996e-05 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:438 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'3, mlcod=30'1)", 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.053496564, 2024-05-09T09:54:27.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036072999999999999, 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:27.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359931+0000", 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.891e-06 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359945+0000", 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359978+0000", 2024-05-09T09:54:27.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2465000000000002e-05 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359996+0000", 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360123+0000", 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012710900000000001 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360164+0000", 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0719000000000001e-05 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363453+0000", 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003289555 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363537+0000", 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3535999999999994e-05 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:443 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'4, mlcod=30'2)", 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.048513761999999, 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034263010000000001, 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364914+0000", 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-06 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364925+0000", 2024-05-09T09:54:27.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628000000000001e-05 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364948+0000", 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3594000000000001e-05 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364960+0000", 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2017e-05 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365077+0000", 2024-05-09T09:54:27.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116706 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365114+0000", 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6908e-05 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368217+0000", 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031027820000000001 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368339+0000", 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121989 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.017830090999993, 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028199750000000002, 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 499 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395598+0000", 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0470000000000001e-06 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395609+0000", 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1083e-05 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395631+0000", 2024-05-09T09:54:27.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1953000000000001e-05 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395644+0000", 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2860000000000001e-05 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395771+0000", 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127231 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395990+0000", 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000218779 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.396428+0000", 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000437854 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.397598+0000", 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011703239999999999 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398222+0000", 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062386500000000003 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398324+0000", 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010160100000000001 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398416+0000", 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2378000000000002e-05 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.931411634, 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085482570000000001, 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 633 2024-05-09T09:54:27.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482016+0000", 2024-05-09T09:54:27.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9300000000000002e-06 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482024+0000", 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0630000000000006e-06 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482042+0000", 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7713000000000001e-05 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482053+0000", 2024-05-09T09:54:27.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1246e-05 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482171+0000", 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117465 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482382+0000", 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000210719 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482853+0000", 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047157999999999998 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.485997+0000", 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031434620000000001 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490455+0000", 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004458414 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490516+0000", 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0488000000000001e-05 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490563+0000", 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.479 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.861745346999996, 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787257, 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 709 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:27.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551683+0000", 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4059999999999999e-06 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551696+0000", 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551725+0000", 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8890999999999998e-05 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551743+0000", 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7878999999999999e-05 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551889+0000", 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014628199999999999 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552237+0000", 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034787300000000001 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552746+0000", 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050886300000000002 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.554142+0000", 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013964120000000001 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555320+0000", 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001177974 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555400+0000", 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9468000000000006e-05 2024-05-09T09:54:27.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555468+0000", 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8511999999999997e-05 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.823901441000004, 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028728, 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.485 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 727 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589527+0000", 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356e-06 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589538+0000", 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1463e-05 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589571+0000", 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589592+0000", 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1219000000000001e-05 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589739+0000", 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147424 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590004+0000", 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264632 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590346+0000", 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034226299999999999 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592098+0000", 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001752116 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592249+0000", 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015033000000000001 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592335+0000", 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5890999999999995e-05 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592397+0000", 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2966000000000007e-05 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.490 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.820135325999999, 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031054329999999999, 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.491 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 729 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593292+0000", 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.344e-06 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593300+0000", 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5229999999999998e-06 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593321+0000", 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1299999999999999e-05 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593339+0000", 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8206000000000002e-05 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593428+0000", 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8928e-05 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593547+0000", 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118794 2024-05-09T09:54:27.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593824+0000", 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027681500000000003 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.595408+0000", 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001584086 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596242+0000", 2024-05-09T09:54:27.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083392999999999998 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596333+0000", 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0878000000000006e-05 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596396+0000", 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3628999999999997e-05 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.718354575999996, 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031859179999999998, 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 775 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695074+0000", 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.723e-06 2024-05-09T09:54:27.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695086+0000", 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1457000000000001e-05 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695117+0000", 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1343000000000001e-05 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695138+0000", 2024-05-09T09:54:27.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0622999999999999e-05 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695261+0000", 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123621 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695596+0000", 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033511000000000001 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:27.500 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.696142+0000", 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054512500000000004 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.697459+0000", 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013177480000000001 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698089+0000", 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063017800000000001 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698179+0000", 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9511000000000004e-05 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698257+0000", 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8479000000000005e-05 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.502 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.627583365000007, 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002852074, 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 814 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:27.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785845+0000", 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785856+0000", 2024-05-09T09:54:27.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1323e-05 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785887+0000", 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0602999999999998e-05 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785901+0000", 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4612e-05 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786031+0000", 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012920100000000001 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786246+0000", 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021583299999999999 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786562+0000", 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031516999999999998 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.787822+0000", 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001260359 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788501+0000", 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067859300000000001 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788589+0000", 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7961999999999996e-05 2024-05-09T09:54:27.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788695+0000", 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106258 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.470362618999999, 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029203889999999998, 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.508 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 880 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943067+0000", 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1870000000000001e-06 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943079+0000", 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2319e-05 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943111+0000", 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1779999999999997e-05 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943126+0000", 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285999999999999e-05 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943239+0000", 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112631 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943472+0000", 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023326299999999999 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943790+0000", 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031812600000000001 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.944926+0000", 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011362519999999999 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945815+0000", 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088909199999999996 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945906+0000", 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0997999999999998e-05 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945984+0000", 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7454999999999996e-05 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.513 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.463137994999997, 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028357909999999998, 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.514 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 883 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950290+0000", 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3e-06 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950303+0000", 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.261e-05 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950334+0000", 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950354+0000", 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9865999999999999e-05 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950487+0000", 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950710+0000", 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223002 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.951056+0000", 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034612999999999999 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952129+0000", 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010729820000000001 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952975+0000", 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00084584999999999999 2024-05-09T09:54:27.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953059+0000", 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4371999999999998e-05 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953124+0000", 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4412000000000006e-05 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.519 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.393435190000005, 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028784679999999999, 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 913 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019993+0000", 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3769999999999999e-06 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020005+0000", 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1797000000000001e-05 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020036+0000", 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0876000000000001e-05 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020051+0000", 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4739000000000001e-05 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020163+0000", 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112432 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020385+0000", 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022189200000000001 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020709+0000", 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032386699999999998 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.021761+0000", 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051979 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022727+0000", 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096616099999999999 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022805+0000", 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8009000000000005e-05 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022869+0000", 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4338999999999995e-05 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 68.356480743999995, 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00285995, 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:27.525 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 928 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:27.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056947+0000", 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.81e-06 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056957+0000", 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5829999999999996e-06 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:27.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056980+0000", 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3278999999999999e-05 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056992+0000", 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2437e-05 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057171+0000", 2024-05-09T09:54:27.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017842199999999999 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057393+0000", 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022195 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057705+0000", 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000311687 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:27.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.058914+0000", 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012093029999999999 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059652+0000", 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073784800000000004 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059738+0000", 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6231999999999997e-05 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:27.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059805+0000", 2024-05-09T09:54:27.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7398999999999996e-05 2024-05-09T09:54:27.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.531 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.531 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:27.531 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:27.531 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:27.533 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:54:27.533 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:27.534 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:27.530+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:27.534 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.3 2024-05-09T09:54:27.534 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:27.534 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 4 2024-05-09T09:54:27.564 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:27.564 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:27.564 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0642493 s, 1.6 GB/s 2024-05-09T09:54:27.633 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:27.630+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:27.703 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:27.704 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:27.704 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:27.704 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:27.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:27.734 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:27.731+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:27.835 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:27.834+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:27.889 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:27.889 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:27.890 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:27.890 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:27.890 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:27.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:27.936 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:27.935+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:28.038 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:28.034+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:28.096 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:28.096 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:28.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:28.096 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:28.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.096 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:437 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.735573402, 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056446969999999997, 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 437 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358504+0000", 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358506+0000", 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7060000000000001e-06 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358516+0000", 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8600000000000005e-06 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358536+0000", 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0231e-05 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.358552+0000", 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6141999999999999e-05 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359405+0000", 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085275200000000002 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359539+0000", 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426000000000001 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:28.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359975+0000", 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043652300000000002 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363582+0000", 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036068459999999999 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364013+0000", 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043084500000000001 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364091+0000", 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7816000000000002e-05 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364149+0000", 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7716000000000001e-05 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:440 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.732494349000007, 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073055910000000002, 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 440 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.103 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:54:28.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361583+0000", 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361584+0000", 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.486e-06 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361591+0000", 2024-05-09T09:54:28.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9829999999999999e-06 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361611+0000", 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9925e-05 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361622+0000", 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0297e-05 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361730+0000", 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010856100000000001 2024-05-09T09:54:28.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.361848+0000", 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117909 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.362099+0000", 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025122099999999999 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368320+0000", 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062206800000000001 2024-05-09T09:54:28.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368752+0000", 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000431629 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368831+0000", 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9369999999999994e-05 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368889+0000", 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.753e-05 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.109 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:633 6.1a e30/24 6:5ae4284b:::obj_delete_at_hint.0000000032:head v 30'7, mlcod=30'5)", 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 69.611000578000002, 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007079526, 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483077+0000", 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483078+0000", 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.703e-06 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483093+0000", 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4589999999999999e-05 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483120+0000", 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7172999999999999e-05 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483134+0000", 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3559e-05 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483241+0000", 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010755399999999999 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.483272+0000", 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0933999999999999e-05 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490066+0000", 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067936860000000002 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490156+0000", 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0327000000000004e-05 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1161 3.1d 3:b8b74cb5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.5755364379999999, 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020326487000000001, 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1161 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518545+0000", 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639999999999998e-06 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522778+0000", 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042321429999999998 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522816+0000", 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624000000000002e-05 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522834+0000", 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522974+0000", 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523215+0000", 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024094700000000001 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523432+0000", 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217333 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.532230+0000", 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087981150000000004 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538624+0000", 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063944249999999996 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538717+0000", 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2608999999999994e-05 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538867+0000", 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150357 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1164 3.2a 3:563cc67e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.533742186, 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023925154000000001, 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1164 2024-05-09T09:54:28.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560338+0000", 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2499999999999998e-06 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564645+0000", 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043069290000000001 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564681+0000", 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5746e-05 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564697+0000", 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6269999999999998e-05 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564822+0000", 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012474099999999999 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565074+0000", 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025190400000000001 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565300+0000", 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226133 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.572636+0000", 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073360760000000004 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584083+0000", 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011446424 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584177+0000", 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4518999999999994e-05 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584260+0000", 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3162000000000001e-05 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.125 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1178 3.37 e57/18 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.371525267, 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025242840999999999, 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722556+0000", 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5159999999999999e-06 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728655+0000", 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060999039999999997 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728694+0000", 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8009999999999997e-05 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728710+0000", 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6880000000000001e-05 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728899+0000", 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018883699999999999 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728968+0000", 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9041999999999994e-05 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747653+0000", 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018684905000000002 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747795+0000", 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014174700000000001 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.129 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1185 3.d e57/18 3:b0d72c34:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_1:head v 57'3, mlcod=57'1)", 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.107702+0000", 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.98637542300000003, 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096742879999999996, 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.130 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.107702+0000", 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.107702+0000", 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.107705+0000", 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.587e-06 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.109164+0000", 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014594390000000001 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.109192+0000", 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8007000000000001e-05 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.109205+0000", 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3514e-05 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.109303+0000", 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7602000000000005e-05 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.109338+0000", 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5026e-05 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.117324+0000", 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079864069999999992 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.117376+0000", 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1706000000000003e-05 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1193 3.c 3:312df403:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.235533+0000", 2024-05-09T09:54:28.134 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.85854477600000001, 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014048306, 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1193 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.235533+0000", 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.235533+0000", 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.235536+0000", 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.253e-06 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.239603+0000", 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040671309999999999 2024-05-09T09:54:28.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.239640+0000", 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6893000000000001e-05 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.239656+0000", 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6365999999999999e-05 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.239744+0000", 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7984000000000003e-05 2024-05-09T09:54:28.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.239869+0000", 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012507800000000001 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.239978+0000", 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000108465 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.248182+0000", 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082047470000000001 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.249503+0000", 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013208 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.249545+0000", 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2123000000000003e-05 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.249581+0000", 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5466000000000002e-05 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1194 3.35 e57/18 3:ac539704:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_10:head v 57'1, mlcod=0'0)", 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.262242+0000", 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.83183533799999998, 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009501977, 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.140 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.262242+0000", 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.262242+0000", 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.262243+0000", 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.339e-06 2024-05-09T09:54:28.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.263802+0000", 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001558657 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.263831+0000", 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8717e-05 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.263846+0000", 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5457000000000001e-05 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.263923+0000", 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6341999999999995e-05 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.263942+0000", 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9351000000000002e-05 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.271687+0000", 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077454680000000001 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.271744+0000", 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6645999999999999e-05 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1198 3.16 3:6968f1e0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.78641572500000001, 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015069340000000001, 2024-05-09T09:54:28.144 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1198 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307664+0000", 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7329999999999999e-06 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311411+0000", 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037470200000000002 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311443+0000", 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311460+0000", 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6690000000000001e-05 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311571+0000", 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011076100000000001 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311723+0000", 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015242399999999999 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311851+0000", 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127878 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.318523+0000", 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066716960000000004 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322606+0000", 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040829669999999998 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322659+0000", 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3491e-05 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322731+0000", 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1793999999999997e-05 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1200 3.22 3:47cf0652:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.75416002800000004, 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016902618000000001, 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1200 2024-05-09T09:54:28.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339920+0000", 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0230000000000001e-06 2024-05-09T09:54:28.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343641+0000", 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037201949999999999 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343670+0000", 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9706999999999999e-05 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343682+0000", 2024-05-09T09:54:28.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2264e-05 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343761+0000", 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8629999999999998e-05 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343899+0000", 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013740599999999999 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:28.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.344011+0000", 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112305 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.350517+0000", 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065057780000000003 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356651+0000", 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061347459999999999 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356749+0000", 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7813999999999996e-05 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356820+0000", 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0749999999999999e-05 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1201 3.2a 3:54ff7f97:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:28.155 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.74589654900000002, 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020960774000000001, 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348183+0000", 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9889999999999999e-06 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352065+0000", 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038826189999999999 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352086+0000", 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0407e-05 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352100+0000", 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3745e-05 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352173+0000", 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3335000000000002e-05 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352330+0000", 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015688400000000001 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352462+0000", 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013203100000000001 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.365714+0000", 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013252553 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.368997+0000", 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032823800000000001 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369079+0000", 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2639999999999995e-05 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369142+0000", 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2191000000000001e-05 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1205 3.c 3:33072649:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.68603023699999999, 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016563870000000001, 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1205 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:28.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408049+0000", 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1840000000000002e-06 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411807+0000", 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003758188 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411838+0000", 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0171e-05 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411853+0000", 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5107e-05 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411933+0000", 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0049999999999994e-05 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.412059+0000", 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012650000000000001 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.412166+0000", 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010712 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.418296+0000", 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061291610000000002 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424417+0000", 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061217390000000002 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424511+0000", 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3738000000000003e-05 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424611+0000", 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9912000000000002e-05 2024-05-09T09:54:28.166 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1207 3.17 e58/18 3:eb26b495:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_23:head v 58'2, mlcod=0'0)", 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.449164+0000", 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.644913717, 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099015079999999998, 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.449164+0000", 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.449164+0000", 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.449164+0000", 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9999999999999998e-07 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.453979+0000", 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048143980000000001 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.453991+0000", 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2857000000000001e-05 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.454000+0000", 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3839999999999997e-06 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.454053+0000", 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3145e-05 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.454076+0000", 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2741000000000001e-05 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.459002+0000", 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049267640000000001 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.459065+0000", 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2718999999999994e-05 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1213 3.22 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.27810991299999999, 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022416997000000001, 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.171 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1213 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:28.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815970+0000", 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6079999999999998e-06 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819807+0000", 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038369699999999999 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819837+0000", 2024-05-09T09:54:28.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0423999999999999e-05 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819850+0000", 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2594e-05 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819953+0000", 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102543 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820186+0000", 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023374800000000001 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820600+0000", 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041405700000000001 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.833246+0000", 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012645854 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838263+0000", 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050170529999999996 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838332+0000", 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9202000000000006e-05 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838384+0000", 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1944000000000003e-05 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1218 3.1f e58/18 3:fb5d7f81:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_6:head v 58'1, mlcod=0'0)", 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.19221550000000001, 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017606534, 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901864+0000", 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4169999999999999e-06 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907193+0000", 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053291229999999998 2024-05-09T09:54:28.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907243+0000", 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.914e-05 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907269+0000", 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6982e-05 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907404+0000", 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-09T09:54:28.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907441+0000", 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7036000000000003e-05 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919377+0000", 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011935871000000001 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919468+0000", 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1355999999999997e-05 2024-05-09T09:54:28.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1219 3.c 3:32502fcd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.17622394999999999, 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016710821000000001, 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1219 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917856+0000", 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0539999999999999e-06 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923017+0000", 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051609450000000001 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923052+0000", 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4369999999999998e-05 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923070+0000", 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8637000000000001e-05 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923167+0000", 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6708999999999999e-05 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923390+0000", 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223372 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923603+0000", 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212847 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.931054+0000", 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074508279999999996 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934408+0000", 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033535850000000001 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934495+0000", 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6945000000000002e-05 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934564+0000", 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9529000000000005e-05 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.186 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1220 3.31 e58/31 3:8df6b82b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_8:head v 58'1, mlcod=0'0)", 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.940182+0000", 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.153894909, 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012712731999999999, 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.940182+0000", 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.940182+0000", 2024-05-09T09:54:28.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.940183+0000", 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9699999999999996e-07 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.945410+0000", 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0052268610000000002 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.945439+0000", 2024-05-09T09:54:28.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9437e-05 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.945454+0000", 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4293e-05 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.945539+0000", 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5619999999999997e-05 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.945570+0000", 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1050999999999998e-05 2024-05-09T09:54:28.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.952824+0000", 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0072534979999999997 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.952895+0000", 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1475000000000003e-05 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1222 3.35 e58/18 3:ae44ec2d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_10:head v 58'2, mlcod=0'0)", 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.990285+0000", 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.10379255499999999, 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010142264, 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.990285+0000", 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.990285+0000", 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.990285+0000", 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2899999999999999e-07 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.992367+0000", 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0020820080000000002 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.992398+0000", 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0883999999999998e-05 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.992415+0000", 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7486000000000002e-05 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.992527+0000", 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011196000000000001 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.992562+0000", 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4885000000000002e-05 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.000349+0000", 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077869039999999999 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.000427+0000", 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7807999999999998e-05 2024-05-09T09:54:28.194 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1224 3.16 3:6a153b4c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.080586205999999994, 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017301769000000002, 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:28.195 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1224 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:28.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013494+0000", 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6900000000000001e-06 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017322+0000", 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038277820000000001 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017347+0000", 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5758e-05 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017361+0000", 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4113e-05 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017456+0000", 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.501e-05 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017598+0000", 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014114100000000001 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017722+0000", 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012439800000000001 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.027953+0000", 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010230888 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030697+0000", 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027437540000000002 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030751+0000", 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4379000000000002e-05 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030793+0000", 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:28.200 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:28.202 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:28.202 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:28.198+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:28.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:28.303 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:28.302+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:28.317 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.4 2024-05-09T09:54:28.317 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:28.317 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 5 2024-05-09T09:54:28.373 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:28.373 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:28.373 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:28.373 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:28.387 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:28.392 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:28.392 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:28.392 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0735481 s, 1.4 GB/s 2024-05-09T09:54:28.403 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:28.403+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:28.422 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:28.422 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:28.439 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:28.439 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:28.456 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:28.456 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:28.473 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:28.473 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:28.492 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:28.492 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:28.505 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:28.503+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:28.512 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:28.567 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:28.568 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:28.568 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:28.568 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:28.569 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:28.570 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:28.570 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:28.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:28.610 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:28.611+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:28.697 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:28.698 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:28.706 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:28.707+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:28.718 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:28.807 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:28.806+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:28.845 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:28.845 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:28.862 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:28.908 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:28.907+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:29.009 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:29.007+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:29.034 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.5 2024-05-09T09:54:29.034 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:29.034 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 6 2024-05-09T09:54:29.040 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:29.040 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:29.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:29.110 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:29.111+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:29.118 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:29.118 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:29.118 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0810315 s, 1.3 GB/s 2024-05-09T09:54:29.175 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:29.175 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:29.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:29.211 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:29.210+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:29.312 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:29.310+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:29.314 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:29.314 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:29.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:29.414 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:29.410+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:29.492 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:29.492 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:29.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:29.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:54:29.556 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:29.555+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:29.615 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:29.615+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:29.668 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:29.668 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:29.682 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.6 2024-05-09T09:54:29.682 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:29.683 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 7 2024-05-09T09:54:29.691 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:29.738 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:29.739+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:29.754 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:29.754 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:29.755 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0707955 s, 1.5 GB/s 2024-05-09T09:54:29.817 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:29.815+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:29.855 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:29.855 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:29.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:29.917 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:29.918+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:30.018 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:30.019+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:30.041 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:30.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:30.119 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:30.118+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:30.220 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:30.219+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:30.252 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:30.252 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:30.264 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.7 2024-05-09T09:54:30.264 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:30.264 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 8 2024-05-09T09:54:30.270 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:30.331 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:30.331 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:30.331 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0656753 s, 1.6 GB/s 2024-05-09T09:54:30.332 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:30.331+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:30.421 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:30.419+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:30.427 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:30.427 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:30.439 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:54:30.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:30.522 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:30.518+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:30.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:30.623 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:30.622+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:30.647 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:30.648 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:30.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:30.724 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:30.723+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:30.774 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:30.774 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:30.807 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:30.807 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:30.824 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:30.824 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:30.824 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:30.822+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:30.835 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:30.836 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:30.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:30.851 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:30.852 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:30.874 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:30.885 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.8 2024-05-09T09:54:30.885 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:30.885 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 9 2024-05-09T09:54:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:30.895 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:30.925 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:30.923+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:30.938 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:30.955 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:30.956 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:30.956 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0685093 s, 1.5 GB/s 2024-05-09T09:54:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:30.969 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:30.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:31.026 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:31.022+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:31.128 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:31.127+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:31.143 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:31.144 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:31.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:31.242 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:31.243+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:31.330 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:31.331+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:31.351 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:31.351 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:31.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:31.351 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:31.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 73.174363255000003, 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1170 3.33 3:cee14352:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.7146310360000001, 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020472503, 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.358 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1170 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631408+0000", 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.106e-06 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634073+0000", 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026654909999999999 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634103+0000", 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9717999999999999e-05 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634119+0000", 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6231000000000001e-05 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634204+0000", 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4588999999999999e-05 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634365+0000", 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634467+0000", 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102076 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.640780+0000", 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063121749999999997 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651757+0000", 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010977489 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651824+0000", 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6907000000000002e-05 2024-05-09T09:54:31.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651877+0000", 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3063999999999999e-05 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1179 3.15 e57/18 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head v 57'1, mlcod=0'0)", 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.6102802599999997, 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012942011999999999, 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.364 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735757+0000", 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6899999999999999e-06 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741210+0000", 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054525679999999997 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741231+0000", 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1753e-05 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741241+0000", 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2669999999999995e-06 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741314+0000", 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3289999999999998e-05 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741341+0000", 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6976000000000001e-05 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.748649+0000", 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00730834 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.748697+0000", 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8127999999999997e-05 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1182 3.24 3:2729f60c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.5858186270000001, 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012696430999999999, 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1182 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760219+0000", 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.418e-06 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761604+0000", 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001384531 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761636+0000", 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1958999999999997e-05 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761649+0000", 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.349e-05 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761741+0000", 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1250999999999998e-05 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761925+0000", 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184644 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.762468+0000", 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054271699999999996 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772380+0000", 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099119689999999996 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772840+0000", 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045971400000000001 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772882+0000", 2024-05-09T09:54:31.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2667000000000003e-05 2024-05-09T09:54:31.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772913+0000", 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1071000000000001e-05 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1187 3.33 3:cfd58a24:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.1927698339999999, 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018610282999999998, 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.375 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1187 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153270+0000", 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.386e-06 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156128+0000", 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028576029999999998 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156181+0000", 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3306000000000001e-05 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156209+0000", 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263e-05 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156349+0000", 2024-05-09T09:54:31.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013982099999999999 2024-05-09T09:54:31.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156592+0000", 2024-05-09T09:54:31.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024288700000000001 2024-05-09T09:54:31.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:31.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156811+0000", 2024-05-09T09:54:31.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021942700000000001 2024-05-09T09:54:31.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.162923+0000", 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061111170000000001 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171805+0000", 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088825099999999997 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171845+0000", 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0179000000000003e-05 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171876+0000", 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0784000000000002e-05 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1189 3.27 3:e771d36d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:31.382 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.1585488130000003, 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014679329, 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1189 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187489+0000", 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7300000000000001e-06 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189331+0000", 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018411689999999999 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189381+0000", 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0735999999999997e-05 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189408+0000", 2024-05-09T09:54:31.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6443000000000001e-05 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189521+0000", 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112979 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189702+0000", 2024-05-09T09:54:31.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018166499999999999 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189798+0000", 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5571999999999999e-05 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.194700+0000", 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049020970000000002 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202064+0000", 2024-05-09T09:54:31.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073640809999999998 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202115+0000", 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0803000000000001e-05 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202166+0000", 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1054000000000003e-05 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1190 3.24 3:252d1260:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.200797+0000", 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.1452383460000002, 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012020393000000001, 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1190 2024-05-09T09:54:31.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.200797+0000", 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.200797+0000", 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.200800+0000", 2024-05-09T09:54:31.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7429999999999998e-06 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202627+0000", 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018273040000000001 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202658+0000", 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1046000000000001e-05 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202681+0000", 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2235999999999999e-05 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202764+0000", 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3707000000000003e-05 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202898+0000", 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013378000000000001 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:31.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.203001+0000", 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010293000000000001 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.208167+0000", 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051661490000000001 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.212624+0000", 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044571899999999998 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.212734+0000", 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109219 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.212818+0000", 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4089000000000001e-05 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1196 3.8 3:108944be:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.276780+0000", 2024-05-09T09:54:31.395 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.0692554550000004, 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011641966, 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1196 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.276780+0000", 2024-05-09T09:54:31.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.276780+0000", 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.276783+0000", 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7870000000000002e-06 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.277984+0000", 2024-05-09T09:54:31.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012008590000000001 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.278010+0000", 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6707e-05 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.278024+0000", 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.278093+0000", 2024-05-09T09:54:31.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8186000000000001e-05 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.278204+0000", 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111223 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.278299+0000", 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4821999999999994e-05 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.283629+0000", 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053308629999999999 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.288284+0000", 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046541949999999999 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.288347+0000", 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3235e-05 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.288422+0000", 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5154999999999994e-05 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1197 3.18 3:19eaa87f:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.288401+0000", 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.057634287, 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010629025, 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1197 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.288401+0000", 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.288401+0000", 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.288403+0000", 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.956e-06 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.290104+0000", 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017003980000000001 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.290134+0000", 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0790000000000002e-05 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.290152+0000", 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7652999999999999e-05 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.290251+0000", 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8647000000000006e-05 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.290448+0000", 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019684999999999999 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.290638+0000", 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019031899999999999 2024-05-09T09:54:31.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.298172+0000", 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075342350000000002 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.298961+0000", 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078883999999999996 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.298998+0000", 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7370000000000003e-05 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.299030+0000", 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1967000000000001e-05 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1200 3.22 e57/18 3:47cf0652:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_16:head v 57'1, mlcod=0'0)", 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.344204+0000", 2024-05-09T09:54:31.407 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.0018311689999999, 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012173501999999999, 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.344204+0000", 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.344204+0000", 2024-05-09T09:54:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.344207+0000", 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4169999999999999e-06 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.350310+0000", 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061034959999999999 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.350351+0000", 2024-05-09T09:54:31.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0985999999999997e-05 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.350374+0000", 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3193e-05 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.350472+0000", 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7421000000000001e-05 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.350501+0000", 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8665000000000001e-05 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.356263+0000", 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057622740000000004 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.356378+0000", 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011505 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1203 3.18 3:1965ae3c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.372391+0000", 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.973644256, 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010911081, 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1203 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.372391+0000", 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.372391+0000", 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.372394+0000", 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1429999999999998e-06 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.374175+0000", 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001780663 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.374213+0000", 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7836999999999997e-05 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.374231+0000", 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7853e-05 2024-05-09T09:54:31.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.374325+0000", 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4687999999999999e-05 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.374516+0000", 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000190216 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.374696+0000", 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018077100000000001 2024-05-09T09:54:31.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.381470+0000", 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067730530000000002 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.383233+0000", 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001763312 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.383272+0000", 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8683999999999998e-05 2024-05-09T09:54:31.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.383302+0000", 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0861000000000001e-05 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1204 3.18 3:18db51f7:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.396443+0000", 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.949592972, 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01038303, 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.417 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.396443+0000", 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.396443+0000", 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.396445+0000", 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8140000000000001e-06 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.398185+0000", 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017393490000000001 2024-05-09T09:54:31.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.398224+0000", 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9365e-05 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.398247+0000", 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2977e-05 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.398352+0000", 2024-05-09T09:54:31.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104999 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.398549+0000", 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019661099999999999 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.398715+0000", 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016666700000000001 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.406430+0000", 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077147600000000002 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.406701+0000", 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027120600000000002 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.406769+0000", 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7912999999999998e-05 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.406826+0000", 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6369000000000002e-05 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1205 3.c e57/18 3:33072649:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_21:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.412452+0000", 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.933583176, 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011424106, 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.412452+0000", 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.412452+0000", 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.412455+0000", 2024-05-09T09:54:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7630000000000001e-06 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.419424+0000", 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069691960000000004 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.419470+0000", 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5948000000000001e-05 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.419492+0000", 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2140000000000001e-05 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.419581+0000", 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8917000000000003e-05 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.419599+0000", 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7744000000000002e-05 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.423811+0000", 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042114199999999996 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.423876+0000", 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5977999999999997e-05 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1206 3.25 e57/18 3:a4e08847:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.9160017520000001, 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012954914, 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430036+0000", 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.588e-06 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432756+0000", 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002719193 2024-05-09T09:54:31.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432795+0000", 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9002999999999999e-05 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432819+0000", 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4297000000000001e-05 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432978+0000", 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015920600000000001 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.433026+0000", 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8334000000000002e-05 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.442929+0000", 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099025769999999992 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.442989+0000", 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9716000000000002e-05 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1213 3.22 e58/18 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head v 58'2, mlcod=0'0)", 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5250584050000002, 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016947308000000001, 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.432 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820978+0000", 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826413+0000", 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054350249999999996 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826455+0000", 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1566000000000001e-05 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826476+0000", 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1063000000000001e-05 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826622+0000", 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014660199999999999 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826668+0000", 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5655999999999998e-05 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.837818+0000", 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149862999999999 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.837924+0000", 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106673 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1215 3.33 3:cc65bbc6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:31.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4866462089999999, 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022109406000000002, 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1215 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859392+0000", 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1360000000000001e-06 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861755+0000", 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002362046 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861804+0000", 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9529e-05 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861835+0000", 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0756999999999997e-05 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861973+0000", 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013852100000000001 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.862360+0000", 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038645800000000001 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.862627+0000", 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026730999999999999 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.874089+0000", 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011461613000000001 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881319+0000", 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072307120000000003 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881418+0000", 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8450999999999996e-05 2024-05-09T09:54:31.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881499+0000", 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0872999999999996e-05 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1221 3.23 e58/18 3:c4089c73:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_9:head v 58'1, mlcod=0'0)", 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.960878+0000", 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.385157092, 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010931033, 2024-05-09T09:54:31.442 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.960878+0000", 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.960878+0000", 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.960881+0000", 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9359999999999999e-06 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.963583+0000", 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002701171 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.963618+0000", 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5797000000000003e-05 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.963636+0000", 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7278999999999998e-05 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.963800+0000", 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000164084 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.963849+0000", 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206999999999998e-05 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.971712+0000", 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078633399999999999 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.971809+0000", 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219000000000005e-05 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1223 3.15 e58/18 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head v 58'2, mlcod=0'0)", 2024-05-09T09:54:31.446 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.3383122809999999, 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016092055000000001, 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007726+0000", 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9869999999999999e-06 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.012919+0000", 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051927040000000002 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.012974+0000", 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4546000000000003e-05 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013001+0000", 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6999999999999999e-05 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013171+0000", 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017040499999999999 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013213+0000", 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2521999999999997e-05 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.023734+0000", 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010520275000000001 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.023815+0000", 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1615999999999999e-05 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.450 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1232 3.33 3:ce18f40e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.163591523, 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021268321, 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.451 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1232 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182448+0000", 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1459999999999998e-06 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186106+0000", 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036576820000000002 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186155+0000", 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8996999999999999e-05 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186176+0000", 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1039e-05 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186355+0000", 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000178798 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186637+0000", 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028261600000000002 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186880+0000", 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242217 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.194753+0000", 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078735599999999999 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203542+0000", 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087893880000000004 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203638+0000", 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5144999999999998e-05 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203712+0000", 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4733000000000004e-05 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1238 3.7 3:e3e1647b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:31.456 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.0440924460000001, 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014927154999999999, 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1238 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301946+0000", 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5560000000000002e-06 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303895+0000", 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001949805 2024-05-09T09:54:31.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303943+0000", 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7348999999999997e-05 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303963+0000", 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0177e-05 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304104+0000", 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014087299999999999 2024-05-09T09:54:31.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304267+0000", 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016336000000000001 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304761+0000", 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049361700000000001 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.313656+0000", 2024-05-09T09:54:31.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088949960000000005 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316758+0000", 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003102399 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316824+0000", 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5639e-05 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316870+0000", 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6384000000000002e-05 2024-05-09T09:54:31.461 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.462 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.462 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:31.462 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:31.462 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:31.463 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:31.464 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:31.462+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:31.546 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.9 2024-05-09T09:54:31.546 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:31.546 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 10 2024-05-09T09:54:31.563 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:31.562+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:31.599 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:31.599 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:31.599 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:31.599 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:31.613 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:31.617 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-05-09T09:54:31.617 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-05-09T09:54:31.617 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.069454 s, 1.5 GB/s 2024-05-09T09:54:31.665 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:31.663+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:31.766 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:31.762+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:31.778 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:31.779 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:31.779 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:31.779 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:31.779 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:31.795 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:31.867 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:31.867+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:31.968 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:31.968 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:31.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:31.968 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:31.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.845619072000005, 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019579709000000001, 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 43 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:31.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119950+0000", 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119985+0000", 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4941999999999999e-05 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120018+0000", 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179999999999997e-05 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120040+0000", 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2432000000000001e-05 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120194+0000", 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015399700000000001 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120215+0000", 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0886e-05 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139214+0000", 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018999381999999999 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139526+0000", 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031177000000000001 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.973 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.763369101999999, 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787665, 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:31.974 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 211 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202200+0000", 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202215+0000", 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5656999999999999e-05 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202254+0000", 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8506e-05 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202272+0000", 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8300000000000001e-05 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202427+0000", 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015497699999999999 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202662+0000", 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234928 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.203104+0000", 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000442151 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.204510+0000", 2024-05-09T09:54:31.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014061329999999999 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205816+0000", 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013059009999999999 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205907+0000", 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0841000000000007e-05 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205984+0000", 2024-05-09T09:54:31.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7164999999999997e-05 2024-05-09T09:54:31.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:31.980 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:31.980 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:31.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.980 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:31.980 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:31.980 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.688049277999994, 2024-05-09T09:54:31.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034049729999999999, 2024-05-09T09:54:31.981 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:31.981 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:31.981 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:31.981 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:31.982 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.982 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 232 2024-05-09T09:54:31.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.982 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:31.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:31.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:31.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277519+0000", 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277531+0000", 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2320000000000001e-05 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277564+0000", 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2669999999999997e-05 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277579+0000", 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5415999999999999e-05 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277729+0000", 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014924 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277957+0000", 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022849599999999999 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.278368+0000", 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041114500000000002 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.279935+0000", 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015665290000000001 2024-05-09T09:54:31.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280758+0000", 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082300099999999996 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280850+0000", 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1978000000000006e-05 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280921+0000", 2024-05-09T09:54:31.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1527999999999997e-05 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:281 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.659721349999998, 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030930129999999999, 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:31.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 281 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:31.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305847+0000", 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3300000000000001e-06 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305858+0000", 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.099e-05 2024-05-09T09:54:31.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305882+0000", 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4026999999999999e-05 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305905+0000", 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3376000000000001e-05 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306060+0000", 2024-05-09T09:54:31.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154757 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306388+0000", 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032792699999999999 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:31.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.307138+0000", 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074994099999999995 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308466+0000", 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013284569999999999 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308604+0000", 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137677 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:31.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308776+0000", 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017272000000000001 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308937+0000", 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016081099999999999 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:360 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:31.994 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.646428035, 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038853109999999998, 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 360 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:31.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319140+0000", 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.057e-06 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319151+0000", 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319180+0000", 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8578999999999999e-05 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319200+0000", 2024-05-09T09:54:31.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0236000000000001e-05 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319337+0000", 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013646400000000001 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319617+0000", 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028014499999999998 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.320147+0000", 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052992600000000001 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321598+0000", 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014515820000000001 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:31.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322829+0000", 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012307959999999999 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322925+0000", 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5494000000000004e-05 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323023+0000", 2024-05-09T09:54:32.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8292e-05 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:378 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.641382086999997, 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036244110000000001, 2024-05-09T09:54:32.001 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 378 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324187+0000", 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999999e-06 2024-05-09T09:54:32.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324203+0000", 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.609e-05 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324240+0000", 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7052999999999999e-05 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324262+0000", 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2195999999999999e-05 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324396+0000", 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013415700000000001 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324628+0000", 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023225200000000001 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325138+0000", 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050956299999999999 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.326372+0000", 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012345489999999999 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327556+0000", 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011832430000000001 2024-05-09T09:54:32.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327701+0000", 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014539699999999999 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327808+0000", 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106835 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.626024521000005, 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876559999999998, 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.008 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 406 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339543+0000", 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2570000000000002e-06 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339553+0000", 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339576+0000", 2024-05-09T09:54:32.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2857000000000002e-05 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339591+0000", 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4905e-05 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339738+0000", 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014698599999999999 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340100+0000", 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036169499999999999 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340703+0000", 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060361099999999999 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342128+0000", 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014245690000000001 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342467+0000", 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033892500000000001 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342554+0000", 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7527000000000004e-05 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342629+0000", 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4580999999999996e-05 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:438 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'3, mlcod=30'1)", 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.605636066000002, 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036072999999999999, 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.014 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359931+0000", 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.891e-06 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359945+0000", 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359978+0000", 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2465000000000002e-05 2024-05-09T09:54:32.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359996+0000", 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360123+0000", 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012710900000000001 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360164+0000", 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0719000000000001e-05 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363453+0000", 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003289555 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363537+0000", 2024-05-09T09:54:32.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3535999999999994e-05 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:443 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'4, mlcod=30'2)", 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.600653264000002, 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034263010000000001, 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364914+0000", 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-06 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364925+0000", 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628000000000001e-05 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364948+0000", 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3594000000000001e-05 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364960+0000", 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2017e-05 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365077+0000", 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116706 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365114+0000", 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6908e-05 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368217+0000", 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031027820000000001 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368339+0000", 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121989 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.569969592999996, 2024-05-09T09:54:32.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028199750000000002, 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 499 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395598+0000", 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0470000000000001e-06 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395609+0000", 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1083e-05 2024-05-09T09:54:32.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395631+0000", 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1953000000000001e-05 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395644+0000", 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2860000000000001e-05 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395771+0000", 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127231 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395990+0000", 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000218779 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.396428+0000", 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000437854 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.397598+0000", 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011703239999999999 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398222+0000", 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062386500000000003 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398324+0000", 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010160100000000001 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398416+0000", 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2378000000000002e-05 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.483551136000003, 2024-05-09T09:54:32.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085482570000000001, 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 633 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482016+0000", 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9300000000000002e-06 2024-05-09T09:54:32.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482024+0000", 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0630000000000006e-06 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482042+0000", 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7713000000000001e-05 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482053+0000", 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1246e-05 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482171+0000", 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117465 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482382+0000", 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000210719 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482853+0000", 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047157999999999998 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.485997+0000", 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031434620000000001 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490455+0000", 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004458414 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490516+0000", 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0488000000000001e-05 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490563+0000", 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.035 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.413884848999999, 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787257, 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.036 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 709 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551683+0000", 2024-05-09T09:54:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4059999999999999e-06 2024-05-09T09:54:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551696+0000", 2024-05-09T09:54:32.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:32.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551725+0000", 2024-05-09T09:54:32.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8890999999999998e-05 2024-05-09T09:54:32.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551743+0000", 2024-05-09T09:54:32.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7878999999999999e-05 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551889+0000", 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014628199999999999 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552237+0000", 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034787300000000001 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552746+0000", 2024-05-09T09:54:32.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050886300000000002 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.554142+0000", 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013964120000000001 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555320+0000", 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001177974 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555400+0000", 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9468000000000006e-05 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555468+0000", 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8511999999999997e-05 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:32.043 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.376040943000007, 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028728, 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 727 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.044 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589527+0000", 2024-05-09T09:54:32.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356e-06 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589538+0000", 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1463e-05 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589571+0000", 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589592+0000", 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1219000000000001e-05 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589739+0000", 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147424 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590004+0000", 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264632 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590346+0000", 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034226299999999999 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592098+0000", 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001752116 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592249+0000", 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015033000000000001 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592335+0000", 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5890999999999995e-05 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592397+0000", 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2966000000000007e-05 2024-05-09T09:54:32.049 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.372274828000002, 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031054329999999999, 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.050 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 729 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593292+0000", 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.344e-06 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593300+0000", 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5229999999999998e-06 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593321+0000", 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1299999999999999e-05 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593339+0000", 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8206000000000002e-05 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593428+0000", 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8928e-05 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593547+0000", 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118794 2024-05-09T09:54:32.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593824+0000", 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027681500000000003 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.595408+0000", 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001584086 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596242+0000", 2024-05-09T09:54:32.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083392999999999998 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596333+0000", 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0878000000000006e-05 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596396+0000", 2024-05-09T09:54:32.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3628999999999997e-05 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.270494077999999, 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031859179999999998, 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.056 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 775 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:32.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695074+0000", 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.723e-06 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695086+0000", 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1457000000000001e-05 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695117+0000", 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1343000000000001e-05 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695138+0000", 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0622999999999999e-05 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695261+0000", 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123621 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695596+0000", 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033511000000000001 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.696142+0000", 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054512500000000004 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.697459+0000", 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013177480000000001 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698089+0000", 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063017800000000001 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698179+0000", 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9511000000000004e-05 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698257+0000", 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8479000000000005e-05 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.061 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.179722866999995, 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002852074, 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.062 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 814 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785845+0000", 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785856+0000", 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1323e-05 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785887+0000", 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0602999999999998e-05 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785901+0000", 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4612e-05 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786031+0000", 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012920100000000001 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786246+0000", 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021583299999999999 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786562+0000", 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031516999999999998 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.787822+0000", 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001260359 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788501+0000", 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067859300000000001 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788589+0000", 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7961999999999996e-05 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788695+0000", 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106258 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.022502121000002, 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029203889999999998, 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 880 2024-05-09T09:54:32.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943067+0000", 2024-05-09T09:54:32.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1870000000000001e-06 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943079+0000", 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2319e-05 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943111+0000", 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1779999999999997e-05 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943126+0000", 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285999999999999e-05 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943239+0000", 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112631 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943472+0000", 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023326299999999999 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943790+0000", 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031812600000000001 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.944926+0000", 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011362519999999999 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945815+0000", 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088909199999999996 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945906+0000", 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0997999999999998e-05 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945984+0000", 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7454999999999996e-05 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.073 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 73.015277497, 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028357909999999998, 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 883 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950290+0000", 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3e-06 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950303+0000", 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.261e-05 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950334+0000", 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950354+0000", 2024-05-09T09:54:32.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9865999999999999e-05 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950487+0000", 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950710+0000", 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223002 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.951056+0000", 2024-05-09T09:54:32.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034612999999999999 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952129+0000", 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010729820000000001 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952975+0000", 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00084584999999999999 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953059+0000", 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4371999999999998e-05 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953124+0000", 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4412000000000006e-05 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.945574691999994, 2024-05-09T09:54:32.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028784679999999999, 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 913 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019993+0000", 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3769999999999999e-06 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020005+0000", 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1797000000000001e-05 2024-05-09T09:54:32.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020036+0000", 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0876000000000001e-05 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020051+0000", 2024-05-09T09:54:32.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4739000000000001e-05 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020163+0000", 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112432 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020385+0000", 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022189200000000001 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020709+0000", 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032386699999999998 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.021761+0000", 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051979 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022727+0000", 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096616099999999999 2024-05-09T09:54:32.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022805+0000", 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8009000000000005e-05 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022869+0000", 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4338999999999995e-05 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.085 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 72.908620245999998, 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00285995, 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 928 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.086 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056947+0000", 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.81e-06 2024-05-09T09:54:32.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056957+0000", 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5829999999999996e-06 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056980+0000", 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3278999999999999e-05 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056992+0000", 2024-05-09T09:54:32.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2437e-05 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057171+0000", 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017842199999999999 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057393+0000", 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022195 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057705+0000", 2024-05-09T09:54:32.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000311687 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.058914+0000", 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012093029999999999 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059652+0000", 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073784800000000004 2024-05-09T09:54:32.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059738+0000", 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6231999999999997e-05 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059805+0000", 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7398999999999996e-05 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.091 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.092 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:32.092 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:31.967+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:32.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:32.094 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:32.091+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:32.193 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:32.190+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:32.228 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:32.228 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:32.229 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:32.229 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:32.243 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:32.295 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:32.295+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:32.395 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:32.394+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:32.410 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:32.410 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:32.411 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:32.428 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:32.459 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:54:32.519 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:32.518+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:32.597 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:32.594+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1161 3.1d 3:b8b74cb5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.0828931749999997, 2024-05-09T09:54:32.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020326487000000001, 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1161 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518545+0000", 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639999999999998e-06 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522778+0000", 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042321429999999998 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522816+0000", 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624000000000002e-05 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522834+0000", 2024-05-09T09:54:32.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-05-09T09:54:32.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522974+0000", 2024-05-09T09:54:32.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:32.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523215+0000", 2024-05-09T09:54:32.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024094700000000001 2024-05-09T09:54:32.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:32.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523432+0000", 2024-05-09T09:54:32.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217333 2024-05-09T09:54:32.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.532230+0000", 2024-05-09T09:54:32.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087981150000000004 2024-05-09T09:54:32.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538624+0000", 2024-05-09T09:54:32.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063944249999999996 2024-05-09T09:54:32.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538717+0000", 2024-05-09T09:54:32.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2608999999999994e-05 2024-05-09T09:54:32.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538867+0000", 2024-05-09T09:54:32.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150357 2024-05-09T09:54:32.611 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.611 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.611 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.611 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1164 3.2a 3:563cc67e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:32.611 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:32.612 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.0410989229999998, 2024-05-09T09:54:32.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023925154000000001, 2024-05-09T09:54:32.612 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.612 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.612 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.613 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1164 2024-05-09T09:54:32.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.613 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:32.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:32.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560338+0000", 2024-05-09T09:54:32.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2499999999999998e-06 2024-05-09T09:54:32.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564645+0000", 2024-05-09T09:54:32.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043069290000000001 2024-05-09T09:54:32.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564681+0000", 2024-05-09T09:54:32.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5746e-05 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564697+0000", 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6269999999999998e-05 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564822+0000", 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012474099999999999 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565074+0000", 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025190400000000001 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565300+0000", 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226133 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.572636+0000", 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073360760000000004 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584083+0000", 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011446424 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584177+0000", 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4518999999999994e-05 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584260+0000", 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3162000000000001e-05 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1178 3.37 e57/18 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.8788820040000003, 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025242840999999999, 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.620 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722556+0000", 2024-05-09T09:54:32.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5159999999999999e-06 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728655+0000", 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060999039999999997 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728694+0000", 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8009999999999997e-05 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728710+0000", 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6880000000000001e-05 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728899+0000", 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018883699999999999 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728968+0000", 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9041999999999994e-05 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747653+0000", 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018684905000000002 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747795+0000", 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014174700000000001 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1198 3.16 3:6968f1e0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:32.624 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.2937724619999997, 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015069340000000001, 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1198 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307664+0000", 2024-05-09T09:54:32.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7329999999999999e-06 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311411+0000", 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037470200000000002 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311443+0000", 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311460+0000", 2024-05-09T09:54:32.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6690000000000001e-05 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311571+0000", 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011076100000000001 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311723+0000", 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015242399999999999 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311851+0000", 2024-05-09T09:54:32.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127878 2024-05-09T09:54:32.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.318523+0000", 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066716960000000004 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322606+0000", 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040829669999999998 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322659+0000", 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3491e-05 2024-05-09T09:54:32.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322731+0000", 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1793999999999997e-05 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1200 3.22 3:47cf0652:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.2615167649999997, 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016902618000000001, 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.631 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1200 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339920+0000", 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0230000000000001e-06 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343641+0000", 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037201949999999999 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343670+0000", 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9706999999999999e-05 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343682+0000", 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2264e-05 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343761+0000", 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8629999999999998e-05 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343899+0000", 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013740599999999999 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.344011+0000", 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112305 2024-05-09T09:54:32.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.350517+0000", 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065057780000000003 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356651+0000", 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061347459999999999 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356749+0000", 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7813999999999996e-05 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356820+0000", 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0749999999999999e-05 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1201 3.2a 3:54ff7f97:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.2532532859999996, 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020960774000000001, 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.637 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348183+0000", 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9889999999999999e-06 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352065+0000", 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038826189999999999 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352086+0000", 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0407e-05 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352100+0000", 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3745e-05 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352173+0000", 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3335000000000002e-05 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352330+0000", 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015688400000000001 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352462+0000", 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013203100000000001 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.365714+0000", 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013252553 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.368997+0000", 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032823800000000001 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369079+0000", 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2639999999999995e-05 2024-05-09T09:54:32.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369142+0000", 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2191000000000001e-05 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1205 3.c 3:33072649:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.193386974, 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016563870000000001, 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.643 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1205 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408049+0000", 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1840000000000002e-06 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411807+0000", 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003758188 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411838+0000", 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0171e-05 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411853+0000", 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5107e-05 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411933+0000", 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0049999999999994e-05 2024-05-09T09:54:32.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.412059+0000", 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012650000000000001 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.412166+0000", 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010712 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.418296+0000", 2024-05-09T09:54:32.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061291610000000002 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424417+0000", 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061217390000000002 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424511+0000", 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3738000000000003e-05 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424611+0000", 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9912000000000002e-05 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1213 3.22 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.78546665, 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022416997000000001, 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.649 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1213 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815970+0000", 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6079999999999998e-06 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819807+0000", 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038369699999999999 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819837+0000", 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0423999999999999e-05 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819850+0000", 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2594e-05 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819953+0000", 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102543 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820186+0000", 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023374800000000001 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820600+0000", 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041405700000000001 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.833246+0000", 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012645854 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838263+0000", 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050170529999999996 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838332+0000", 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9202000000000006e-05 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838384+0000", 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1944000000000003e-05 2024-05-09T09:54:32.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1218 3.1f e58/18 3:fb5d7f81:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_6:head v 58'1, mlcod=0'0)", 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.6995722369999999, 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017606534, 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901864+0000", 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4169999999999999e-06 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907193+0000", 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053291229999999998 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907243+0000", 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.914e-05 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907269+0000", 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6982e-05 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907404+0000", 2024-05-09T09:54:32.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907441+0000", 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7036000000000003e-05 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919377+0000", 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011935871000000001 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919468+0000", 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1355999999999997e-05 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1219 3.c 3:32502fcd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.6835806870000001, 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016710821000000001, 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.659 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1219 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.660 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917856+0000", 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0539999999999999e-06 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923017+0000", 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051609450000000001 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923052+0000", 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4369999999999998e-05 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923070+0000", 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8637000000000001e-05 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923167+0000", 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6708999999999999e-05 2024-05-09T09:54:32.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923390+0000", 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223372 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923603+0000", 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212847 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.931054+0000", 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074508279999999996 2024-05-09T09:54:32.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934408+0000", 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033535850000000001 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934495+0000", 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6945000000000002e-05 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934564+0000", 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9529000000000005e-05 2024-05-09T09:54:32.664 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1224 3.16 3:6a153b4c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.5879429429999998, 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017301769000000002, 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.665 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1224 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013494+0000", 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6900000000000001e-06 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017322+0000", 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038277820000000001 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017347+0000", 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5758e-05 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017361+0000", 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4113e-05 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017456+0000", 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.501e-05 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017598+0000", 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014114100000000001 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017722+0000", 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012439800000000001 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.027953+0000", 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010230888 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030697+0000", 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027437540000000002 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030751+0000", 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4379000000000002e-05 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030793+0000", 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1234 3.2f 3:f547a26d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:32.670 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.3644444729999998, 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021134344999999999, 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1234 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236992+0000", 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.12e-06 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.240966+0000", 2024-05-09T09:54:32.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039738539999999998 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241001+0000", 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5169999999999997e-05 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241018+0000", 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7523000000000001e-05 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241186+0000", 2024-05-09T09:54:32.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016797099999999999 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241562+0000", 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037583099999999997 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241922+0000", 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036000099999999998 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.255413+0000", 2024-05-09T09:54:32.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013490925000000001 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.257956+0000", 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025432250000000001 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258047+0000", 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1108999999999998e-05 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258124+0000", 2024-05-09T09:54:32.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6616e-05 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1235 3.16 3:6ba36f9f:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.3432824050000001, 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01677847, 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1235 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258154+0000", 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.08e-06 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.261982+0000", 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038285400000000001 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262012+0000", 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9213999999999998e-05 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262027+0000", 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5096000000000001e-05 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262139+0000", 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112768 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262308+0000", 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016902200000000001 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262450+0000", 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014123900000000001 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.272081+0000", 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096315700000000008 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274825+0000", 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027440780000000001 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274885+0000", 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9351999999999997e-05 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274930+0000", 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5510999999999998e-05 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1354 3.2f 3:f6a59ae0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.3926880910000001, 2024-05-09T09:54:32.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019275487000000001, 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1354 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208748+0000", 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4569999999999999e-06 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212622+0000", 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038735649999999998 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212658+0000", 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5709e-05 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212674+0000", 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6373000000000001e-05 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212860+0000", 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000185479 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213131+0000", 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027101700000000002 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213376+0000", 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024525700000000003 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.220719+0000", 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073430400000000003 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227786+0000", 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070674259999999999 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227893+0000", 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106884 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.228021+0000", 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012828000000000001 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1370 3.2a 3:57f66698:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.3139687170000001, 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017490545, 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.687 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1370 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287469+0000", 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3100000000000001e-06 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291476+0000", 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040070310000000003 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291514+0000", 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8658999999999997e-05 2024-05-09T09:54:32.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291533+0000", 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8233e-05 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291658+0000", 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012539100000000001 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291923+0000", 2024-05-09T09:54:32.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026470999999999998 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.292151+0000", 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022856800000000001 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.303534+0000", 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01138313 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304784+0000", 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012494400000000001 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304880+0000", 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5721000000000001e-05 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304956+0000", 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6352000000000004e-05 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1377 3.5 3:a124be72:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.200295863, 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016238164999999999, 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1377 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401142+0000", 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6859999999999999e-06 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405159+0000", 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004016609 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405198+0000", 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9752000000000002e-05 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405224+0000", 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5346000000000001e-05 2024-05-09T09:54:32.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405406+0000", 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000182516 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405651+0000", 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024484700000000002 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405882+0000", 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023145500000000001 2024-05-09T09:54:32.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.414967+0000", 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090847770000000005 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417077+0000", 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021101869999999999 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417255+0000", 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017720299999999999 2024-05-09T09:54:32.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417376+0000", 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121787 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1380 3.5 3:a201732c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.160235517, 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016810110999999999, 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.698 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1380 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441202+0000", 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9699999999999999e-06 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446791+0000", 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055891669999999999 2024-05-09T09:54:32.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446824+0000", 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3256000000000001e-05 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446840+0000", 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5977e-05 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446989+0000", 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014906899999999999 2024-05-09T09:54:32.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.447226+0000", 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023668800000000001 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.447457+0000", 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231781 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.455200+0000", 2024-05-09T09:54:32.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077425940000000002 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.457806+0000", 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026058909999999999 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.457902+0000", 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6105000000000002e-05 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.458009+0000", 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106613 2024-05-09T09:54:32.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1394 3.1d 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.65352503500000003, 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021946568999999999, 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1394 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947912+0000", 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5979999999999999e-06 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952060+0000", 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041480270000000003 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952101+0000", 2024-05-09T09:54:32.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0948999999999997e-05 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952129+0000", 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8634999999999999e-05 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952302+0000", 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017274599999999999 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952559+0000", 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025720799999999998 2024-05-09T09:54:32.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952811+0000", 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252124 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.961321+0000", 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085092090000000002 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969641+0000", 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083202880000000003 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969737+0000", 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6642000000000001e-05 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969856+0000", 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118143 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.709 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1404 3.2a 3:55508e05:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.42744342699999999, 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017081753000000002, 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:32.710 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173994+0000", 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2959999999999999e-06 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178574+0000", 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045802669999999998 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178621+0000", 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6576000000000003e-05 2024-05-09T09:54:32.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178647+0000", 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5908999999999999e-05 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178778+0000", 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131571 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178929+0000", 2024-05-09T09:54:32.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015090399999999999 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.179051+0000", 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012210699999999999 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.185995+0000", 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069436799999999998 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:32.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.190973+0000", 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049780609999999998 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.191032+0000", 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8915000000000001e-05 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.191072+0000", 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0466999999999997e-05 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1407 3.17 e59/18 3:e9776743:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_17:head v 59'5, mlcod=58'3)", 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.36500930700000001, 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015177110000000001, 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236427+0000", 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4260000000000002e-06 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242600+0000", 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061732749999999998 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242643+0000", 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2076000000000002e-05 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242666+0000", 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3689e-05 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242845+0000", 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000178512 2024-05-09T09:54:32.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242887+0000", 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2503000000000003e-05 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.251544+0000", 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0086570750000000002 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.251602+0000", 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7553999999999998e-05 2024-05-09T09:54:32.719 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.720 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.720 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.720 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:32.720 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:32.720 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:32.721 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:32.722 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:32.718+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:32.822 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:32.818+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:32.896 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:32.896 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:32.896 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:32.896 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:32.910 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:32.923 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:32.923+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:32.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:33.024 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:33.022+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:33.071 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:33.072 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:33.072 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:33.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:33.120 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:33.121 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:33.131 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:33.130+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:33.139 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:33.139 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:33.156 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:33.157 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:33.174 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:33.174 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:33.192 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:33.192 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:33.215 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:33.216 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:33.225 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:33.223+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:33.238 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:33.238 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:33.259 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:33.259 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:33.262 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:33.262 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:33.276 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:33.327 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:33.326+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:33.405 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:33.405 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:33.422 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:33.467 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:33.466+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:33.473 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:54:33.528 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:33.527+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:33.586 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:33.586 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:33.600 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:33.628 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:33.627+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:33.726 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:33.726 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:33.729 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:33.727+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:33.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:33.830 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:33.831+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:33.869 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:33.869 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:33.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:33.970 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:33.971+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:34.032 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:34.030+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:34.049 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:34.050 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:34.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:34.150 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:34.151+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:34.231 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:34.231 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:34.234 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:34.230+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:34.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:34.335 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:34.335+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:34.417 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:34.417 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:34.432 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:34.474 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:34.475+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:34.537 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:34.538+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:34.594 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:34.594 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:34.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:34.638 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:34.634+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:34.736 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:34.736 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:34.739 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:34.739+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:34.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:34.840 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:34.839+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:34.932 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:34.932 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:34.940 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:34.938+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:34.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:35.041 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:35.038+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:35.125 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:35.125 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:35.140 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:35.141 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:35.138+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:35.243 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:35.242+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:35.267 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:35.267 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:35.279 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:35.281 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:35.344 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:35.342+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:35.444 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:35.445 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:35.445 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:35.442+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:35.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:35.469 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:35.469 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:35.489 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:35.489 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:35.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:54:35.507 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:35.507 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:35.526 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:35.526 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:35.545 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:35.543+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:35.549 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:35.549 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:35.574 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:35.574 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:35.589 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:35.589 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:35.589 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:35.590 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:35.590 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:35.597 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:35.598 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:35.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:35.634 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:35.635 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:35.646 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:35.646+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:35.747 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:35.747+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:35.760 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:35.760 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 77.587065827999993, 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:35.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1170 3.33 3:cee14352:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.1273336090000008, 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020472503, 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1170 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.767 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631408+0000", 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.106e-06 2024-05-09T09:54:35.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634073+0000", 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026654909999999999 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634103+0000", 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9717999999999999e-05 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634119+0000", 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6231000000000001e-05 2024-05-09T09:54:35.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634204+0000", 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4588999999999999e-05 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634365+0000", 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634467+0000", 2024-05-09T09:54:35.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102076 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.640780+0000", 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063121749999999997 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651757+0000", 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010977489 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651824+0000", 2024-05-09T09:54:35.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6907000000000002e-05 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651877+0000", 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3063999999999999e-05 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1179 3.15 e57/18 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head v 57'1, mlcod=0'0)", 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.0229828330000004, 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012942011999999999, 2024-05-09T09:54:35.772 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735757+0000", 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6899999999999999e-06 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741210+0000", 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054525679999999997 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741231+0000", 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1753e-05 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741241+0000", 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2669999999999995e-06 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741314+0000", 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3289999999999998e-05 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741341+0000", 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6976000000000001e-05 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.748649+0000", 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00730834 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.748697+0000", 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8127999999999997e-05 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1182 3.24 3:2729f60c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:35.776 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.9985212000000008, 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012696430999999999, 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1182 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:35.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760219+0000", 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.418e-06 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761604+0000", 2024-05-09T09:54:35.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001384531 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761636+0000", 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1958999999999997e-05 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761649+0000", 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.349e-05 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761741+0000", 2024-05-09T09:54:35.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1250999999999998e-05 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761925+0000", 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184644 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.762468+0000", 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054271699999999996 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772380+0000", 2024-05-09T09:54:35.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099119689999999996 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772840+0000", 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045971400000000001 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772882+0000", 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2667000000000003e-05 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772913+0000", 2024-05-09T09:54:35.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1071000000000001e-05 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1187 3.33 3:cfd58a24:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.6054724070000006, 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018610282999999998, 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1187 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153270+0000", 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.386e-06 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156128+0000", 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028576029999999998 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156181+0000", 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3306000000000001e-05 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156209+0000", 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263e-05 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156349+0000", 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013982099999999999 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156592+0000", 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024288700000000001 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156811+0000", 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021942700000000001 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.162923+0000", 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061111170000000001 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171805+0000", 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088825099999999997 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171845+0000", 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0179000000000003e-05 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171876+0000", 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0784000000000002e-05 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.787 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1189 3.27 3:e771d36d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.5712513860000001, 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014679329, 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1189 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187489+0000", 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7300000000000001e-06 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189331+0000", 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018411689999999999 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189381+0000", 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0735999999999997e-05 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189408+0000", 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6443000000000001e-05 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189521+0000", 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112979 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189702+0000", 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018166499999999999 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189798+0000", 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5571999999999999e-05 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.194700+0000", 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049020970000000002 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202064+0000", 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073640809999999998 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202115+0000", 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0803000000000001e-05 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202166+0000", 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1054000000000003e-05 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1206 3.25 e57/18 3:a4e08847:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.3287043250000004, 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012954914, 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430036+0000", 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.588e-06 2024-05-09T09:54:35.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432756+0000", 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002719193 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432795+0000", 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9002999999999999e-05 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432819+0000", 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4297000000000001e-05 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432978+0000", 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015920600000000001 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.433026+0000", 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8334000000000002e-05 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.442929+0000", 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099025769999999992 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.442989+0000", 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9716000000000002e-05 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1213 3.22 e58/18 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head v 58'2, mlcod=0'0)", 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.937760978, 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016947308000000001, 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.797 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820978+0000", 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826413+0000", 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054350249999999996 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826455+0000", 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1566000000000001e-05 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826476+0000", 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1063000000000001e-05 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826622+0000", 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014660199999999999 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826668+0000", 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5655999999999998e-05 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.837818+0000", 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149862999999999 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.837924+0000", 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106673 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1215 3.33 3:cc65bbc6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.8993487819999997, 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022109406000000002, 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1215 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859392+0000", 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1360000000000001e-06 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861755+0000", 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002362046 2024-05-09T09:54:35.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861804+0000", 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9529e-05 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861835+0000", 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0756999999999997e-05 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861973+0000", 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013852100000000001 2024-05-09T09:54:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.862360+0000", 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038645800000000001 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.862627+0000", 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026730999999999999 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.874089+0000", 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011461613000000001 2024-05-09T09:54:35.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881319+0000", 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072307120000000003 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881418+0000", 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8450999999999996e-05 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881499+0000", 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0872999999999996e-05 2024-05-09T09:54:35.806 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1223 3.15 e58/18 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head v 58'2, mlcod=0'0)", 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.7510148540000001, 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016092055000000001, 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007726+0000", 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9869999999999999e-06 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.012919+0000", 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051927040000000002 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.012974+0000", 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4546000000000003e-05 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013001+0000", 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6999999999999999e-05 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013171+0000", 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017040499999999999 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013213+0000", 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2521999999999997e-05 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.023734+0000", 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010520275000000001 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.023815+0000", 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1615999999999999e-05 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1232 3.33 3:ce18f40e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.5762940959999998, 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021268321, 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.811 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1232 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:35.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182448+0000", 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1459999999999998e-06 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186106+0000", 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036576820000000002 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186155+0000", 2024-05-09T09:54:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8996999999999999e-05 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186176+0000", 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1039e-05 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186355+0000", 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000178798 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186637+0000", 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028261600000000002 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186880+0000", 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242217 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.194753+0000", 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078735599999999999 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203542+0000", 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087893880000000004 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203638+0000", 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5144999999999998e-05 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203712+0000", 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4733000000000004e-05 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1238 3.7 3:e3e1647b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.4567950190000003, 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014927154999999999, 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1238 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301946+0000", 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5560000000000002e-06 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303895+0000", 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001949805 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303943+0000", 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7348999999999997e-05 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303963+0000", 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0177e-05 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304104+0000", 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014087299999999999 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304267+0000", 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016336000000000001 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304761+0000", 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049361700000000001 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.313656+0000", 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088949960000000005 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316758+0000", 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003102399 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316824+0000", 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5639e-05 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316870+0000", 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6384000000000002e-05 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1372 3.18 3:1b1c8ec0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.323054+0000", 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.43568388, 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003115000000001, 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.822 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1372 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.323054+0000", 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.323054+0000", 2024-05-09T09:54:35.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.323058+0000", 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5480000000000002e-06 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326205+0000", 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003147108 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326238+0000", 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3524e-05 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326252+0000", 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3179e-05 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326318+0000", 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6129000000000003e-05 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326419+0000", 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101122 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326513+0000", 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3902999999999999e-05 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.331684+0000", 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708659999999997 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.335776+0000", 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040926019999999999 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.335962+0000", 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186102 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.336057+0000", 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5031999999999994e-05 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.827 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1373 3.7 3:e129455f:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.333471+0000", 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.4252667419999998, 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024809194999999999, 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1373 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.828 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.333471+0000", 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.333471+0000", 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.333474+0000", 2024-05-09T09:54:35.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.384e-06 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.336909+0000", 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034355430000000001 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.336930+0000", 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0792e-05 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.336946+0000", 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6235999999999998e-05 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.337076+0000", 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129932 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.337384+0000", 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030786700000000003 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:35.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.337698+0000", 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031433600000000002 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.346484+0000", 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087853889999999994 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.358160+0000", 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011676466999999999 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.358230+0000", 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9197999999999997e-05 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.358281+0000", 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1051000000000003e-05 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1378 3.24 3:24775331:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.416527+0000", 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3422112479999999, 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012424197, 2024-05-09T09:54:35.833 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1378 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.416527+0000", 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.416527+0000", 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.416529+0000", 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3420000000000002e-06 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419652+0000", 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031231710000000001 2024-05-09T09:54:35.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419690+0000", 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7557e-05 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419713+0000", 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3142e-05 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419789+0000", 2024-05-09T09:54:35.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5622000000000002e-05 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419896+0000", 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107283 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419986+0000", 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9642000000000007e-05 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.425520+0000", 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055342949999999998 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.428864+0000", 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033441019999999998 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.428902+0000", 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7548e-05 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.428951+0000", 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9493000000000002e-05 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1383 3.38 3:1c4f94c2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.481823+0000", 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2769148230000003, 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014727888999999999, 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.839 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1383 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.481823+0000", 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.481823+0000", 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.481826+0000", 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0079999999999998e-06 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483561+0000", 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017345660000000001 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483590+0000", 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9263000000000001e-05 2024-05-09T09:54:35.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483607+0000", 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6759999999999999e-05 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483690+0000", 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3349000000000004e-05 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483812+0000", 2024-05-09T09:54:35.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121957 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483906+0000", 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3441000000000002e-05 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.488357+0000", 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044511280000000004 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.496423+0000", 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080660750000000007 2024-05-09T09:54:35.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.496482+0000", 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8661e-05 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.496551+0000", 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9680999999999999e-05 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.844 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1397 3.38 3:1dcfd94a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.004356+0000", 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.7543818519999999, 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020938258000000001, 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1397 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.004356+0000", 2024-05-09T09:54:35.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.004356+0000", 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.004360+0000", 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1999999999999996e-06 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.008857+0000", 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044965939999999996 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.008907+0000", 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0142999999999997e-05 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.008930+0000", 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3255999999999999e-05 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.009079+0000", 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014806199999999999 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.009339+0000", 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026093399999999999 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.009592+0000", 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025225099999999999 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.023748+0000", 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014155910000000001 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.025064+0000", 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001316743 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.025174+0000", 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109336 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.025295+0000", 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120829 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1400 3.29 3:95773e52:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.076559+0000", 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.6821786799999998, 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019146456999999999, 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.850 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1400 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.076559+0000", 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.076559+0000", 2024-05-09T09:54:35.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.076562+0000", 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.633e-06 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.079607+0000", 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003044606 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.079661+0000", 2024-05-09T09:54:35.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3899e-05 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.079688+0000", 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6993000000000001e-05 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.079860+0000", 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172325 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.080163+0000", 2024-05-09T09:54:35.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030263700000000002 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.080435+0000", 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027294999999999999 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.090276+0000", 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098400710000000006 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.095594+0000", 2024-05-09T09:54:35.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053181900000000004 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.095656+0000", 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1756999999999998e-05 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.095706+0000", 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0396000000000003e-05 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1405 3.24 3:2653ece5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.199247+0000", 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5594913459999997, 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017192691999999999, 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1405 2024-05-09T09:54:35.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.199247+0000", 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.199247+0000", 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.199251+0000", 2024-05-09T09:54:35.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8929999999999998e-06 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202284+0000", 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030333859999999999 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202332+0000", 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8293e-05 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202360+0000", 2024-05-09T09:54:35.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7829000000000001e-05 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202511+0000", 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000150896 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202771+0000", 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025946299999999998 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.203025+0000", 2024-05-09T09:54:35.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025471499999999998 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.210482+0000", 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0074566809999999997 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.216018+0000", 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055357940000000001 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.216265+0000", 2024-05-09T09:54:35.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024712300000000003 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.216439+0000", 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017461899999999999 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1408 3.33 3:ce9e4708:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.255770+0000", 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5029682649999998, 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015645157999999999, 2024-05-09T09:54:35.861 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1408 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.255770+0000", 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.255770+0000", 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.255775+0000", 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1429999999999997e-06 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.258618+0000", 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028431239999999998 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.258666+0000", 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7750000000000002e-05 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.258686+0000", 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9783e-05 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.258838+0000", 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000151998 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.259175+0000", 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000337327 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.259429+0000", 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025413999999999998 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.267296+0000", 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078668290000000005 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:35.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.271232+0000", 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039355919999999999 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.271338+0000", 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010675600000000001 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.271415+0000", 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6716000000000002e-05 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:35.867 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:35.867 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:35.868 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:35.869 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:35.870+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:35.969 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:35.966+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:36.001 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:36.001 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:36.001 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:36.001 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:36.015 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:36.107 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:36.106+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:36.171 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:36.170+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:36.187 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:36.187 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:36.187 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:36.187 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:36.187 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:36.203 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:36.291 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:36.290+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:36.371 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:36.371 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:36.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:36.371 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:36.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.371 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 83.248914159999998, 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019579709000000001, 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 43 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119950+0000", 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119985+0000", 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4941999999999999e-05 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120018+0000", 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179999999999997e-05 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120040+0000", 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2432000000000001e-05 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120194+0000", 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015399700000000001 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120215+0000", 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0886e-05 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139214+0000", 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018999381999999999 2024-05-09T09:54:36.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139526+0000", 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031177000000000001 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.166664190000006, 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787665, 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.376 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 211 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:36.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202200+0000", 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202215+0000", 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5656999999999999e-05 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202254+0000", 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8506e-05 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202272+0000", 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8300000000000001e-05 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202427+0000", 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015497699999999999 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202662+0000", 2024-05-09T09:54:36.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234928 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.203104+0000", 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000442151 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.204510+0000", 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014061329999999999 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205816+0000", 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013059009999999999 2024-05-09T09:54:36.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205907+0000", 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0841000000000007e-05 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205984+0000", 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7164999999999997e-05 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.381 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.091344366000001, 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034049729999999999, 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 232 2024-05-09T09:54:36.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277519+0000", 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277531+0000", 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2320000000000001e-05 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277564+0000", 2024-05-09T09:54:36.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2669999999999997e-05 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277579+0000", 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5415999999999999e-05 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277729+0000", 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014924 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277957+0000", 2024-05-09T09:54:36.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022849599999999999 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.278368+0000", 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041114500000000002 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.279935+0000", 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015665290000000001 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280758+0000", 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082300099999999996 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280850+0000", 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1978000000000006e-05 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280921+0000", 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1527999999999997e-05 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:281 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.063016438000005, 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030930129999999999, 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 281 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305847+0000", 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3300000000000001e-06 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305858+0000", 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.099e-05 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305882+0000", 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4026999999999999e-05 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305905+0000", 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3376000000000001e-05 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306060+0000", 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154757 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306388+0000", 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032792699999999999 2024-05-09T09:54:36.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.307138+0000", 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074994099999999995 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308466+0000", 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013284569999999999 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308604+0000", 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137677 2024-05-09T09:54:36.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308776+0000", 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017272000000000001 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308937+0000", 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016081099999999999 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.393 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:360 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.049723123000007, 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038853109999999998, 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 360 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319140+0000", 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.057e-06 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319151+0000", 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319180+0000", 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8578999999999999e-05 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319200+0000", 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0236000000000001e-05 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319337+0000", 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013646400000000001 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319617+0000", 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028014499999999998 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.320147+0000", 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052992600000000001 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321598+0000", 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014515820000000001 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322829+0000", 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012307959999999999 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322925+0000", 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5494000000000004e-05 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323023+0000", 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8292e-05 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:378 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.044677175000004, 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036244110000000001, 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.399 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 378 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324187+0000", 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999999e-06 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324203+0000", 2024-05-09T09:54:36.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.609e-05 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324240+0000", 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7052999999999999e-05 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324262+0000", 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2195999999999999e-05 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324396+0000", 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013415700000000001 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324628+0000", 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023225200000000001 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325138+0000", 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050956299999999999 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.326372+0000", 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012345489999999999 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327556+0000", 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011832430000000001 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327701+0000", 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014539699999999999 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327808+0000", 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106835 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.029319608999998, 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876559999999998, 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.405 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 406 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339543+0000", 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2570000000000002e-06 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339553+0000", 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339576+0000", 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2857000000000002e-05 2024-05-09T09:54:36.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339591+0000", 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4905e-05 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339738+0000", 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014698599999999999 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340100+0000", 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036169499999999999 2024-05-09T09:54:36.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340703+0000", 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060361099999999999 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342128+0000", 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014245690000000001 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342467+0000", 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033892500000000001 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342554+0000", 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7527000000000004e-05 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342629+0000", 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4580999999999996e-05 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.410 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:438 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'3, mlcod=30'1)", 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.008931153999995, 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036072999999999999, 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359931+0000", 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.891e-06 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359945+0000", 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:36.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359978+0000", 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2465000000000002e-05 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359996+0000", 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360123+0000", 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012710900000000001 2024-05-09T09:54:36.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360164+0000", 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0719000000000001e-05 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363453+0000", 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003289555 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363537+0000", 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3535999999999994e-05 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:443 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'4, mlcod=30'2)", 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 78.003948351999995, 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034263010000000001, 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.415 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364914+0000", 2024-05-09T09:54:36.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-06 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364925+0000", 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628000000000001e-05 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364948+0000", 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3594000000000001e-05 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364960+0000", 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2017e-05 2024-05-09T09:54:36.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365077+0000", 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116706 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365114+0000", 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6908e-05 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368217+0000", 2024-05-09T09:54:36.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031027820000000001 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368339+0000", 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121989 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.973264681000003, 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028199750000000002, 2024-05-09T09:54:36.419 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 499 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395598+0000", 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0470000000000001e-06 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395609+0000", 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1083e-05 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395631+0000", 2024-05-09T09:54:36.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1953000000000001e-05 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395644+0000", 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2860000000000001e-05 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395771+0000", 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127231 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395990+0000", 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000218779 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.396428+0000", 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000437854 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.397598+0000", 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011703239999999999 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398222+0000", 2024-05-09T09:54:36.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062386500000000003 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398324+0000", 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010160100000000001 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398416+0000", 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2378000000000002e-05 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.886846223999996, 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085482570000000001, 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 633 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482016+0000", 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9300000000000002e-06 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482024+0000", 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0630000000000006e-06 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482042+0000", 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7713000000000001e-05 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482053+0000", 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1246e-05 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482171+0000", 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117465 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482382+0000", 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000210719 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482853+0000", 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047157999999999998 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.428 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.485997+0000", 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031434620000000001 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490455+0000", 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004458414 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490516+0000", 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0488000000000001e-05 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490563+0000", 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.817179937000006, 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787257, 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.430 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 709 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551683+0000", 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4059999999999999e-06 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551696+0000", 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551725+0000", 2024-05-09T09:54:36.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8890999999999998e-05 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551743+0000", 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7878999999999999e-05 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551889+0000", 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014628199999999999 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552237+0000", 2024-05-09T09:54:36.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034787300000000001 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552746+0000", 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050886300000000002 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.554142+0000", 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013964120000000001 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555320+0000", 2024-05-09T09:54:36.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001177974 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555400+0000", 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9468000000000006e-05 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555468+0000", 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8511999999999997e-05 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.779336031, 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028728, 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 727 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589527+0000", 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356e-06 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589538+0000", 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1463e-05 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589571+0000", 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589592+0000", 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1219000000000001e-05 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589739+0000", 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147424 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590004+0000", 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264632 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590346+0000", 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034226299999999999 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592098+0000", 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001752116 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592249+0000", 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015033000000000001 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592335+0000", 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5890999999999995e-05 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592397+0000", 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2966000000000007e-05 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.775569915999995, 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031054329999999999, 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.441 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 729 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593292+0000", 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.344e-06 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593300+0000", 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5229999999999998e-06 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593321+0000", 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1299999999999999e-05 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593339+0000", 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8206000000000002e-05 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593428+0000", 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8928e-05 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593547+0000", 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118794 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593824+0000", 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027681500000000003 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.595408+0000", 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001584086 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596242+0000", 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083392999999999998 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596333+0000", 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0878000000000006e-05 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596396+0000", 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3628999999999997e-05 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.446 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.673789166000006, 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031859179999999998, 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 775 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.447 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695074+0000", 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.723e-06 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695086+0000", 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1457000000000001e-05 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695117+0000", 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1343000000000001e-05 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695138+0000", 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0622999999999999e-05 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695261+0000", 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123621 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695596+0000", 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033511000000000001 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.696142+0000", 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054512500000000004 2024-05-09T09:54:36.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.697459+0000", 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013177480000000001 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698089+0000", 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063017800000000001 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.451 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698179+0000", 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9511000000000004e-05 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698257+0000", 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8479000000000005e-05 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.583017955000003, 2024-05-09T09:54:36.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002852074, 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 814 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785845+0000", 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785856+0000", 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1323e-05 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785887+0000", 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0602999999999998e-05 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785901+0000", 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4612e-05 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786031+0000", 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012920100000000001 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786246+0000", 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021583299999999999 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786562+0000", 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031516999999999998 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.787822+0000", 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001260359 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788501+0000", 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067859300000000001 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788589+0000", 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7961999999999996e-05 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788695+0000", 2024-05-09T09:54:36.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106258 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.425797208999995, 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029203889999999998, 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.458 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 880 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943067+0000", 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1870000000000001e-06 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943079+0000", 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2319e-05 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943111+0000", 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1779999999999997e-05 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943126+0000", 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285999999999999e-05 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943239+0000", 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112631 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943472+0000", 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023326299999999999 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943790+0000", 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031812600000000001 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.944926+0000", 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011362519999999999 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945815+0000", 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088909199999999996 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.462 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945906+0000", 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0997999999999998e-05 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945984+0000", 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7454999999999996e-05 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:36.463 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.418572585000007, 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028357909999999998, 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 883 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950290+0000", 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3e-06 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950303+0000", 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.261e-05 2024-05-09T09:54:36.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950334+0000", 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950354+0000", 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9865999999999999e-05 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950487+0000", 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950710+0000", 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223002 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.951056+0000", 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034612999999999999 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952129+0000", 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010729820000000001 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952975+0000", 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00084584999999999999 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953059+0000", 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4371999999999998e-05 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953124+0000", 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4412000000000006e-05 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.468 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.348869780000001, 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028784679999999999, 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 913 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.469 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019993+0000", 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3769999999999999e-06 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020005+0000", 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1797000000000001e-05 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020036+0000", 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0876000000000001e-05 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020051+0000", 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4739000000000001e-05 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020163+0000", 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112432 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020385+0000", 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022189200000000001 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020709+0000", 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032386699999999998 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.021761+0000", 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051979 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022727+0000", 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096616099999999999 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022805+0000", 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8009000000000005e-05 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022869+0000", 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4338999999999995e-05 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 77.311915334000005, 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00285995, 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:36.474 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 928 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:36.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056947+0000", 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.81e-06 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056957+0000", 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5829999999999996e-06 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056980+0000", 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3278999999999999e-05 2024-05-09T09:54:36.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056992+0000", 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2437e-05 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057171+0000", 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017842199999999999 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057393+0000", 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022195 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057705+0000", 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000311687 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.058914+0000", 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012093029999999999 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059652+0000", 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073784800000000004 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059738+0000", 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6231999999999997e-05 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059805+0000", 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7398999999999996e-05 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:36.479 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:54:36.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:36.482 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:36.479+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:36.582 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:36.578+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:36.656 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:36.656 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:36.656 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:36.657 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:36.670 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:36.683 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:36.683+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:36.784 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:36.782+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:36.836 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:36.836 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:36.836 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:36.836 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:36.836 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:36.855 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:36.885 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:36.883+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:36.985 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:36.983+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1161 3.1d 3:b8b74cb5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.509884702000001, 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020326487000000001, 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.031 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1161 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518545+0000", 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639999999999998e-06 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522778+0000", 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042321429999999998 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522816+0000", 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624000000000002e-05 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522834+0000", 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522974+0000", 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523215+0000", 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024094700000000001 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523432+0000", 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217333 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.532230+0000", 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087981150000000004 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538624+0000", 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063944249999999996 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538717+0000", 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2608999999999994e-05 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538867+0000", 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150357 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.036 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1164 3.2a 3:563cc67e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.46809045, 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023925154000000001, 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1164 2024-05-09T09:54:37.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560338+0000", 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2499999999999998e-06 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564645+0000", 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043069290000000001 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564681+0000", 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5746e-05 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564697+0000", 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6269999999999998e-05 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564822+0000", 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012474099999999999 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565074+0000", 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025190400000000001 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565300+0000", 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226133 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.572636+0000", 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073360760000000004 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584083+0000", 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011446424 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584177+0000", 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4518999999999994e-05 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584260+0000", 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3162000000000001e-05 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1178 3.37 e57/18 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:37.042 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.305873531, 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025242840999999999, 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722556+0000", 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5159999999999999e-06 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728655+0000", 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060999039999999997 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728694+0000", 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8009999999999997e-05 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728710+0000", 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6880000000000001e-05 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728899+0000", 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018883699999999999 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728968+0000", 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9041999999999994e-05 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747653+0000", 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018684905000000002 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747795+0000", 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014174700000000001 2024-05-09T09:54:37.046 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1198 3.16 3:6968f1e0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.7207639889999999, 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015069340000000001, 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.047 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1198 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307664+0000", 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7329999999999999e-06 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311411+0000", 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037470200000000002 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311443+0000", 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311460+0000", 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6690000000000001e-05 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311571+0000", 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011076100000000001 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311723+0000", 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015242399999999999 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311851+0000", 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127878 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.318523+0000", 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066716960000000004 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322606+0000", 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040829669999999998 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322659+0000", 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3491e-05 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322731+0000", 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1793999999999997e-05 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1200 3.22 3:47cf0652:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.6885082919999999, 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016902618000000001, 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1200 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.053 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339920+0000", 2024-05-09T09:54:37.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0230000000000001e-06 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343641+0000", 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037201949999999999 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343670+0000", 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9706999999999999e-05 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343682+0000", 2024-05-09T09:54:37.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2264e-05 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343761+0000", 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8629999999999998e-05 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343899+0000", 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013740599999999999 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.344011+0000", 2024-05-09T09:54:37.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112305 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.350517+0000", 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065057780000000003 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356651+0000", 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061347459999999999 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356749+0000", 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7813999999999996e-05 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356820+0000", 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0749999999999999e-05 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1201 3.2a 3:54ff7f97:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.6802448129999998, 2024-05-09T09:54:37.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020960774000000001, 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:37.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348183+0000", 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9889999999999999e-06 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352065+0000", 2024-05-09T09:54:37.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038826189999999999 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352086+0000", 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0407e-05 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352100+0000", 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3745e-05 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352173+0000", 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3335000000000002e-05 2024-05-09T09:54:37.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352330+0000", 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015688400000000001 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352462+0000", 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013203100000000001 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.365714+0000", 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013252553 2024-05-09T09:54:37.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.368997+0000", 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032823800000000001 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369079+0000", 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2639999999999995e-05 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369142+0000", 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2191000000000001e-05 2024-05-09T09:54:37.063 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1205 3.c 3:33072649:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.6203785009999994, 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016563870000000001, 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.064 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1205 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:37.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408049+0000", 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1840000000000002e-06 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411807+0000", 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003758188 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411838+0000", 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0171e-05 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411853+0000", 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5107e-05 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411933+0000", 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0049999999999994e-05 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.412059+0000", 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012650000000000001 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.412166+0000", 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010712 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.418296+0000", 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061291610000000002 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424417+0000", 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061217390000000002 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424511+0000", 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3738000000000003e-05 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424611+0000", 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9912000000000002e-05 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1213 3.22 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.2124581770000002, 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022416997000000001, 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1213 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.070 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815970+0000", 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6079999999999998e-06 2024-05-09T09:54:37.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819807+0000", 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038369699999999999 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819837+0000", 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0423999999999999e-05 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819850+0000", 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2594e-05 2024-05-09T09:54:37.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819953+0000", 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102543 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820186+0000", 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023374800000000001 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820600+0000", 2024-05-09T09:54:37.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041405700000000001 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.833246+0000", 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012645854 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838263+0000", 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050170529999999996 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838332+0000", 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9202000000000006e-05 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838384+0000", 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1944000000000003e-05 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1218 3.1f e58/18 3:fb5d7f81:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_6:head v 58'1, mlcod=0'0)", 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.1265637640000001, 2024-05-09T09:54:37.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017606534, 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901864+0000", 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4169999999999999e-06 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907193+0000", 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053291229999999998 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907243+0000", 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.914e-05 2024-05-09T09:54:37.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907269+0000", 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6982e-05 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907404+0000", 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907441+0000", 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7036000000000003e-05 2024-05-09T09:54:37.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919377+0000", 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011935871000000001 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919468+0000", 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1355999999999997e-05 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.079 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1219 3.c 3:32502fcd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.1105722139999994, 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016710821000000001, 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1219 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917856+0000", 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0539999999999999e-06 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923017+0000", 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051609450000000001 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923052+0000", 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4369999999999998e-05 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923070+0000", 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8637000000000001e-05 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923167+0000", 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6708999999999999e-05 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923390+0000", 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223372 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923603+0000", 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212847 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.931054+0000", 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074508279999999996 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934408+0000", 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033535850000000001 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934495+0000", 2024-05-09T09:54:37.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6945000000000002e-05 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934564+0000", 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9529000000000005e-05 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1224 3.16 3:6a153b4c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.01493447, 2024-05-09T09:54:37.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017301769000000002, 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1224 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013494+0000", 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6900000000000001e-06 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017322+0000", 2024-05-09T09:54:37.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038277820000000001 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017347+0000", 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5758e-05 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017361+0000", 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4113e-05 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017456+0000", 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.501e-05 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017598+0000", 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014114100000000001 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017722+0000", 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012439800000000001 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.027953+0000", 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010230888 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030697+0000", 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027437540000000002 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030751+0000", 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4379000000000002e-05 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030793+0000", 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1234 3.2f 3:f547a26d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.7914360000000009, 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021134344999999999, 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.091 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1234 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:37.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236992+0000", 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.12e-06 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.240966+0000", 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039738539999999998 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241001+0000", 2024-05-09T09:54:37.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5169999999999997e-05 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241018+0000", 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7523000000000001e-05 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241186+0000", 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016797099999999999 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241562+0000", 2024-05-09T09:54:37.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037583099999999997 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241922+0000", 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036000099999999998 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.255413+0000", 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013490925000000001 2024-05-09T09:54:37.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.257956+0000", 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025432250000000001 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258047+0000", 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1108999999999998e-05 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258124+0000", 2024-05-09T09:54:37.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6616e-05 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1235 3.16 3:6ba36f9f:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.7702739320000003, 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01677847, 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.097 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1235 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258154+0000", 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.08e-06 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.261982+0000", 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038285400000000001 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262012+0000", 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9213999999999998e-05 2024-05-09T09:54:37.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262027+0000", 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5096000000000001e-05 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262139+0000", 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112768 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262308+0000", 2024-05-09T09:54:37.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016902200000000001 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262450+0000", 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014123900000000001 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.272081+0000", 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096315700000000008 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274825+0000", 2024-05-09T09:54:37.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027440780000000001 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274885+0000", 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9351999999999997e-05 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274930+0000", 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5510999999999998e-05 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1354 3.2f 3:f6a59ae0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.8196796180000003, 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019275487000000001, 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1354 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208748+0000", 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4569999999999999e-06 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212622+0000", 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038735649999999998 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212658+0000", 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5709e-05 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212674+0000", 2024-05-09T09:54:37.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6373000000000001e-05 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212860+0000", 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000185479 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213131+0000", 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027101700000000002 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213376+0000", 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024525700000000003 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.220719+0000", 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073430400000000003 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227786+0000", 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070674259999999999 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227893+0000", 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106884 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.228021+0000", 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012828000000000001 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1370 3.2a 3:57f66698:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:37.108 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.740960244, 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017490545, 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1370 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287469+0000", 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3100000000000001e-06 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291476+0000", 2024-05-09T09:54:37.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040070310000000003 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291514+0000", 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8658999999999997e-05 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291533+0000", 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8233e-05 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291658+0000", 2024-05-09T09:54:37.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012539100000000001 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291923+0000", 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026470999999999998 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.292151+0000", 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022856800000000001 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.303534+0000", 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01138313 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304784+0000", 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012494400000000001 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304880+0000", 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5721000000000001e-05 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304956+0000", 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6352000000000004e-05 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1377 3.5 3:a124be72:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.6272873900000002, 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016238164999999999, 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.114 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1377 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401142+0000", 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6859999999999999e-06 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405159+0000", 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004016609 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405198+0000", 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9752000000000002e-05 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405224+0000", 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5346000000000001e-05 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405406+0000", 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000182516 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405651+0000", 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024484700000000002 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405882+0000", 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023145500000000001 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.414967+0000", 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090847770000000005 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417077+0000", 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021101869999999999 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417255+0000", 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017720299999999999 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417376+0000", 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121787 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1380 3.5 3:a201732c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.119 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.5872270440000005, 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016810110999999999, 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1380 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441202+0000", 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9699999999999999e-06 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446791+0000", 2024-05-09T09:54:37.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055891669999999999 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446824+0000", 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3256000000000001e-05 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446840+0000", 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5977e-05 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446989+0000", 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014906899999999999 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.447226+0000", 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023668800000000001 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.447457+0000", 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231781 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.455200+0000", 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077425940000000002 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.457806+0000", 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026058909999999999 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.457902+0000", 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6105000000000002e-05 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.458009+0000", 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106613 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1394 3.1d 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.0805165619999997, 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021946568999999999, 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.125 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1394 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947912+0000", 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5979999999999999e-06 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952060+0000", 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041480270000000003 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952101+0000", 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0948999999999997e-05 2024-05-09T09:54:37.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952129+0000", 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8634999999999999e-05 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952302+0000", 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017274599999999999 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952559+0000", 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025720799999999998 2024-05-09T09:54:37.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952811+0000", 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252124 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.961321+0000", 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085092090000000002 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969641+0000", 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083202880000000003 2024-05-09T09:54:37.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969737+0000", 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6642000000000001e-05 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969856+0000", 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118143 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1404 3.2a 3:55508e05:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.8544349540000002, 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017081753000000002, 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173994+0000", 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2959999999999999e-06 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178574+0000", 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045802669999999998 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178621+0000", 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6576000000000003e-05 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178647+0000", 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5908999999999999e-05 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178778+0000", 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131571 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178929+0000", 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015090399999999999 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.179051+0000", 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012210699999999999 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.185995+0000", 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069436799999999998 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.190973+0000", 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049780609999999998 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.191032+0000", 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8915000000000001e-05 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.191072+0000", 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0466999999999997e-05 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1407 3.17 e59/18 3:e9776743:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_17:head v 59'5, mlcod=58'3)", 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.7920008339999995, 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015177110000000001, 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.136 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236427+0000", 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4260000000000002e-06 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242600+0000", 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061732749999999998 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242643+0000", 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2076000000000002e-05 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242666+0000", 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3689e-05 2024-05-09T09:54:37.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242845+0000", 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000178512 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242887+0000", 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2503000000000003e-05 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.251544+0000", 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0086570750000000002 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.251602+0000", 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7553999999999998e-05 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.140 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:37.141 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:37.142 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:37.139+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:37.243 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:37.241+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:37.277 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:37.277 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:37.277 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:37.277 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:37.290 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:37.343 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:37.343+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:37.444 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:37.443+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:37.467 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:37.467 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:37.467 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:37.467 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:37.467 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:37.481 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:37.545 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:37.541+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:37.607 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:37.607 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.456793371000003, 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:54:37.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:54:37.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:54:37.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:54:37.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:54:37.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1158 3.2c 3:367a58d5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.123727429000001, 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021363626, 2024-05-09T09:54:37.615 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1158 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481220+0000", 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486955+0000", 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057345460000000001 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486994+0000", 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8982e-05 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487016+0000", 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2103000000000002e-05 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487145+0000", 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012962499999999999 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487392+0000", 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024650300000000002 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487614+0000", 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022186999999999999 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.500091+0000", 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012477054 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502399+0000", 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023086449999999998 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502492+0000", 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2662000000000002e-05 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502581+0000", 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.621 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1167 3.26 3:65d9db40:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 11.009072783000001, 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021114266, 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1167 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595875+0000", 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1499999999999999e-06 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599908+0000", 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040330510000000002 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599945+0000", 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7366000000000001e-05 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599964+0000", 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199e-05 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600143+0000", 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017947500000000001 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600531+0000", 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000387914 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600968+0000", 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043724399999999999 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.615593+0000", 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014624727000000001 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616799+0000", 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012065159999999999 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616910+0000", 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110555 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616986+0000", 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6069000000000006e-05 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1170 3.33 e57/18 3:cee14352:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_14:head v 57'1, mlcod=0'0)", 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.634734+0000", 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.970211047999999, 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016742363999999999, 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.627 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.634734+0000", 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.634734+0000", 2024-05-09T09:54:37.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.634736+0000", 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639468+0000", 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047319739999999999 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639505+0000", 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6959000000000003e-05 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639523+0000", 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8070000000000001e-05 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639677+0000", 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015426799999999999 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639739+0000", 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1681999999999997e-05 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.651323+0000", 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011584347 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.651476+0000", 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015241399999999999 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1175 3.20 3:0625bb6d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:37.632 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.920322485, 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017491074999999998, 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1175 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684627+0000", 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.843e-06 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688715+0000", 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040879360000000003 2024-05-09T09:54:37.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688766+0000", 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0791999999999998e-05 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688783+0000", 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7816999999999999e-05 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688978+0000", 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019497699999999999 2024-05-09T09:54:37.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.689380+0000", 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040179099999999998 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.689741+0000", 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036100500000000002 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.700248+0000", 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010507011 2024-05-09T09:54:37.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.701823+0000", 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015747669999999999 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.701994+0000", 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017048399999999999 2024-05-09T09:54:37.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.702113+0000", 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119652 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1192 3.2c 3:37f009da:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.225283+0000", 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.37966175, 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016770698000000001, 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.638 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1192 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.225283+0000", 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.225283+0000", 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.225285+0000", 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3740000000000001e-06 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229195+0000", 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039099800000000004 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229215+0000", 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9606000000000002e-05 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229225+0000", 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0597999999999999e-05 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229311+0000", 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5424000000000001e-05 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229508+0000", 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019745400000000001 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229715+0000", 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020629099999999999 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.239190+0000", 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094751499999999999 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.241884+0000", 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026941000000000001 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.241987+0000", 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010281 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.242054+0000", 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6910999999999997e-05 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1194 3.35 3:ac539704:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.257751+0000", 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.347193580999999, 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016473048000000001, 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1194 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.257751+0000", 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.257751+0000", 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.257754+0000", 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.706e-06 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261417+0000", 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003663473 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261436+0000", 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8420999999999999e-05 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261445+0000", 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0890000000000006e-06 2024-05-09T09:54:37.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261625+0000", 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180151 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261870+0000", 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024474300000000001 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.262095+0000", 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022570000000000001 2024-05-09T09:54:37.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.271930+0000", 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098342540000000006 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.274097+0000", 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002167586 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.274155+0000", 2024-05-09T09:54:37.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7534999999999997e-05 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.274224+0000", 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9389999999999998e-05 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1208 3.a 3:5055ce64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.139494438, 2024-05-09T09:54:37.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018795551000000001, 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1208 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465453+0000", 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8609999999999998e-06 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469227+0000", 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003774281 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469250+0000", 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3156e-05 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469262+0000", 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1531e-05 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469334+0000", 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2290000000000001e-05 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469342+0000", 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1659999999999994e-06 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473383+0000", 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040406940000000001 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473477+0000", 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3929000000000001e-05 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473588+0000", 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110938 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.479810+0000", 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062221070000000002 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484173+0000", 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436265 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484212+0000", 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9322000000000001e-05 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484246+0000", 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3626e-05 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.655 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1215 3.33 e58/18 3:cc65bbc6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_3:head v 58'3, mlcod=57'1)", 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.7419706999999995, 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018005263000000001, 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:37.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9999999999999998e-07 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867905+0000", 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049302390000000003 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867938+0000", 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3309999999999998e-05 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867960+0000", 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1889999999999999e-05 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.868111+0000", 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151154 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.868155+0000", 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3545999999999999e-05 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.880884+0000", 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012729835 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.880979+0000", 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4789000000000003e-05 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1229 3.2c 3:34904b64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.4894088360000008, 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020735874000000001, 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1229 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:37.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115539+0000", 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6200000000000001e-06 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119644+0000", 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041042090000000002 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119669+0000", 2024-05-09T09:54:37.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5754000000000001e-05 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119684+0000", 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4209000000000001e-05 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119768+0000", 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4524999999999995e-05 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119922+0000", 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015423600000000001 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.120056+0000", 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013380999999999999 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.129703+0000", 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009646422 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136158+0000", 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064555810000000002 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136223+0000", 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4523999999999994e-05 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136272+0000", 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8983999999999997e-05 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1232 3.33 e58/18 3:ce18f40e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_20:head v 58'4, mlcod=57'2)", 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.187255+0000", 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.4176893340000003, 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015820357, 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.187255+0000", 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.187255+0000", 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.187257+0000", 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1059999999999998e-06 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.191944+0000", 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0046871409999999997 2024-05-09T09:54:37.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.191978+0000", 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3173000000000002e-05 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.191995+0000", 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7646e-05 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.192099+0000", 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103285 2024-05-09T09:54:37.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.192116+0000", 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7433999999999999e-05 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.202917+0000", 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010800654 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.203076+0000", 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000158918 2024-05-09T09:54:37.669 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1356 3.35 3:af70797a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.3724343210000001, 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018963760999999999, 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.670 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1356 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232514+0000", 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.237973+0000", 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054590610000000003 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238009+0000", 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188999999999998e-05 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238033+0000", 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4769999999999998e-05 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238179+0000", 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014558299999999999 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238427+0000", 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000247827 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238654+0000", 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022734200000000001 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.247463+0000", 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008808471 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251130+0000", 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036668830000000001 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251327+0000", 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000197441 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251474+0000", 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147047 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.675 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1358 3.3b 3:dc65933b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.351055508, 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017217211999999999, 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1358 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253892+0000", 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9399999999999998e-06 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.677 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259312+0000", 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054195659999999998 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259356+0000", 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4365e-05 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259384+0000", 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7662999999999999e-05 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259566+0000", 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000182246 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259813+0000", 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024673000000000002 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.260045+0000", 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023265499999999999 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.269980+0000", 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009934801 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.270919+0000", 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00093904399999999999 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.271020+0000", 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101084 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.271106+0000", 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6118000000000005e-05 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1374 3.14 e59/31 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head v 59'2, mlcod=0'0)", 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.2399421559999997, 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018480588999999999, 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365005+0000", 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9529999999999999e-06 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369409+0000", 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044040859999999998 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369451+0000", 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1128999999999999e-05 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369469+0000", 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369600+0000", 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013082 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369641+0000", 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1051999999999999e-05 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383383+0000", 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013741913999999999 2024-05-09T09:54:37.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383483+0000", 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010019200000000001 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1375 3.2c 3:35a92b62:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.2265920689999996, 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018309355999999999, 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.685 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1375 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378356+0000", 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3400000000000002e-06 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384131+0000", 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057751529999999999 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384166+0000", 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4965999999999997e-05 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384189+0000", 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3329e-05 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384311+0000", 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121914 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384551+0000", 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000239471 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384817+0000", 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026635 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.393368+0000", 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085508100000000007 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396327+0000", 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029596599999999998 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396514+0000", 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018649000000000001 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396662+0000", 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147873 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.690 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1385 3.2c 3:346c7d8b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.502042+0000", 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 6.1029026279999998, 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016667040000000001, 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1385 2024-05-09T09:54:37.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.502042+0000", 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.502042+0000", 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.502045+0000", 2024-05-09T09:54:37.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5310000000000002e-06 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506233+0000", 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041872300000000001 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506261+0000", 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8717e-05 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506277+0000", 2024-05-09T09:54:37.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5687000000000001e-05 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506409+0000", 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131996 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506664+0000", 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025508399999999999 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506945+0000", 2024-05-09T09:54:37.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028097300000000001 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.515696+0000", 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087507239999999997 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.518524+0000", 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028284120000000002 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.518628+0000", 2024-05-09T09:54:37.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103564 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.518709+0000", 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1122e-05 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1391 3.35 3:aeaf512a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.878916+0000", 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.7260282980000001, 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016127129, 2024-05-09T09:54:37.696 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1391 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.878916+0000", 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.878916+0000", 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.878920+0000", 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3529999999999999e-06 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.882943+0000", 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040234390000000002 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.882971+0000", 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7521999999999998e-05 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.882982+0000", 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.181e-05 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.883071+0000", 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9041000000000003e-05 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.883232+0000", 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016055099999999999 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.883356+0000", 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012357899999999999 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.890198+0000", 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068421810000000001 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.894930+0000", 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047322529999999996 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.894993+0000", 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2837999999999997e-05 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.895043+0000", 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0562000000000001e-05 2024-05-09T09:54:37.701 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1393 3.10 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.6817948669999998, 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02062228, 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.702 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1393 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923152+0000", 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0190000000000001e-06 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926928+0000", 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037758520000000001 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926954+0000", 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6152e-05 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926967+0000", 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2925000000000001e-05 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927050+0000", 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3015000000000004e-05 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927188+0000", 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013808000000000001 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927320+0000", 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132311 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.936936+0000", 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096158560000000008 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943673+0000", 2024-05-09T09:54:37.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067373729999999996 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943728+0000", 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5053000000000003e-05 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943772+0000", 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643999999999998e-05 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.707 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1394 3.1d e59/31 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head v 59'7, mlcod=58'5)", 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.953025+0000", 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.6519196410000001, 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016272961999999998, 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.953025+0000", 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.953025+0000", 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.953026+0000", 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5680000000000001e-06 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.955766+0000", 2024-05-09T09:54:37.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027392639999999999 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.955793+0000", 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7441e-05 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.955807+0000", 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4052e-05 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.955951+0000", 2024-05-09T09:54:37.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144041 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.956017+0000", 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5728000000000005e-05 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969204+0000", 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013187051 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969298+0000", 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3817e-05 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1403 3.a 3:53fcb7d2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.4550613239999999, 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018525527, 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:37.712 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1403 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149887+0000", 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5240000000000001e-06 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153623+0000", 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037363919999999998 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153652+0000", 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8836e-05 2024-05-09T09:54:37.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153666+0000", 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3824e-05 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153761+0000", 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4975000000000005e-05 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153967+0000", 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206085 2024-05-09T09:54:37.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.154165+0000", 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198118 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.161143+0000", 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069783700000000002 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168262+0000", 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071186340000000004 2024-05-09T09:54:37.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168343+0000", 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1044999999999994e-05 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168409+0000", 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5723999999999996e-05 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:37.717 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:37.718 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:37.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:37.719 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:37.720 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:37.717+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:37.820 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:37.817+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:37.878 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:37.878 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:37.895 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:37.895 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:37.895 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:37.896 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:37.896 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:37.896 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:37.911 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:37.915 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:37.915 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:37.933 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:37.933 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:37.953 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:37.955 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:37.953+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:37.972 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:37.972 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:37.992 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:37.992 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:38.010 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:38.010 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:38.021 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:38.017+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:38.081 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:38.081 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:38.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:38.139 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:38.137+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:38.142 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-09T09:54:38.143 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-09T09:54:38.143 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 5, 6, 7] 2024-05-09T09:54:38.143 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-05-09T09:54:38.223 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:38.223+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:38.263 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:38.263 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:38.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:38.325 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:38.323+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:38.389 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:38.390 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:38.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:38.425 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:38.421+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:38.446 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-05-09T09:54:38.443+0000 7fcc70e52640 -1 mon.a@0(leader).osd e61 definitely_dead 0 2024-05-09T09:54:38.502 INFO:teuthology.orchestra.run.smithi032.stderr:marked out osd.3. 2024-05-09T09:54:38.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:54:38.549 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:38.547+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:38.589 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:38.589 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:38.604 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:38.647 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:38.647+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:38.729 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:38.727+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:38.758 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:38.758 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:38.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:38.858 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:38.859+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:38.927 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:38.927 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:38.931 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:38.931+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:38.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:39.032 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:39.029+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:39.105 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:39.106 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:39.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:39.133 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:39.129+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:39.234 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:39.233+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:39.246 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:39.246 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:39.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:39.335 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:39.335+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:39.375 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:39.375 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:39.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:39.474 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:39.475+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:39.485 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:54:39.546 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:39.535+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:39.605 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:39.605 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:39.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:39.671 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:39.671+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:39.739 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:39.737+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:39.822 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:39.823 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:39.840 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:39.839+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:39.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:39.940 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:39.939+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:40.012 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:40.012 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:40.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:40.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:40.067 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:40.067+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:40.143 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:40.143+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:40.192 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:40.192 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:40.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:40.206 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:40.207 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:40.222 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:40.223 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:40.240 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:40.240 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:40.244 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:40.241+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:40.256 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:40.257 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:40.291 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:40.292 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:40.325 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:40.325 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:40.338 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:40.338 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:54:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:54:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:54:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 82.165918860000005, 2024-05-09T09:54:40.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013987374, 2024-05-09T09:54:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-05-09T09:54:40.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171672+0000", 2024-05-09T09:54:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171676+0000", 2024-05-09T09:54:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7230000000000002e-06 2024-05-09T09:54:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171690+0000", 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3844e-05 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171726+0000", 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5729000000000003e-05 2024-05-09T09:54:40.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171743+0000", 2024-05-09T09:54:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7370000000000001e-05 2024-05-09T09:54:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171920+0000", 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017681700000000001 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.171936+0000", 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5795999999999999e-05 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.179989+0000", 2024-05-09T09:54:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080537850000000008 2024-05-09T09:54:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.181953+0000", 2024-05-09T09:54:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019636929999999999 2024-05-09T09:54:40.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.182490+0000", 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053683400000000003 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.184415+0000", 2024-05-09T09:54:40.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019250409999999999 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185488+0000", 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0010735009999999999 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185595+0000", 2024-05-09T09:54:40.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106469 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:18.185660+0000", 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4771999999999996e-05 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1170 3.33 3:cee14352:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.706186641, 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020472503, 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.350 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1170 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:40.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631405+0000", 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.631408+0000", 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.106e-06 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634073+0000", 2024-05-09T09:54:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026654909999999999 2024-05-09T09:54:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634103+0000", 2024-05-09T09:54:40.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9717999999999999e-05 2024-05-09T09:54:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634119+0000", 2024-05-09T09:54:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6231000000000001e-05 2024-05-09T09:54:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634204+0000", 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4588999999999999e-05 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634365+0000", 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000161657 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.634467+0000", 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102076 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.640780+0000", 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063121749999999997 2024-05-09T09:54:40.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651757+0000", 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010977489 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651824+0000", 2024-05-09T09:54:40.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6907000000000002e-05 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.651877+0000", 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3063999999999999e-05 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1179 3.15 e57/18 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head v 57'1, mlcod=0'0)", 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.601835865, 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012942011999999999, 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.360 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735755+0000", 2024-05-09T09:54:40.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.735757+0000", 2024-05-09T09:54:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6899999999999999e-06 2024-05-09T09:54:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741210+0000", 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054525679999999997 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741231+0000", 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1753e-05 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741241+0000", 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2669999999999995e-06 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741314+0000", 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3289999999999998e-05 2024-05-09T09:54:40.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.741341+0000", 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6976000000000001e-05 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.748649+0000", 2024-05-09T09:54:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00730834 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.748697+0000", 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8127999999999997e-05 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1182 3.24 3:2729f60c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.577374232, 2024-05-09T09:54:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012696430999999999, 2024-05-09T09:54:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.367 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1182 2024-05-09T09:54:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760217+0000", 2024-05-09T09:54:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.760219+0000", 2024-05-09T09:54:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.418e-06 2024-05-09T09:54:40.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761604+0000", 2024-05-09T09:54:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001384531 2024-05-09T09:54:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761636+0000", 2024-05-09T09:54:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1958999999999997e-05 2024-05-09T09:54:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761649+0000", 2024-05-09T09:54:40.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.349e-05 2024-05-09T09:54:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761741+0000", 2024-05-09T09:54:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1250999999999998e-05 2024-05-09T09:54:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.761925+0000", 2024-05-09T09:54:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000184644 2024-05-09T09:54:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:40.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.762468+0000", 2024-05-09T09:54:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054271699999999996 2024-05-09T09:54:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772380+0000", 2024-05-09T09:54:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099119689999999996 2024-05-09T09:54:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772840+0000", 2024-05-09T09:54:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045971400000000001 2024-05-09T09:54:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772882+0000", 2024-05-09T09:54:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2667000000000003e-05 2024-05-09T09:54:40.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.772913+0000", 2024-05-09T09:54:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1071000000000001e-05 2024-05-09T09:54:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.378 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1187 3.33 3:cfd58a24:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.184325439, 2024-05-09T09:54:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018610282999999998, 2024-05-09T09:54:40.379 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.380 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1187 2024-05-09T09:54:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153266+0000", 2024-05-09T09:54:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.153270+0000", 2024-05-09T09:54:40.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.386e-06 2024-05-09T09:54:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156128+0000", 2024-05-09T09:54:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028576029999999998 2024-05-09T09:54:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156181+0000", 2024-05-09T09:54:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3306000000000001e-05 2024-05-09T09:54:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156209+0000", 2024-05-09T09:54:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263e-05 2024-05-09T09:54:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156349+0000", 2024-05-09T09:54:40.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013982099999999999 2024-05-09T09:54:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156592+0000", 2024-05-09T09:54:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024288700000000001 2024-05-09T09:54:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:40.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.156811+0000", 2024-05-09T09:54:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021942700000000001 2024-05-09T09:54:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.162923+0000", 2024-05-09T09:54:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061111170000000001 2024-05-09T09:54:40.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171805+0000", 2024-05-09T09:54:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088825099999999997 2024-05-09T09:54:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171845+0000", 2024-05-09T09:54:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0179000000000003e-05 2024-05-09T09:54:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.171876+0000", 2024-05-09T09:54:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0784000000000002e-05 2024-05-09T09:54:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.392 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1189 3.27 3:e771d36d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.150104418, 2024-05-09T09:54:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014679329, 2024-05-09T09:54:40.393 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1189 2024-05-09T09:54:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.394 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187487+0000", 2024-05-09T09:54:40.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.187489+0000", 2024-05-09T09:54:40.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7300000000000001e-06 2024-05-09T09:54:40.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189331+0000", 2024-05-09T09:54:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018411689999999999 2024-05-09T09:54:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189381+0000", 2024-05-09T09:54:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0735999999999997e-05 2024-05-09T09:54:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189408+0000", 2024-05-09T09:54:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6443000000000001e-05 2024-05-09T09:54:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189521+0000", 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112979 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189702+0000", 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018166499999999999 2024-05-09T09:54:40.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.189798+0000", 2024-05-09T09:54:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5571999999999999e-05 2024-05-09T09:54:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.194700+0000", 2024-05-09T09:54:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049020970000000002 2024-05-09T09:54:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202064+0000", 2024-05-09T09:54:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073640809999999998 2024-05-09T09:54:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202115+0000", 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0803000000000001e-05 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.202166+0000", 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1054000000000003e-05 2024-05-09T09:54:40.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1206 3.25 e57/18 3:a4e08847:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.907557357, 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012954914, 2024-05-09T09:54:40.403 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430034+0000", 2024-05-09T09:54:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.430036+0000", 2024-05-09T09:54:40.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.588e-06 2024-05-09T09:54:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432756+0000", 2024-05-09T09:54:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002719193 2024-05-09T09:54:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432795+0000", 2024-05-09T09:54:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9002999999999999e-05 2024-05-09T09:54:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432819+0000", 2024-05-09T09:54:40.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4297000000000001e-05 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.432978+0000", 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015920600000000001 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.433026+0000", 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8334000000000002e-05 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.442929+0000", 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0099025769999999992 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.442989+0000", 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9716000000000002e-05 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1213 3.22 e58/18 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head v 58'2, mlcod=0'0)", 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:40.409 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.51661401, 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016947308000000001, 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820977+0000", 2024-05-09T09:54:40.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.820978+0000", 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6000000000000002e-07 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826413+0000", 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054350249999999996 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826455+0000", 2024-05-09T09:54:40.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1566000000000001e-05 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826476+0000", 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1063000000000001e-05 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826622+0000", 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014660199999999999 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.826668+0000", 2024-05-09T09:54:40.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5655999999999998e-05 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.837818+0000", 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149862999999999 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.837924+0000", 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106673 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1215 3.33 3:cc65bbc6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.478201814, 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022109406000000002, 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1215 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859389+0000", 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.859392+0000", 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1360000000000001e-06 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861755+0000", 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002362046 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861804+0000", 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9529e-05 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861835+0000", 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0756999999999997e-05 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.861973+0000", 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013852100000000001 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.862360+0000", 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038645800000000001 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.862627+0000", 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026730999999999999 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.874089+0000", 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011461613000000001 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881319+0000", 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072307120000000003 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881418+0000", 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8450999999999996e-05 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.881499+0000", 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0872999999999996e-05 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1223 3.15 e58/18 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head v 58'2, mlcod=0'0)", 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.329867886000001, 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016092055000000001, 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007723+0000", 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.007726+0000", 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9869999999999999e-06 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.012919+0000", 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051927040000000002 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.012974+0000", 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4546000000000003e-05 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013001+0000", 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6999999999999999e-05 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013171+0000", 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017040499999999999 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.013213+0000", 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2521999999999997e-05 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.023734+0000", 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010520275000000001 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.023815+0000", 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1615999999999999e-05 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1232 3.33 3:ce18f40e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.155147127999999, 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021268321, 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.423 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1232 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182444+0000", 2024-05-09T09:54:40.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.182448+0000", 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1459999999999998e-06 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186106+0000", 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036576820000000002 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186155+0000", 2024-05-09T09:54:40.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8996999999999999e-05 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186176+0000", 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1039e-05 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186355+0000", 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000178798 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186637+0000", 2024-05-09T09:54:40.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028261600000000002 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.186880+0000", 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000242217 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.194753+0000", 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078735599999999999 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203542+0000", 2024-05-09T09:54:40.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087893880000000004 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203638+0000", 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5144999999999998e-05 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.203712+0000", 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4733000000000004e-05 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.428 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1238 3.7 3:e3e1647b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (201) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.035648051000001, 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014927154999999999, 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1238 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301943+0000", 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.301946+0000", 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5560000000000002e-06 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303895+0000", 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001949805 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303943+0000", 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7348999999999997e-05 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.303963+0000", 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0177e-05 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304104+0000", 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014087299999999999 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304267+0000", 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016336000000000001 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.304761+0000", 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049361700000000001 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.313656+0000", 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088949960000000005 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316758+0000", 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003102399 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316824+0000", 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5639e-05 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.316870+0000", 2024-05-09T09:54:40.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6384000000000002e-05 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1372 3.18 3:1b1c8ec0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.323054+0000", 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.0145369120000005, 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013003115000000001, 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.434 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1372 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.323054+0000", 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.323054+0000", 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.323058+0000", 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5480000000000002e-06 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326205+0000", 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003147108 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326238+0000", 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3524e-05 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326252+0000", 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3179e-05 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326318+0000", 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6129000000000003e-05 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326419+0000", 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101122 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.326513+0000", 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3902999999999999e-05 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.331684+0000", 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051708659999999997 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.335776+0000", 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040926019999999999 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.335962+0000", 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186102 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.336057+0000", 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5031999999999994e-05 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1373 3.7 3:e129455f:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.333471+0000", 2024-05-09T09:54:40.439 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.0041197739999994, 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024809194999999999, 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1373 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.333471+0000", 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.333471+0000", 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.333474+0000", 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.384e-06 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.336909+0000", 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034355430000000001 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.336930+0000", 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0792e-05 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.336946+0000", 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6235999999999998e-05 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.337076+0000", 2024-05-09T09:54:40.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129932 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.337384+0000", 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030786700000000003 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.337698+0000", 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031433600000000002 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.346484+0000", 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087853889999999994 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.358160+0000", 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011676466999999999 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.358230+0000", 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9197999999999997e-05 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.358281+0000", 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1051000000000003e-05 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1378 3.24 3:24775331:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.416527+0000", 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.9210642799999995, 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012424197, 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.445 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1378 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.416527+0000", 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.416527+0000", 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.416529+0000", 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3420000000000002e-06 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419652+0000", 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031231710000000001 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419690+0000", 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7557e-05 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419713+0000", 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3142e-05 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419789+0000", 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5622000000000002e-05 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419896+0000", 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107283 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.419986+0000", 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9642000000000007e-05 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.425520+0000", 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055342949999999998 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.428864+0000", 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033441019999999998 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.428902+0000", 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7548e-05 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.428951+0000", 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9493000000000002e-05 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1383 3.38 3:1c4f94c2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:40.450 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.481823+0000", 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.8557678549999999, 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014727888999999999, 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1383 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.481823+0000", 2024-05-09T09:54:40.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.481823+0000", 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.481826+0000", 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0079999999999998e-06 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483561+0000", 2024-05-09T09:54:40.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017345660000000001 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483590+0000", 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9263000000000001e-05 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483607+0000", 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6759999999999999e-05 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483690+0000", 2024-05-09T09:54:40.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3349000000000004e-05 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483812+0000", 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121957 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.483906+0000", 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3441000000000002e-05 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.488357+0000", 2024-05-09T09:54:40.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044511280000000004 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.496423+0000", 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080660750000000007 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.496482+0000", 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8661e-05 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.496551+0000", 2024-05-09T09:54:40.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9680999999999999e-05 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1397 3.38 3:1dcfd94a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.004356+0000", 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.3332348839999995, 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020938258000000001, 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.456 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1397 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.004356+0000", 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.004356+0000", 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.004360+0000", 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1999999999999996e-06 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.008857+0000", 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044965939999999996 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.008907+0000", 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0142999999999997e-05 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.008930+0000", 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3255999999999999e-05 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.009079+0000", 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014806199999999999 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.009339+0000", 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026093399999999999 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:40.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.009592+0000", 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025225099999999999 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.023748+0000", 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014155910000000001 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.025064+0000", 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001316743 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.025174+0000", 2024-05-09T09:54:40.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000109336 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.025295+0000", 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120829 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1400 3.29 3:95773e52:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.076559+0000", 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.2610317119999994, 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019146456999999999, 2024-05-09T09:54:40.461 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1400 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.076559+0000", 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.076559+0000", 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.076562+0000", 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.633e-06 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.079607+0000", 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003044606 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.079661+0000", 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3899e-05 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.079688+0000", 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6993000000000001e-05 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.079860+0000", 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000172325 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.080163+0000", 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030263700000000002 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.080435+0000", 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027294999999999999 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.090276+0000", 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098400710000000006 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.095594+0000", 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053181900000000004 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.095656+0000", 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1756999999999998e-05 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.095706+0000", 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0396000000000003e-05 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1405 3.24 3:2653ece5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.199247+0000", 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.1383443779999993, 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017192691999999999, 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1405 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.199247+0000", 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.199247+0000", 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.199251+0000", 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8929999999999998e-06 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202284+0000", 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030333859999999999 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202332+0000", 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8293e-05 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202360+0000", 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7829000000000001e-05 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202511+0000", 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000150896 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.202771+0000", 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025946299999999998 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.203025+0000", 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025471499999999998 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.210482+0000", 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0074566809999999997 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.216018+0000", 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055357940000000001 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.216265+0000", 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024712300000000003 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.216439+0000", 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017461899999999999 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1408 3.33 3:ce9e4708:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.255770+0000", 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.0818212969999994, 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015645157999999999, 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:54:40.472 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1408 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.255770+0000", 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.255770+0000", 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.255775+0000", 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1429999999999997e-06 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.258618+0000", 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028431239999999998 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.258666+0000", 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7750000000000002e-05 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.258686+0000", 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9783e-05 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.258838+0000", 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000151998 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.259175+0000", 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000337327 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:40.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.259429+0000", 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025413999999999998 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.267296+0000", 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078668290000000005 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.271232+0000", 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039355919999999999 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.271338+0000", 2024-05-09T09:54:40.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010675600000000001 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.271415+0000", 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6716000000000002e-05 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:54:40.477 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:40.479 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:40.479 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:40.480 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:40.481 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:40.479+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:40.579 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:40.579+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:40.613 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:40.613 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:40.613 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:40.613 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:40.626 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:40.680 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:40.677+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:40.746 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:40.747 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:40.747 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:40.747 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:40.747 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:40.761 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:40.807 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:40.805+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:40.882 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:40.877+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:40.934 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:40.934 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.812232879999996, 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019579709000000001, 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.935 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 43 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119950+0000", 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119985+0000", 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4941999999999999e-05 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120018+0000", 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179999999999997e-05 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120040+0000", 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2432000000000001e-05 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120194+0000", 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015399700000000001 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120215+0000", 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0886e-05 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139214+0000", 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018999381999999999 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139526+0000", 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031177000000000001 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.939 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.729982910000004, 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787665, 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 211 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:40.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202200+0000", 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202215+0000", 2024-05-09T09:54:40.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5656999999999999e-05 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202254+0000", 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8506e-05 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202272+0000", 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8300000000000001e-05 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202427+0000", 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015497699999999999 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202662+0000", 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234928 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.203104+0000", 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000442151 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.204510+0000", 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014061329999999999 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205816+0000", 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013059009999999999 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205907+0000", 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0841000000000007e-05 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205984+0000", 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7164999999999997e-05 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.654663085999999, 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034049729999999999, 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.945 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.946 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.946 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 232 2024-05-09T09:54:40.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.946 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277519+0000", 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277531+0000", 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2320000000000001e-05 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.948 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277564+0000", 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2669999999999997e-05 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277579+0000", 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5415999999999999e-05 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277729+0000", 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014924 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277957+0000", 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022849599999999999 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.278368+0000", 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041114500000000002 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.279935+0000", 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015665290000000001 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280758+0000", 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082300099999999996 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280850+0000", 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1978000000000006e-05 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280921+0000", 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1527999999999997e-05 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.951 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:281 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.626335158000003, 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030930129999999999, 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 281 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.952 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305847+0000", 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3300000000000001e-06 2024-05-09T09:54:40.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305858+0000", 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.099e-05 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305882+0000", 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4026999999999999e-05 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305905+0000", 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3376000000000001e-05 2024-05-09T09:54:40.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306060+0000", 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154757 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306388+0000", 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032792699999999999 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.307138+0000", 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074994099999999995 2024-05-09T09:54:40.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308466+0000", 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013284569999999999 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308604+0000", 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137677 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308776+0000", 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017272000000000001 2024-05-09T09:54:40.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308937+0000", 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016081099999999999 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:360 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.613041843000005, 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038853109999999998, 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.957 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 360 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319140+0000", 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.057e-06 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319151+0000", 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319180+0000", 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8578999999999999e-05 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319200+0000", 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0236000000000001e-05 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319337+0000", 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013646400000000001 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319617+0000", 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028014499999999998 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.320147+0000", 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052992600000000001 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321598+0000", 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014515820000000001 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322829+0000", 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012307959999999999 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322925+0000", 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5494000000000004e-05 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323023+0000", 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8292e-05 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.962 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:378 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.607995895000002, 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036244110000000001, 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.963 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 378 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324187+0000", 2024-05-09T09:54:40.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999999e-06 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324203+0000", 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.609e-05 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324240+0000", 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7052999999999999e-05 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324262+0000", 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2195999999999999e-05 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324396+0000", 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013415700000000001 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324628+0000", 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023225200000000001 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:40.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325138+0000", 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050956299999999999 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.326372+0000", 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012345489999999999 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327556+0000", 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011832430000000001 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327701+0000", 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014539699999999999 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327808+0000", 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106835 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:40.968 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.592638328999996, 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876559999999998, 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 406 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339543+0000", 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2570000000000002e-06 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339553+0000", 2024-05-09T09:54:40.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339576+0000", 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2857000000000002e-05 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339591+0000", 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4905e-05 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339738+0000", 2024-05-09T09:54:40.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014698599999999999 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340100+0000", 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036169499999999999 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340703+0000", 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060361099999999999 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342128+0000", 2024-05-09T09:54:40.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014245690000000001 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342467+0000", 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033892500000000001 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342554+0000", 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7527000000000004e-05 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342629+0000", 2024-05-09T09:54:40.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4580999999999996e-05 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:438 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'3, mlcod=30'1)", 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.572249873999993, 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036072999999999999, 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359931+0000", 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.891e-06 2024-05-09T09:54:40.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359945+0000", 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359978+0000", 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2465000000000002e-05 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359996+0000", 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360123+0000", 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012710900000000001 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360164+0000", 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0719000000000001e-05 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363453+0000", 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003289555 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363537+0000", 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3535999999999994e-05 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:443 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'4, mlcod=30'2)", 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.567267072000007, 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034263010000000001, 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.978 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364914+0000", 2024-05-09T09:54:40.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-06 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364925+0000", 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628000000000001e-05 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364948+0000", 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3594000000000001e-05 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364960+0000", 2024-05-09T09:54:40.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2017e-05 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365077+0000", 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116706 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365114+0000", 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6908e-05 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368217+0000", 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031027820000000001 2024-05-09T09:54:40.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368339+0000", 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121989 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.536583401000001, 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028199750000000002, 2024-05-09T09:54:40.982 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 499 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395598+0000", 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0470000000000001e-06 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395609+0000", 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1083e-05 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395631+0000", 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1953000000000001e-05 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395644+0000", 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2860000000000001e-05 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395771+0000", 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127231 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395990+0000", 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000218779 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.396428+0000", 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000437854 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.397598+0000", 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011703239999999999 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398222+0000", 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062386500000000003 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398324+0000", 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010160100000000001 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398416+0000", 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2378000000000002e-05 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.450164943999994, 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085482570000000001, 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 633 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482016+0000", 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9300000000000002e-06 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482024+0000", 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0630000000000006e-06 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482042+0000", 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7713000000000001e-05 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482053+0000", 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1246e-05 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482171+0000", 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117465 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482382+0000", 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000210719 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482853+0000", 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047157999999999998 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.485997+0000", 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031434620000000001 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490455+0000", 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004458414 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490516+0000", 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0488000000000001e-05 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490563+0000", 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.380498657000004, 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787257, 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.993 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 709 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:40.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551683+0000", 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4059999999999999e-06 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551696+0000", 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551725+0000", 2024-05-09T09:54:40.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8890999999999998e-05 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551743+0000", 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7878999999999999e-05 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551889+0000", 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014628199999999999 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552237+0000", 2024-05-09T09:54:40.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034787300000000001 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552746+0000", 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050886300000000002 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.554142+0000", 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013964120000000001 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555320+0000", 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001177974 2024-05-09T09:54:40.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555400+0000", 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9468000000000006e-05 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555468+0000", 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8511999999999997e-05 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.998 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.342654750999998, 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028728, 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 727 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:40.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:41.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:41.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589527+0000", 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356e-06 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589538+0000", 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1463e-05 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589571+0000", 2024-05-09T09:54:41.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589592+0000", 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1219000000000001e-05 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589739+0000", 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147424 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590004+0000", 2024-05-09T09:54:41.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264632 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590346+0000", 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034226299999999999 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592098+0000", 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001752116 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592249+0000", 2024-05-09T09:54:41.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015033000000000001 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592335+0000", 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5890999999999995e-05 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592397+0000", 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2966000000000007e-05 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.338888635999993, 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031054329999999999, 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 729 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593292+0000", 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.344e-06 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593300+0000", 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5229999999999998e-06 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593321+0000", 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1299999999999999e-05 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593339+0000", 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8206000000000002e-05 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593428+0000", 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8928e-05 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593547+0000", 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118794 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593824+0000", 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027681500000000003 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.595408+0000", 2024-05-09T09:54:41.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001584086 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596242+0000", 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083392999999999998 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596333+0000", 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0878000000000006e-05 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596396+0000", 2024-05-09T09:54:41.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3628999999999997e-05 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.237107886000004, 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031859179999999998, 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.011 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 775 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695074+0000", 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.723e-06 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695086+0000", 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1457000000000001e-05 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695117+0000", 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1343000000000001e-05 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695138+0000", 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0622999999999999e-05 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695261+0000", 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123621 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695596+0000", 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033511000000000001 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.696142+0000", 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054512500000000004 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.697459+0000", 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013177480000000001 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698089+0000", 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063017800000000001 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698179+0000", 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9511000000000004e-05 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698257+0000", 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8479000000000005e-05 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:41.016 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 82.146336675000001, 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002852074, 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 814 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785845+0000", 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785856+0000", 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1323e-05 2024-05-09T09:54:41.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785887+0000", 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0602999999999998e-05 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785901+0000", 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4612e-05 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786031+0000", 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012920100000000001 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786246+0000", 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021583299999999999 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786562+0000", 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031516999999999998 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.787822+0000", 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001260359 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788501+0000", 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067859300000000001 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788589+0000", 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7961999999999996e-05 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788695+0000", 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106258 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.021 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.989115928999993, 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029203889999999998, 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 880 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943067+0000", 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1870000000000001e-06 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943079+0000", 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2319e-05 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943111+0000", 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1779999999999997e-05 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943126+0000", 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285999999999999e-05 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943239+0000", 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112631 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943472+0000", 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023326299999999999 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943790+0000", 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031812600000000001 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.944926+0000", 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011362519999999999 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945815+0000", 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088909199999999996 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945906+0000", 2024-05-09T09:54:41.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0997999999999998e-05 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945984+0000", 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7454999999999996e-05 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.981891305000005, 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028357909999999998, 2024-05-09T09:54:41.027 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 883 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950290+0000", 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3e-06 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950303+0000", 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.261e-05 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950334+0000", 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950354+0000", 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9865999999999999e-05 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950487+0000", 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950710+0000", 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223002 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.951056+0000", 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034612999999999999 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952129+0000", 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010729820000000001 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952975+0000", 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00084584999999999999 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953059+0000", 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4371999999999998e-05 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953124+0000", 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4412000000000006e-05 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.032 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.912188499999999, 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028784679999999999, 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 913 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019993+0000", 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3769999999999999e-06 2024-05-09T09:54:41.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020005+0000", 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1797000000000001e-05 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020036+0000", 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0876000000000001e-05 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020051+0000", 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4739000000000001e-05 2024-05-09T09:54:41.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020163+0000", 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112432 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020385+0000", 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022189200000000001 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020709+0000", 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032386699999999998 2024-05-09T09:54:41.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.021761+0000", 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051979 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022727+0000", 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096616099999999999 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022805+0000", 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8009000000000005e-05 2024-05-09T09:54:41.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022869+0000", 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4338999999999995e-05 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 81.875234054000003, 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00285995, 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.038 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 928 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056947+0000", 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.81e-06 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056957+0000", 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5829999999999996e-06 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056980+0000", 2024-05-09T09:54:41.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3278999999999999e-05 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056992+0000", 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2437e-05 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057171+0000", 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017842199999999999 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057393+0000", 2024-05-09T09:54:41.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022195 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057705+0000", 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000311687 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.058914+0000", 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012093029999999999 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059652+0000", 2024-05-09T09:54:41.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073784800000000004 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059738+0000", 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6231999999999997e-05 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059805+0000", 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7398999999999996e-05 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.043 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.044 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:41.045 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:41.045 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:41.043+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:41.146 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:41.147+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:41.215 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:41.216 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:41.216 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:41.216 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:41.231 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:41.275 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:41.273+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:41.348 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:41.345+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:41.353 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:41.353 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:41.353 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:41.367 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:41.459 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:41.457+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:41.539 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:41.539 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:41.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:41.539 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:41.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.539 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1161 3.1d 3:b8b74cb5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:41.539 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.018456005000001, 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020326487000000001, 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1161 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:41.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518545+0000", 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639999999999998e-06 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522778+0000", 2024-05-09T09:54:41.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042321429999999998 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522816+0000", 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624000000000002e-05 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522834+0000", 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522974+0000", 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523215+0000", 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024094700000000001 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523432+0000", 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217333 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.532230+0000", 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087981150000000004 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538624+0000", 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063944249999999996 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538717+0000", 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2608999999999994e-05 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538867+0000", 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150357 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1164 3.2a 3:563cc67e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.976661753, 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023925154000000001, 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.545 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1164 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:41.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560338+0000", 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2499999999999998e-06 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564645+0000", 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043069290000000001 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564681+0000", 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5746e-05 2024-05-09T09:54:41.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564697+0000", 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6269999999999998e-05 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564822+0000", 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012474099999999999 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565074+0000", 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025190400000000001 2024-05-09T09:54:41.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565300+0000", 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226133 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.572636+0000", 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073360760000000004 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584083+0000", 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011446424 2024-05-09T09:54:41.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584177+0000", 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4518999999999994e-05 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584260+0000", 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3162000000000001e-05 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.550 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1178 3.37 e57/18 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.814444834, 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025242840999999999, 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:41.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722556+0000", 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5159999999999999e-06 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728655+0000", 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060999039999999997 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728694+0000", 2024-05-09T09:54:41.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8009999999999997e-05 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728710+0000", 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6880000000000001e-05 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728899+0000", 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018883699999999999 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728968+0000", 2024-05-09T09:54:41.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9041999999999994e-05 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747653+0000", 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018684905000000002 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747795+0000", 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014174700000000001 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1198 3.16 3:6968f1e0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.229335292, 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015069340000000001, 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1198 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307662+0000", 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.307664+0000", 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7329999999999999e-06 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311411+0000", 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037470200000000002 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311443+0000", 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1885999999999999e-05 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311460+0000", 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6690000000000001e-05 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311571+0000", 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011076100000000001 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311723+0000", 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015242399999999999 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.311851+0000", 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127878 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.318523+0000", 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066716960000000004 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322606+0000", 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040829669999999998 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322659+0000", 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.3491e-05 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.322731+0000", 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1793999999999997e-05 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1200 3.22 3:47cf0652:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.197079595, 2024-05-09T09:54:41.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016902618000000001, 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1200 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339920+0000", 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0230000000000001e-06 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343641+0000", 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037201949999999999 2024-05-09T09:54:41.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343670+0000", 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9706999999999999e-05 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343682+0000", 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2264e-05 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343761+0000", 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8629999999999998e-05 2024-05-09T09:54:41.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343899+0000", 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013740599999999999 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.344011+0000", 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112305 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.350517+0000", 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065057780000000003 2024-05-09T09:54:41.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356651+0000", 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061347459999999999 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356749+0000", 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7813999999999996e-05 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356820+0000", 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0749999999999999e-05 2024-05-09T09:54:41.565 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1201 3.2a 3:54ff7f97:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.188816116, 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020960774000000001, 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.566 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348183+0000", 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9889999999999999e-06 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352065+0000", 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038826189999999999 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352086+0000", 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0407e-05 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352100+0000", 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3745e-05 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352173+0000", 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3335000000000002e-05 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352330+0000", 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015688400000000001 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352462+0000", 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013203100000000001 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.365714+0000", 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013252553 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.368997+0000", 2024-05-09T09:54:41.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032823800000000001 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369079+0000", 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2639999999999995e-05 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369142+0000", 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2191000000000001e-05 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1205 3.c 3:33072649:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.128949803999999, 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016563870000000001, 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1205 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408047+0000", 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.408049+0000", 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1840000000000002e-06 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411807+0000", 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003758188 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411838+0000", 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0171e-05 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411853+0000", 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5107e-05 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.411933+0000", 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0049999999999994e-05 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.412059+0000", 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012650000000000001 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.412166+0000", 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010712 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.418296+0000", 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061291610000000002 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424417+0000", 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061217390000000002 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424511+0000", 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3738000000000003e-05 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.424611+0000", 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.9912000000000002e-05 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.579 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1213 3.22 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.72102948, 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022416997000000001, 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1213 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815970+0000", 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6079999999999998e-06 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819807+0000", 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038369699999999999 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819837+0000", 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0423999999999999e-05 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819850+0000", 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2594e-05 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819953+0000", 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102543 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820186+0000", 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023374800000000001 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820600+0000", 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041405700000000001 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.833246+0000", 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012645854 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838263+0000", 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050170529999999996 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838332+0000", 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9202000000000006e-05 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838384+0000", 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1944000000000003e-05 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1218 3.1f e58/18 3:fb5d7f81:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_6:head v 58'1, mlcod=0'0)", 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.635135067, 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017606534, 2024-05-09T09:54:41.585 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901864+0000", 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4169999999999999e-06 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907193+0000", 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053291229999999998 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907243+0000", 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.914e-05 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907269+0000", 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6982e-05 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907404+0000", 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907441+0000", 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7036000000000003e-05 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919377+0000", 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011935871000000001 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919468+0000", 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1355999999999997e-05 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1219 3.c 3:32502fcd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.619143516999999, 2024-05-09T09:54:41.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016710821000000001, 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1219 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917853+0000", 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.917856+0000", 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0539999999999999e-06 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923017+0000", 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051609450000000001 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923052+0000", 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4369999999999998e-05 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923070+0000", 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8637000000000001e-05 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923167+0000", 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6708999999999999e-05 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923390+0000", 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223372 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.923603+0000", 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000212847 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.931054+0000", 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0074508279999999996 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934408+0000", 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0033535850000000001 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934495+0000", 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6945000000000002e-05 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.934564+0000", 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9529000000000005e-05 2024-05-09T09:54:41.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1224 3.16 3:6a153b4c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.523505773, 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017301769000000002, 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1224 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013494+0000", 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6900000000000001e-06 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017322+0000", 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038277820000000001 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017347+0000", 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5758e-05 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017361+0000", 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4113e-05 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017456+0000", 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.501e-05 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017598+0000", 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014114100000000001 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017722+0000", 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012439800000000001 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.027953+0000", 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010230888 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030697+0000", 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027437540000000002 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030751+0000", 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4379000000000002e-05 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030793+0000", 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1234 3.2f 3:f547a26d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.300007302999999, 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021134344999999999, 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1234 2024-05-09T09:54:41.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236992+0000", 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.12e-06 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.240966+0000", 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039738539999999998 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241001+0000", 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5169999999999997e-05 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241018+0000", 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7523000000000001e-05 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241186+0000", 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016797099999999999 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241562+0000", 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037583099999999997 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241922+0000", 2024-05-09T09:54:41.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036000099999999998 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.255413+0000", 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013490925000000001 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.257956+0000", 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025432250000000001 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258047+0000", 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1108999999999998e-05 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258124+0000", 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6616e-05 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.606 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.607 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1235 3.16 3:6ba36f9f:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:41.607 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:41.607 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.278845235, 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01677847, 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1235 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258154+0000", 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.08e-06 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.261982+0000", 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038285400000000001 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262012+0000", 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9213999999999998e-05 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262027+0000", 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5096000000000001e-05 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262139+0000", 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112768 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262308+0000", 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016902200000000001 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262450+0000", 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014123900000000001 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.272081+0000", 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096315700000000008 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274825+0000", 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027440780000000001 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274885+0000", 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9351999999999997e-05 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274930+0000", 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5510999999999998e-05 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1354 3.2f 3:f6a59ae0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.328250921, 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019275487000000001, 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.613 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1354 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208748+0000", 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4569999999999999e-06 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212622+0000", 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038735649999999998 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212658+0000", 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5709e-05 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212674+0000", 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6373000000000001e-05 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212860+0000", 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000185479 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213131+0000", 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027101700000000002 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213376+0000", 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024525700000000003 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.220719+0000", 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073430400000000003 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227786+0000", 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070674259999999999 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227893+0000", 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106884 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.228021+0000", 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012828000000000001 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1370 3.2a 3:57f66698:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:41.618 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.249531547, 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017490545, 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1370 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:41.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287469+0000", 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3100000000000001e-06 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291476+0000", 2024-05-09T09:54:41.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040070310000000003 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291514+0000", 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8658999999999997e-05 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291533+0000", 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8233e-05 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291658+0000", 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012539100000000001 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291923+0000", 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026470999999999998 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.292151+0000", 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022856800000000001 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.303534+0000", 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01138313 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304784+0000", 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012494400000000001 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304880+0000", 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5721000000000001e-05 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304956+0000", 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6352000000000004e-05 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1377 3.5 3:a124be72:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.135858692999999, 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016238164999999999, 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.624 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1377 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401138+0000", 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.401142+0000", 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6859999999999999e-06 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405159+0000", 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004016609 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405198+0000", 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9752000000000002e-05 2024-05-09T09:54:41.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405224+0000", 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5346000000000001e-05 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405406+0000", 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000182516 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405651+0000", 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024484700000000002 2024-05-09T09:54:41.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.405882+0000", 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023145500000000001 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.414967+0000", 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090847770000000005 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417077+0000", 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0021101869999999999 2024-05-09T09:54:41.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417255+0000", 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017720299999999999 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.417376+0000", 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121787 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.629 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1380 3.5 3:a201732c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.095798347000001, 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016810110999999999, 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1380 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441202+0000", 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9699999999999999e-06 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446791+0000", 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055891669999999999 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446824+0000", 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3256000000000001e-05 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446840+0000", 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5977e-05 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446989+0000", 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014906899999999999 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.447226+0000", 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023668800000000001 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.447457+0000", 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231781 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.455200+0000", 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077425940000000002 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.457806+0000", 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026058909999999999 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.457902+0000", 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6105000000000002e-05 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.458009+0000", 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106613 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1394 3.1d 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.5890878649999998, 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021946568999999999, 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.635 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1394 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947912+0000", 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5979999999999999e-06 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952060+0000", 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041480270000000003 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952101+0000", 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0948999999999997e-05 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952129+0000", 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8634999999999999e-05 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952302+0000", 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017274599999999999 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952559+0000", 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025720799999999998 2024-05-09T09:54:41.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952811+0000", 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252124 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.961321+0000", 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085092090000000002 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969641+0000", 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083202880000000003 2024-05-09T09:54:41.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969737+0000", 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6642000000000001e-05 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969856+0000", 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118143 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.640 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1404 3.2a 3:55508e05:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.3630062570000003, 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017081753000000002, 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:41.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173994+0000", 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2959999999999999e-06 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178574+0000", 2024-05-09T09:54:41.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045802669999999998 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178621+0000", 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6576000000000003e-05 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178647+0000", 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5908999999999999e-05 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178778+0000", 2024-05-09T09:54:41.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131571 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178929+0000", 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015090399999999999 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.179051+0000", 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012210699999999999 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.185995+0000", 2024-05-09T09:54:41.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069436799999999998 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.190973+0000", 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049780609999999998 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.191032+0000", 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8915000000000001e-05 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.191072+0000", 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0466999999999997e-05 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1407 3.17 e59/18 3:e9776743:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_17:head v 59'5, mlcod=58'3)", 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.3005721369999996, 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015177110000000001, 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:41.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236425+0000", 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.236427+0000", 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4260000000000002e-06 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242600+0000", 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061732749999999998 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242643+0000", 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2076000000000002e-05 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242666+0000", 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3689e-05 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242845+0000", 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000178512 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.242887+0000", 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2503000000000003e-05 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.251544+0000", 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0086570750000000002 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:41.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.251602+0000", 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7553999999999998e-05 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:41.650 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:41.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:54:41.652 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:41.652 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:41.651+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:41.752 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:41.749+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:41.814 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_25: 100Mb.10 2024-05-09T09:54:41.814 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:41.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.1 from bucket to /tmp/downloadfile.1 2024-05-09T09:54:41.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.2 from bucket to /tmp/downloadfile.2 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.3 from bucket to /tmp/downloadfile.3 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.4 from bucket to /tmp/downloadfile.4 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.5 from bucket to /tmp/downloadfile.5 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.6 from bucket to /tmp/downloadfile.6 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.7 from bucket to /tmp/downloadfile.7 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.8 from bucket to /tmp/downloadfile.8 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.9 from bucket to /tmp/downloadfile.9 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.10 from bucket to /tmp/downloadfile.10 2024-05-09T09:54:41.815 INFO:tasks.workunit.client.0.smithi032.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-09T09:54:41.817 INFO:tasks.workunit.client.0.smithi032.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-05-09T09:54:41.817 INFO:tasks.workunit.client.0.smithi032.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-09T09:54:41.821 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:41.821 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:41.822 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:41.822 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:41.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:41.853 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:41.851+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:41.953 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:41.955+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:42.010 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:42.010 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:42.010 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:42.026 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:42.054 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:42.055+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:42.128 INFO:tasks.workunit.client.0.smithi032.stdout:user 0.35775658542207 deleted 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.001657214000005, 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.152 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:42.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:42.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:54:42.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1158 3.2c 3:367a58d5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.668591272, 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021363626, 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.159 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1158 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481220+0000", 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486955+0000", 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057345460000000001 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486994+0000", 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8982e-05 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487016+0000", 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2103000000000002e-05 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487145+0000", 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012962499999999999 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487392+0000", 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024650300000000002 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487614+0000", 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022186999999999999 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.500091+0000", 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012477054 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502399+0000", 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023086449999999998 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502492+0000", 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2662000000000002e-05 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502581+0000", 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1167 3.26 3:65d9db40:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.553936626, 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021114266, 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.165 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1167 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595875+0000", 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1499999999999999e-06 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599908+0000", 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040330510000000002 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599945+0000", 2024-05-09T09:54:42.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7366000000000001e-05 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599964+0000", 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199e-05 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600143+0000", 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017947500000000001 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600531+0000", 2024-05-09T09:54:42.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000387914 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600968+0000", 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043724399999999999 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.615593+0000", 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014624727000000001 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616799+0000", 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012065159999999999 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616910+0000", 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110555 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616986+0000", 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6069000000000006e-05 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1170 3.33 e57/18 3:cee14352:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_14:head v 57'1, mlcod=0'0)", 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.634734+0000", 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.515074890999999, 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016742363999999999, 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.634734+0000", 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.634734+0000", 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.634736+0000", 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639468+0000", 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047319739999999999 2024-05-09T09:54:42.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639505+0000", 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6959000000000003e-05 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639523+0000", 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8070000000000001e-05 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639677+0000", 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015426799999999999 2024-05-09T09:54:42.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.639739+0000", 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1681999999999997e-05 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.651323+0000", 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011584347 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.651476+0000", 2024-05-09T09:54:42.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015241399999999999 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1175 3.20 3:0625bb6d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.465186328, 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017491074999999998, 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1175 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684627+0000", 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.843e-06 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688715+0000", 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040879360000000003 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688766+0000", 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0791999999999998e-05 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688783+0000", 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7816999999999999e-05 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688978+0000", 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019497699999999999 2024-05-09T09:54:42.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.689380+0000", 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040179099999999998 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.689741+0000", 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036100500000000002 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.700248+0000", 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010507011 2024-05-09T09:54:42.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.701823+0000", 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015747669999999999 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.701994+0000", 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017048399999999999 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.702113+0000", 2024-05-09T09:54:42.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119652 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1192 3.2c 3:37f009da:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.225283+0000", 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.924525593, 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016770698000000001, 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1192 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.225283+0000", 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.225283+0000", 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.225285+0000", 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3740000000000001e-06 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229195+0000", 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039099800000000004 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229215+0000", 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9606000000000002e-05 2024-05-09T09:54:42.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229225+0000", 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0597999999999999e-05 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229311+0000", 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5424000000000001e-05 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229508+0000", 2024-05-09T09:54:42.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019745400000000001 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.229715+0000", 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020629099999999999 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.239190+0000", 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0094751499999999999 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.241884+0000", 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026941000000000001 2024-05-09T09:54:42.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.241987+0000", 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010281 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.242054+0000", 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6910999999999997e-05 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1194 3.35 3:ac539704:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.257751+0000", 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.892057424000001, 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016473048000000001, 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1194 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.257751+0000", 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.257751+0000", 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.257754+0000", 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.706e-06 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261417+0000", 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003663473 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261436+0000", 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8420999999999999e-05 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261445+0000", 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0890000000000006e-06 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261625+0000", 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000180151 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.261870+0000", 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024474300000000001 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.262095+0000", 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022570000000000001 2024-05-09T09:54:42.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.271930+0000", 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098342540000000006 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.274097+0000", 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002167586 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.274155+0000", 2024-05-09T09:54:42.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7534999999999997e-05 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.274224+0000", 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9389999999999998e-05 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1208 3.a 3:5055ce64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.684358281, 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018795551000000001, 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.193 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1208 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465453+0000", 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8609999999999998e-06 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469227+0000", 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003774281 2024-05-09T09:54:42.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469250+0000", 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3156e-05 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469262+0000", 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1531e-05 2024-05-09T09:54:42.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469334+0000", 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2290000000000001e-05 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469342+0000", 2024-05-09T09:54:42.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1659999999999994e-06 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473383+0000", 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040406940000000001 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473477+0000", 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3929000000000001e-05 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473588+0000", 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110938 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.479810+0000", 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062221070000000002 2024-05-09T09:54:42.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484173+0000", 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436265 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484212+0000", 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9322000000000001e-05 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484246+0000", 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3626e-05 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1215 3.33 e58/18 3:cc65bbc6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_3:head v 58'3, mlcod=57'1)", 2024-05-09T09:54:42.201 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.286834542999999, 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018005263000000001, 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9999999999999998e-07 2024-05-09T09:54:42.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867905+0000", 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049302390000000003 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867938+0000", 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3309999999999998e-05 2024-05-09T09:54:42.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867960+0000", 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1889999999999999e-05 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.868111+0000", 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151154 2024-05-09T09:54:42.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.868155+0000", 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3545999999999999e-05 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.880884+0000", 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012729835 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.880979+0000", 2024-05-09T09:54:42.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4789000000000003e-05 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1229 3.2c 3:34904b64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.034272679000001, 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020735874000000001, 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1229 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:42.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115539+0000", 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6200000000000001e-06 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119644+0000", 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041042090000000002 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119669+0000", 2024-05-09T09:54:42.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5754000000000001e-05 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119684+0000", 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4209000000000001e-05 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119768+0000", 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4524999999999995e-05 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119922+0000", 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015423600000000001 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.120056+0000", 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013380999999999999 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.129703+0000", 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009646422 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136158+0000", 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064555810000000002 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136223+0000", 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4523999999999994e-05 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136272+0000", 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8983999999999997e-05 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.212 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1356 3.35 3:af70797a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.917298164, 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018963760999999999, 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1356 2024-05-09T09:54:42.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232514+0000", 2024-05-09T09:54:42.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.237973+0000", 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054590610000000003 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238009+0000", 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188999999999998e-05 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238033+0000", 2024-05-09T09:54:42.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4769999999999998e-05 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238179+0000", 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014558299999999999 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238427+0000", 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000247827 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238654+0000", 2024-05-09T09:54:42.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022734200000000001 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.247463+0000", 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008808471 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251130+0000", 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036668830000000001 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251327+0000", 2024-05-09T09:54:42.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000197441 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251474+0000", 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147047 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1358 3.3b 3:dc65933b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.895919351, 2024-05-09T09:54:42.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017217211999999999, 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1358 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253892+0000", 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9399999999999998e-06 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259312+0000", 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054195659999999998 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259356+0000", 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4365e-05 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259384+0000", 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7662999999999999e-05 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259566+0000", 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000182246 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259813+0000", 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024673000000000002 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.260045+0000", 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023265499999999999 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.269980+0000", 2024-05-09T09:54:42.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009934801 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.270919+0000", 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00093904399999999999 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.271020+0000", 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101084 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.271106+0000", 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6118000000000005e-05 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1374 3.14 e59/31 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head v 59'2, mlcod=0'0)", 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.784805999, 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018480588999999999, 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365005+0000", 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9529999999999999e-06 2024-05-09T09:54:42.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369409+0000", 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044040859999999998 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369451+0000", 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1128999999999999e-05 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369469+0000", 2024-05-09T09:54:42.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369600+0000", 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013082 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369641+0000", 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1051999999999999e-05 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383383+0000", 2024-05-09T09:54:42.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013741913999999999 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383483+0000", 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010019200000000001 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1375 3.2c 3:35a92b62:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.771455912, 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018309355999999999, 2024-05-09T09:54:42.228 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1375 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378356+0000", 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3400000000000002e-06 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384131+0000", 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057751529999999999 2024-05-09T09:54:42.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384166+0000", 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4965999999999997e-05 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384189+0000", 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3329e-05 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384311+0000", 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121914 2024-05-09T09:54:42.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384551+0000", 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000239471 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384817+0000", 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026635 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.393368+0000", 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085508100000000007 2024-05-09T09:54:42.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396327+0000", 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029596599999999998 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396514+0000", 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018649000000000001 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396662+0000", 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147873 2024-05-09T09:54:42.233 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1385 3.2c 3:346c7d8b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.502042+0000", 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.647766471000001, 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016667040000000001, 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.234 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1385 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.502042+0000", 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.502042+0000", 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.502045+0000", 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5310000000000002e-06 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506233+0000", 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041872300000000001 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506261+0000", 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8717e-05 2024-05-09T09:54:42.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506277+0000", 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5687000000000001e-05 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506409+0000", 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131996 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506664+0000", 2024-05-09T09:54:42.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025508399999999999 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.506945+0000", 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028097300000000001 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.515696+0000", 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087507239999999997 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.518524+0000", 2024-05-09T09:54:42.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028284120000000002 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.518628+0000", 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103564 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.518709+0000", 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1122e-05 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1391 3.35 3:aeaf512a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.878916+0000", 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.270892140999999, 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016127129, 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1391 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.240 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.878916+0000", 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.878916+0000", 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.878920+0000", 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3529999999999999e-06 2024-05-09T09:54:42.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.882943+0000", 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040234390000000002 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.882971+0000", 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7521999999999998e-05 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.882982+0000", 2024-05-09T09:54:42.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.181e-05 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.883071+0000", 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9041000000000003e-05 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.883232+0000", 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016055099999999999 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.883356+0000", 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012357899999999999 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.890198+0000", 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068421810000000001 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.894930+0000", 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047322529999999996 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.894993+0000", 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2837999999999997e-05 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.895043+0000", 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0562000000000001e-05 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.245 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1393 3.10 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.226658710000001, 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02062228, 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1393 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923152+0000", 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0190000000000001e-06 2024-05-09T09:54:42.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926928+0000", 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037758520000000001 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926954+0000", 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6152e-05 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926967+0000", 2024-05-09T09:54:42.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2925000000000001e-05 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927050+0000", 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3015000000000004e-05 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927188+0000", 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013808000000000001 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927320+0000", 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132311 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.936936+0000", 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096158560000000008 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943673+0000", 2024-05-09T09:54:42.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067373729999999996 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943728+0000", 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5053000000000003e-05 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943772+0000", 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643999999999998e-05 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1394 3.1d e59/31 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head v 59'7, mlcod=58'5)", 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.953025+0000", 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.196783484000001, 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016272961999999998, 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.953025+0000", 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.953025+0000", 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.953026+0000", 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5680000000000001e-06 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.955766+0000", 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027392639999999999 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.955793+0000", 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7441e-05 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.955807+0000", 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4052e-05 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.955951+0000", 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144041 2024-05-09T09:54:42.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.956017+0000", 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5728000000000005e-05 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969204+0000", 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013187051 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969298+0000", 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3817e-05 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1403 3.a 3:53fcb7d2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.9999251670000007, 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018525527, 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:42.256 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1403 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149887+0000", 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5240000000000001e-06 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153623+0000", 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037363919999999998 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153652+0000", 2024-05-09T09:54:42.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8836e-05 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153666+0000", 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3824e-05 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153761+0000", 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4975000000000005e-05 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153967+0000", 2024-05-09T09:54:42.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206085 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.154165+0000", 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198118 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.161143+0000", 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069783700000000002 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:42.260 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168262+0000", 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071186340000000004 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168343+0000", 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1044999999999994e-05 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168409+0000", 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5723999999999996e-05 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1656 3.35 3:ad423f51:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.4166453649999999, 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021084454999999998, 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1656 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.262 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733164+0000", 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2300000000000001e-06 2024-05-09T09:54:42.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733175+0000", 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0526999999999999e-05 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733201+0000", 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5952000000000002e-05 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733210+0000", 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5629999999999998e-06 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744680+0000", 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011469795 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744936+0000", 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255691 2024-05-09T09:54:42.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.754248+0000", 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093116970000000007 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:42.266 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:42.268 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:42.268 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:42.267+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:42.355 INFO:tasks.workunit.client.0.smithi032.stdout:Bucket Created: buck_2024_04_9_09_54_42 2024-05-09T09:54:42.355 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 1 2024-05-09T09:54:42.368 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:42.368 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:42.368 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107677 s, 974 MB/s 2024-05-09T09:54:42.368 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:42.365+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:42.405 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:42.405 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:42.405 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:42.405 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:42.419 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:42.462 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.1 2024-05-09T09:54:42.462 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:42.462 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 2 2024-05-09T09:54:42.476 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:42.476 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:42.476 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116751 s, 898 MB/s 2024-05-09T09:54:42.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:42.507 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:42.505+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:42.557 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:54:42.570 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:42.571+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:42.591 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.2 2024-05-09T09:54:42.591 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:42.591 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 3 2024-05-09T09:54:42.596 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:42.596 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:42.596 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:42.602 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:42.602 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:42.602 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00900074 s, 1.2 GB/s 2024-05-09T09:54:42.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:42.635 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:42.636 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:42.654 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:42.655 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:42.671 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:42.671+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:42.675 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:42.676 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:42.695 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:42.695 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:42.705 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.3 2024-05-09T09:54:42.705 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:42.705 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 4 2024-05-09T09:54:42.714 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:42.714 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:42.715 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:42.715 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:42.715 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00919556 s, 1.1 GB/s 2024-05-09T09:54:42.733 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:42.733 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:42.753 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:42.754 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:42.772 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:42.771+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:42.774 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:42.774 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:42.777 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:42.777 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:42.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:42.821 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.4 2024-05-09T09:54:42.821 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:42.821 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 5 2024-05-09T09:54:42.831 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:42.831 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:42.831 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00923881 s, 1.1 GB/s 2024-05-09T09:54:42.873 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:42.869+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:42.944 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.5 2024-05-09T09:54:42.944 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:42.944 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 6 2024-05-09T09:54:42.946 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:42.946 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:42.956 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:42.956 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:42.956 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0098243 s, 1.1 GB/s 2024-05-09T09:54:42.964 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:42.974 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:42.969+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:43.075 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.6 2024-05-09T09:54:43.075 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:43.075 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 7 2024-05-09T09:54:43.075 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:43.075+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:43.085 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:43.085 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:43.085 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00901851 s, 1.2 GB/s 2024-05-09T09:54:43.147 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:43.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:43.206 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:43.207+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:43.221 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.7 2024-05-09T09:54:43.221 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:43.221 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 8 2024-05-09T09:54:43.232 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:43.232 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:43.232 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00977554 s, 1.1 GB/s 2024-05-09T09:54:43.277 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:43.275+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:43.343 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:43.343 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:43.350 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.8 2024-05-09T09:54:43.350 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:43.350 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 9 2024-05-09T09:54:43.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:43.364 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:43.364 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:43.364 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110525 s, 949 MB/s 2024-05-09T09:54:43.378 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:43.373+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:43.470 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.9 2024-05-09T09:54:43.470 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:43.470 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 10 2024-05-09T09:54:43.478 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:43.479+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:43.483 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:43.483 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:43.483 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108747 s, 964 MB/s 2024-05-09T09:54:43.493 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:43.493 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:43.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:43.587 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.10 2024-05-09T09:54:43.587 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:43.587 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 11 2024-05-09T09:54:43.587 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:43.587+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:43.599 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:43.600 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:43.600 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106824 s, 982 MB/s 2024-05-09T09:54:43.680 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:43.677+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:43.686 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:43.686 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:43.700 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:43.721 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.11 2024-05-09T09:54:43.721 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:43.721 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 12 2024-05-09T09:54:43.735 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:43.736 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:43.736 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119999 s, 874 MB/s 2024-05-09T09:54:43.782 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:43.783+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:43.849 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:43.849 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:43.856 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.12 2024-05-09T09:54:43.856 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:43.856 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 13 2024-05-09T09:54:43.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:43.869 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:43.870 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:43.870 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106782 s, 982 MB/s 2024-05-09T09:54:43.883 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:43.881+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:43.984 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:43.983+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:43.991 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:43.992 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:44.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:44.025 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.13 2024-05-09T09:54:44.025 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.025 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 14 2024-05-09T09:54:44.036 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:44.036 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:44.037 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00876258 s, 1.2 GB/s 2024-05-09T09:54:44.087 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:44.085+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:44.168 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.14 2024-05-09T09:54:44.169 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.169 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 15 2024-05-09T09:54:44.172 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:44.172 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:44.184 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:44.184 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:44.184 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110646 s, 948 MB/s 2024-05-09T09:54:44.186 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:44.187+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:44.188 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:44.286 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:44.281+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:44.302 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.15 2024-05-09T09:54:44.302 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.302 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 16 2024-05-09T09:54:44.314 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:44.314 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:44.314 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105053 s, 998 MB/s 2024-05-09T09:54:44.385 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:44.385 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:44.387 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:44.387+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:44.407 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:44.418 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.16 2024-05-09T09:54:44.418 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.418 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 17 2024-05-09T09:54:44.428 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:44.428 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:44.428 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00890089 s, 1.2 GB/s 2024-05-09T09:54:44.488 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:44.485+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:44.533 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.17 2024-05-09T09:54:44.533 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.533 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 18 2024-05-09T09:54:44.545 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:44.545 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:44.545 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104894 s, 1000 MB/s 2024-05-09T09:54:44.553 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:44.553 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:44.569 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:44.589 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:44.585+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:44.592 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:54:44.664 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.18 2024-05-09T09:54:44.664 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.664 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 19 2024-05-09T09:54:44.674 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:44.674 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:44.675 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00905719 s, 1.2 GB/s 2024-05-09T09:54:44.690 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:44.685+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:44.745 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:44.745 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:44.761 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:44.779 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.19 2024-05-09T09:54:44.779 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.779 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 20 2024-05-09T09:54:44.789 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:44.789 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:44.789 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00925006 s, 1.1 GB/s 2024-05-09T09:54:44.790 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:44.789+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:44.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:44.890 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.20 2024-05-09T09:54:44.891 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.891 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 21 2024-05-09T09:54:44.892 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:44.891+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:44.900 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:44.900 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:44.900 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010736 s, 977 MB/s 2024-05-09T09:54:44.912 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:44.912 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:44.929 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:44.963 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:44.963 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:44.985 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:44.985 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:44.992 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:44.989+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:44.994 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.21 2024-05-09T09:54:44.994 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:44.994 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 22 2024-05-09T09:54:45.003 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:45.003 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:45.005 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:45.005 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:45.005 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00883053 s, 1.2 GB/s 2024-05-09T09:54:45.017 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:54:45.022 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:45.023 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:45.044 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:45.044 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:45.065 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:45.065 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:45.065 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:45.065 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:45.066 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:45.067 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:45.084 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:45.089 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:45.090 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:45.093 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:45.091+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:45.097 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.22 2024-05-09T09:54:45.097 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:45.097 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 23 2024-05-09T09:54:45.108 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:45.108 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:45.108 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00915821 s, 1.1 GB/s 2024-05-09T09:54:45.110 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:45.110 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:45.194 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:45.189+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:45.206 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.23 2024-05-09T09:54:45.206 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:45.206 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 24 2024-05-09T09:54:45.218 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:45.218 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:45.218 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010128 s, 1.0 GB/s 2024-05-09T09:54:45.251 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:45.251 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:45.251 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:45.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:45.307 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:45.305+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:45.339 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.24 2024-05-09T09:54:45.340 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:45.340 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 25 2024-05-09T09:54:45.354 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:45.354 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:45.354 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116297 s, 902 MB/s 2024-05-09T09:54:45.396 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:45.395+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:45.432 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:45.432 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 92.310405621000001, 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019579709000000001, 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-09T09:54:45.433 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 43 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119950+0000", 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119985+0000", 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4941999999999999e-05 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120018+0000", 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179999999999997e-05 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120040+0000", 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2432000000000001e-05 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120194+0000", 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015399700000000001 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120215+0000", 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0886e-05 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139214+0000", 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018999381999999999 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139526+0000", 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031177000000000001 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.228155650999994, 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787665, 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.438 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 211 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.439 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202200+0000", 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202215+0000", 2024-05-09T09:54:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5656999999999999e-05 2024-05-09T09:54:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202254+0000", 2024-05-09T09:54:45.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8506e-05 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202272+0000", 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8300000000000001e-05 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202427+0000", 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015497699999999999 2024-05-09T09:54:45.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202662+0000", 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234928 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.203104+0000", 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000442151 2024-05-09T09:54:45.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.204510+0000", 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014061329999999999 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205816+0000", 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013059009999999999 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205907+0000", 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0841000000000007e-05 2024-05-09T09:54:45.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205984+0000", 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7164999999999997e-05 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.152835827000004, 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034049729999999999, 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 232 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277519+0000", 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277531+0000", 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2320000000000001e-05 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277564+0000", 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2669999999999997e-05 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277579+0000", 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5415999999999999e-05 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277729+0000", 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014924 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277957+0000", 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022849599999999999 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.278368+0000", 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041114500000000002 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.279935+0000", 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015665290000000001 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280758+0000", 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082300099999999996 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280850+0000", 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1978000000000006e-05 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280921+0000", 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1527999999999997e-05 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:281 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.124507898999994, 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030930129999999999, 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 281 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.451 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305847+0000", 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3300000000000001e-06 2024-05-09T09:54:45.452 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305858+0000", 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.099e-05 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305882+0000", 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4026999999999999e-05 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305905+0000", 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3376000000000001e-05 2024-05-09T09:54:45.453 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306060+0000", 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154757 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306388+0000", 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032792699999999999 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.307138+0000", 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074994099999999995 2024-05-09T09:54:45.454 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308466+0000", 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013284569999999999 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308604+0000", 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137677 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308776+0000", 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017272000000000001 2024-05-09T09:54:45.455 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308937+0000", 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016081099999999999 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:360 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.111214583999995, 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038853109999999998, 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.456 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 360 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.457 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319140+0000", 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.057e-06 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319151+0000", 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.458 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319180+0000", 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8578999999999999e-05 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319200+0000", 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0236000000000001e-05 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319337+0000", 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013646400000000001 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.459 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319617+0000", 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028014499999999998 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.320147+0000", 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052992600000000001 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321598+0000", 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014515820000000001 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.460 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322829+0000", 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012307959999999999 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322925+0000", 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5494000000000004e-05 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323023+0000", 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8292e-05 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.461 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:378 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.106168636000007, 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036244110000000001, 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 378 2024-05-09T09:54:45.462 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.463 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324187+0000", 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999999e-06 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324203+0000", 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.609e-05 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324240+0000", 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7052999999999999e-05 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.464 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324262+0000", 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2195999999999999e-05 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324396+0000", 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013415700000000001 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324628+0000", 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023225200000000001 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.465 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325138+0000", 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050956299999999999 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.326372+0000", 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012345489999999999 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327556+0000", 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011832430000000001 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.466 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327701+0000", 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014539699999999999 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327808+0000", 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106835 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.467 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.090811070000001, 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876559999999998, 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 406 2024-05-09T09:54:45.468 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.469 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339543+0000", 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2570000000000002e-06 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339553+0000", 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339576+0000", 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2857000000000002e-05 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.470 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339591+0000", 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4905e-05 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339738+0000", 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014698599999999999 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340100+0000", 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036169499999999999 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.471 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340703+0000", 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060361099999999999 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342128+0000", 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014245690000000001 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.472 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342467+0000", 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033892500000000001 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342554+0000", 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7527000000000004e-05 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342629+0000", 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4580999999999996e-05 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.473 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:438 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'3, mlcod=30'1)", 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.070422614999998, 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036072999999999999, 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.474 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359931+0000", 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.891e-06 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.475 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359945+0000", 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359978+0000", 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2465000000000002e-05 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.476 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359996+0000", 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360123+0000", 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012710900000000001 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360164+0000", 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0719000000000001e-05 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.477 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363453+0000", 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003289555 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363537+0000", 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3535999999999994e-05 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.478 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:443 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'4, mlcod=30'2)", 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.065439812999998, 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034263010000000001, 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:45.479 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364914+0000", 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-06 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364925+0000", 2024-05-09T09:54:45.480 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628000000000001e-05 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364948+0000", 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3594000000000001e-05 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364960+0000", 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2017e-05 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.481 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365077+0000", 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116706 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365114+0000", 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6908e-05 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.482 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368217+0000", 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031027820000000001 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368339+0000", 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121989 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 87.034756142000006, 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028199750000000002, 2024-05-09T09:54:45.483 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 499 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.484 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395598+0000", 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0470000000000001e-06 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.485 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395609+0000", 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1083e-05 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395631+0000", 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1953000000000001e-05 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395644+0000", 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2860000000000001e-05 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.486 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395771+0000", 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127231 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395990+0000", 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000218779 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.487 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.396428+0000", 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000437854 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.397598+0000", 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011703239999999999 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398222+0000", 2024-05-09T09:54:45.488 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062386500000000003 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398324+0000", 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010160100000000001 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398416+0000", 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2378000000000002e-05 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.489 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.490 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.490 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:45.490 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.948337684999998, 2024-05-09T09:54:45.490 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085482570000000001, 2024-05-09T09:54:45.490 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.490 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.490 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.490 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 633 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.491 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482016+0000", 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9300000000000002e-06 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482024+0000", 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0630000000000006e-06 2024-05-09T09:54:45.492 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482042+0000", 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7713000000000001e-05 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482053+0000", 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1246e-05 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482171+0000", 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117465 2024-05-09T09:54:45.493 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482382+0000", 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000210719 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482853+0000", 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047157999999999998 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.485997+0000", 2024-05-09T09:54:45.494 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031434620000000001 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490455+0000", 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004458414 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490516+0000", 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0488000000000001e-05 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490563+0000", 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-05-09T09:54:45.495 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.878671397999994, 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787257, 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.496 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 709 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551683+0000", 2024-05-09T09:54:45.497 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4059999999999999e-06 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551696+0000", 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551725+0000", 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8890999999999998e-05 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551743+0000", 2024-05-09T09:54:45.498 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7878999999999999e-05 2024-05-09T09:54:45.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.499 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.499 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551889+0000", 2024-05-09T09:54:45.499 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014628199999999999 2024-05-09T09:54:45.499 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.499 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.501 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.501 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552237+0000", 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034787300000000001 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552746+0000", 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050886300000000002 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.554142+0000", 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013964120000000001 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.502 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555320+0000", 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001177974 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555400+0000", 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9468000000000006e-05 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555468+0000", 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8511999999999997e-05 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.503 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.840827492000003, 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028728, 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 727 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.504 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589527+0000", 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356e-06 2024-05-09T09:54:45.505 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589538+0000", 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1463e-05 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589571+0000", 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589592+0000", 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1219000000000001e-05 2024-05-09T09:54:45.506 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589739+0000", 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147424 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590004+0000", 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264632 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590346+0000", 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034226299999999999 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.507 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592098+0000", 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001752116 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592249+0000", 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015033000000000001 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592335+0000", 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5890999999999995e-05 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.508 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592397+0000", 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2966000000000007e-05 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.837061376999998, 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031054329999999999, 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.509 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 729 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.510 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593292+0000", 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.344e-06 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593300+0000", 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5229999999999998e-06 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593321+0000", 2024-05-09T09:54:45.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1299999999999999e-05 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593339+0000", 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8206000000000002e-05 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593428+0000", 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8928e-05 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593547+0000", 2024-05-09T09:54:45.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118794 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593824+0000", 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027681500000000003 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.595408+0000", 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001584086 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596242+0000", 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083392999999999998 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596333+0000", 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0878000000000006e-05 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596396+0000", 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3628999999999997e-05 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.514 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.735280626999995, 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031859179999999998, 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.515 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 775 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695074+0000", 2024-05-09T09:54:45.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.723e-06 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695086+0000", 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1457000000000001e-05 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695117+0000", 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1343000000000001e-05 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695138+0000", 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0622999999999999e-05 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695261+0000", 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123621 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695596+0000", 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033511000000000001 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.696142+0000", 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054512500000000004 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.697459+0000", 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013177480000000001 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698089+0000", 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063017800000000001 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698179+0000", 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9511000000000004e-05 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698257+0000", 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8479000000000005e-05 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.520 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.644509416000005, 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002852074, 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.521 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 814 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785845+0000", 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785856+0000", 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1323e-05 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785887+0000", 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0602999999999998e-05 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785901+0000", 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4612e-05 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786031+0000", 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012920100000000001 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786246+0000", 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021583299999999999 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786562+0000", 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031516999999999998 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.787822+0000", 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001260359 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788501+0000", 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067859300000000001 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788589+0000", 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7961999999999996e-05 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788695+0000", 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106258 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.526 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.487288669999998, 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029203889999999998, 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 880 2024-05-09T09:54:45.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943067+0000", 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1870000000000001e-06 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943079+0000", 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2319e-05 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943111+0000", 2024-05-09T09:54:45.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1779999999999997e-05 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943126+0000", 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285999999999999e-05 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943239+0000", 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112631 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943472+0000", 2024-05-09T09:54:45.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023326299999999999 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943790+0000", 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031812600000000001 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.944926+0000", 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011362519999999999 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945815+0000", 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088909199999999996 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945906+0000", 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0997999999999998e-05 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945984+0000", 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7454999999999996e-05 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.480064045999995, 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028357909999999998, 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.533 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 883 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950290+0000", 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3e-06 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950303+0000", 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.261e-05 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950334+0000", 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950354+0000", 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9865999999999999e-05 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950487+0000", 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950710+0000", 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223002 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.951056+0000", 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034612999999999999 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952129+0000", 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010729820000000001 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952975+0000", 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00084584999999999999 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953059+0000", 2024-05-09T09:54:45.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4371999999999998e-05 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953124+0000", 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4412000000000006e-05 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.410361241000004, 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028784679999999999, 2024-05-09T09:54:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 913 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019993+0000", 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3769999999999999e-06 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020005+0000", 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1797000000000001e-05 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020036+0000", 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0876000000000001e-05 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020051+0000", 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4739000000000001e-05 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020163+0000", 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112432 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020385+0000", 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022189200000000001 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020709+0000", 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032386699999999998 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.021761+0000", 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051979 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022727+0000", 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096616099999999999 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022805+0000", 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8009000000000005e-05 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022869+0000", 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4338999999999995e-05 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 86.373406794999994, 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00285995, 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 928 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:45.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056947+0000", 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.81e-06 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056957+0000", 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5829999999999996e-06 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056980+0000", 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3278999999999999e-05 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056992+0000", 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2437e-05 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057171+0000", 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017842199999999999 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057393+0000", 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022195 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057705+0000", 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000311687 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.058914+0000", 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012093029999999999 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059652+0000", 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073784800000000004 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059738+0000", 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6231999999999997e-05 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:45.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059805+0000", 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7398999999999996e-05 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:45.551 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:45.552 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.25 2024-05-09T09:54:45.552 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:45.552 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 26 2024-05-09T09:54:45.553 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:45.553 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:45.553 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130641 s, 803 MB/s 2024-05-09T09:54:45.553 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:45.554 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:45.549+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:45.646 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.26 2024-05-09T09:54:45.647 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:45.647 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 27 2024-05-09T09:54:45.653 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:45.651+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:45.662 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:45.662 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:45.663 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128221 s, 818 MB/s 2024-05-09T09:54:45.730 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:45.730 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:45.730 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:45.730 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:45.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:45.791 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:45.789+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:45.817 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.27 2024-05-09T09:54:45.817 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:45.817 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 28 2024-05-09T09:54:45.834 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:45.834 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:45.834 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0133553 s, 785 MB/s 2024-05-09T09:54:45.854 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:45.855+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:45.868 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:45.868 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:45.868 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:45.868 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:45.868 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:45.882 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:45.956 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:45.955+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:45.992 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.28 2024-05-09T09:54:45.992 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:45.992 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 29 2024-05-09T09:54:46.007 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:46.007 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:46.007 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125065 s, 838 MB/s 2024-05-09T09:54:46.057 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:46.053+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:46.060 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:46.060 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:46.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:46.060 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1161 3.1d 3:b8b74cb5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.539431801999999, 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020326487000000001, 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1161 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.061 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518545+0000", 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639999999999998e-06 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522778+0000", 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042321429999999998 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522816+0000", 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624000000000002e-05 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522834+0000", 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522974+0000", 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523215+0000", 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024094700000000001 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:46.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523432+0000", 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217333 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.532230+0000", 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087981150000000004 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538624+0000", 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063944249999999996 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538717+0000", 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2608999999999994e-05 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538867+0000", 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150357 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1164 3.2a 3:563cc67e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:46.066 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.49763755, 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023925154000000001, 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1164 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560338+0000", 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2499999999999998e-06 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564645+0000", 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043069290000000001 2024-05-09T09:54:46.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564681+0000", 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5746e-05 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564697+0000", 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6269999999999998e-05 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564822+0000", 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012474099999999999 2024-05-09T09:54:46.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565074+0000", 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025190400000000001 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565300+0000", 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226133 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.572636+0000", 2024-05-09T09:54:46.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073360760000000004 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584083+0000", 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011446424 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584177+0000", 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4518999999999994e-05 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584260+0000", 2024-05-09T09:54:46.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3162000000000001e-05 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1178 3.37 e57/18 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.335420631000002, 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025242840999999999, 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722556+0000", 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5159999999999999e-06 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728655+0000", 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060999039999999997 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728694+0000", 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8009999999999997e-05 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728710+0000", 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6880000000000001e-05 2024-05-09T09:54:46.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728899+0000", 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018883699999999999 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728968+0000", 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9041999999999994e-05 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747653+0000", 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018684905000000002 2024-05-09T09:54:46.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747795+0000", 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014174700000000001 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1200 3.22 3:47cf0652:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.718055392, 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016902618000000001, 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.076 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1200 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339917+0000", 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.339920+0000", 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0230000000000001e-06 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343641+0000", 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037201949999999999 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343670+0000", 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9706999999999999e-05 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343682+0000", 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2264e-05 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343761+0000", 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8629999999999998e-05 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.343899+0000", 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013740599999999999 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.344011+0000", 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112305 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.350517+0000", 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065057780000000003 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356651+0000", 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0061347459999999999 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356749+0000", 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7813999999999996e-05 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.356820+0000", 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.0749999999999999e-05 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1201 3.2a 3:54ff7f97:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.709791913, 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020960774000000001, 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-09T09:54:46.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348183+0000", 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9889999999999999e-06 2024-05-09T09:54:46.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352065+0000", 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038826189999999999 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352086+0000", 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0407e-05 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352100+0000", 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3745e-05 2024-05-09T09:54:46.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352173+0000", 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3335000000000002e-05 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352330+0000", 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015688400000000001 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352462+0000", 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013203100000000001 2024-05-09T09:54:46.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.365714+0000", 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013252553 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.368997+0000", 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032823800000000001 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369079+0000", 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2639999999999995e-05 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369142+0000", 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2191000000000001e-05 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1213 3.22 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:46.087 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.242005277000001, 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022416997000000001, 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1213 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815970+0000", 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6079999999999998e-06 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819807+0000", 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038369699999999999 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819837+0000", 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0423999999999999e-05 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819850+0000", 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2594e-05 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819953+0000", 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102543 2024-05-09T09:54:46.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820186+0000", 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023374800000000001 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820600+0000", 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041405700000000001 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.833246+0000", 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012645854 2024-05-09T09:54:46.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838263+0000", 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050170529999999996 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838332+0000", 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9202000000000006e-05 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838384+0000", 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1944000000000003e-05 2024-05-09T09:54:46.092 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1218 3.1f e58/18 3:fb5d7f81:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_6:head v 58'1, mlcod=0'0)", 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.156110863999999, 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017606534, 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901862+0000", 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.901864+0000", 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4169999999999999e-06 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907193+0000", 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053291229999999998 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907243+0000", 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.914e-05 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907269+0000", 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6982e-05 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907404+0000", 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134609 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907441+0000", 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7036000000000003e-05 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919377+0000", 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011935871000000001 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.919468+0000", 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1355999999999997e-05 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1224 3.16 3:6a153b4c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.044481569999999, 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017301769000000002, 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.097 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1224 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013491+0000", 2024-05-09T09:54:46.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.013494+0000", 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6900000000000001e-06 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017322+0000", 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038277820000000001 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017347+0000", 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5758e-05 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017361+0000", 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4113e-05 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017456+0000", 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.501e-05 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017598+0000", 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014114100000000001 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.017722+0000", 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012439800000000001 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.027953+0000", 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010230888 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030697+0000", 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027437540000000002 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030751+0000", 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4379000000000002e-05 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.030793+0000", 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1856e-05 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.102 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1234 3.2f 3:f547a26d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.820983099999999, 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021134344999999999, 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1234 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.103 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236992+0000", 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.12e-06 2024-05-09T09:54:46.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.240966+0000", 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039738539999999998 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241001+0000", 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5169999999999997e-05 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241018+0000", 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7523000000000001e-05 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241186+0000", 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016797099999999999 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241562+0000", 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037583099999999997 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241922+0000", 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036000099999999998 2024-05-09T09:54:46.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.255413+0000", 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013490925000000001 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.257956+0000", 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025432250000000001 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258047+0000", 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1108999999999998e-05 2024-05-09T09:54:46.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258124+0000", 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6616e-05 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1235 3.16 3:6ba36f9f:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.799821032000001, 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01677847, 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.108 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1235 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258152+0000", 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258154+0000", 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.08e-06 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.261982+0000", 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038285400000000001 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262012+0000", 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9213999999999998e-05 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262027+0000", 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5096000000000001e-05 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262139+0000", 2024-05-09T09:54:46.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112768 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262308+0000", 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016902200000000001 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.262450+0000", 2024-05-09T09:54:46.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014123900000000001 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.272081+0000", 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096315700000000008 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274825+0000", 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027440780000000001 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274885+0000", 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9351999999999997e-05 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.274930+0000", 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5510999999999998e-05 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1354 3.2f 3:f6a59ae0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.849226718000001, 2024-05-09T09:54:46.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019275487000000001, 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1354 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:46.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208748+0000", 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4569999999999999e-06 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212622+0000", 2024-05-09T09:54:46.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038735649999999998 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212658+0000", 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5709e-05 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212674+0000", 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6373000000000001e-05 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212860+0000", 2024-05-09T09:54:46.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000185479 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213131+0000", 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027101700000000002 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213376+0000", 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024525700000000003 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.220719+0000", 2024-05-09T09:54:46.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073430400000000003 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227786+0000", 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070674259999999999 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227893+0000", 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106884 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.228021+0000", 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012828000000000001 2024-05-09T09:54:46.121 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1370 3.2a 3:57f66698:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.770507344, 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017490545, 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1370 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287465+0000", 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.287469+0000", 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3100000000000001e-06 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291476+0000", 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040070310000000003 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291514+0000", 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8658999999999997e-05 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291533+0000", 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8233e-05 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291658+0000", 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012539100000000001 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.291923+0000", 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026470999999999998 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.292151+0000", 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022856800000000001 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.303534+0000", 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01138313 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304784+0000", 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012494400000000001 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304880+0000", 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5721000000000001e-05 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.304956+0000", 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6352000000000004e-05 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1380 3.5 3:a201732c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:46.127 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.616774144000001, 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016810110999999999, 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1380 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441199+0000", 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.441202+0000", 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9699999999999999e-06 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446791+0000", 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055891669999999999 2024-05-09T09:54:46.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446824+0000", 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3256000000000001e-05 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446840+0000", 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5977e-05 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.446989+0000", 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014906899999999999 2024-05-09T09:54:46.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.447226+0000", 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023668800000000001 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.447457+0000", 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000231781 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.455200+0000", 2024-05-09T09:54:46.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0077425940000000002 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.457806+0000", 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0026058909999999999 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.457902+0000", 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6105000000000002e-05 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.458009+0000", 2024-05-09T09:54:46.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106613 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1394 3.1d 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.110063662, 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021946568999999999, 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.133 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1394 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947912+0000", 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5979999999999999e-06 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952060+0000", 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041480270000000003 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952101+0000", 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0948999999999997e-05 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952129+0000", 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8634999999999999e-05 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952302+0000", 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017274599999999999 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952559+0000", 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025720799999999998 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952811+0000", 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252124 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.961321+0000", 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085092090000000002 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969641+0000", 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083202880000000003 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969737+0000", 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6642000000000001e-05 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969856+0000", 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118143 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.138 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1404 3.2a 3:55508e05:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.883982054000001, 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017081753000000002, 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1404 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173991+0000", 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.173994+0000", 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2959999999999999e-06 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178574+0000", 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045802669999999998 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178621+0000", 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6576000000000003e-05 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178647+0000", 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5908999999999999e-05 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178778+0000", 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131571 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.178929+0000", 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015090399999999999 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.179051+0000", 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012210699999999999 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.185995+0000", 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069436799999999998 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.190973+0000", 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049780609999999998 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.191032+0000", 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.8915000000000001e-05 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.191072+0000", 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0466999999999997e-05 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1729 3.3a 3:5ffa07d6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.574263+0000", 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4837095119999999, 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017767160000000001, 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.144 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1729 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.574263+0000", 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.574263+0000", 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.574267+0000", 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6600000000000001e-06 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579395+0000", 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051283600000000002 2024-05-09T09:54:46.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579435+0000", 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9526000000000001e-05 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579453+0000", 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8267e-05 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579545+0000", 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2063000000000003e-05 2024-05-09T09:54:46.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579707+0000", 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016210000000000001 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.580185+0000", 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047816800000000001 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.591328+0000", 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011142887000000001 2024-05-09T09:54:46.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.591891+0000", 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056308900000000002 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.591979+0000", 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8066999999999996e-05 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.592030+0000", 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0973000000000001e-05 2024-05-09T09:54:46.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1732 3.2a 3:57cad4d0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.z7A6gvGdCsGpYkA4afvy42BiLcIeNy9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.3883807400000001, 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020981109000000001, 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1732 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669595+0000", 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8159999999999998e-06 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673343+0000", 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037477550000000002 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673372+0000", 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9085999999999999e-05 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673384+0000", 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2615e-05 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673496+0000", 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111888 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673731+0000", 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023452 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673945+0000", 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021394900000000001 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.686870+0000", 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012925624 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690449+0000", 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035790399999999999 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690522+0000", 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2745999999999998e-05 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690573+0000", 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1069999999999997e-05 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1864 3.30 3:0f8e5753:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.vjrfU8R0YhW7bZ2SDYx38ZOxKyLoEJ4_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.61187499999999995, 2024-05-09T09:54:46.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020719274999999999, 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1864 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446101+0000", 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.49e-06 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450033+0000", 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039319380000000003 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450059+0000", 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5548e-05 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450071+0000", 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2245999999999999e-05 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450231+0000", 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000160464 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450626+0000", 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039443900000000001 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.451035+0000", 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040921300000000001 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.463627+0000", 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012592067 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466538+0000", 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029110289999999999 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466696+0000", 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015758999999999999 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466817+0000", 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012125099999999999 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1873 3.38 3:1e64df2a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.26:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.43129826700000001, 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019915188, 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1873 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.161 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626678+0000", 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8e-06 2024-05-09T09:54:46.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630890+0000", 2024-05-09T09:54:46.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042116360000000004 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630924+0000", 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3708999999999999e-05 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630937+0000", 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3841e-05 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.631046+0000", 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010836 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.631313+0000", 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026688200000000002 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.632056+0000", 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074307599999999996 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.640884+0000", 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008828743 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646477+0000", 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055922339999999997 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646542+0000", 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5617999999999994e-05 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646590+0000", 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7289000000000001e-05 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1879 3.3a 3:5c465ff6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.27:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.797883+0000", 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.26008970399999998, 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018545826000000001, 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.167 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1879 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.797883+0000", 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.797883+0000", 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.797885+0000", 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9139999999999998e-06 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802068+0000", 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041826490000000001 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802096+0000", 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8228000000000001e-05 2024-05-09T09:54:46.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802107+0000", 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.166e-05 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802190+0000", 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2826999999999998e-05 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802347+0000", 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015719599999999999 2024-05-09T09:54:46.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802801+0000", 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045321100000000002 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.814288+0000", 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011487212 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.816324+0000", 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002035902 2024-05-09T09:54:46.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.816386+0000", 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2558999999999995e-05 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.816429+0000", 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2468000000000001e-05 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.172 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:46.173 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.29 2024-05-09T09:54:46.173 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:46.173 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 30 2024-05-09T09:54:46.174 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:46.175 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:46.175+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:46.178 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:46.178 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:46.178 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127258 s, 824 MB/s 2024-05-09T09:54:46.275 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:46.273+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:46.334 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.30 2024-05-09T09:54:46.334 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:46.334 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 31 2024-05-09T09:54:46.351 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:46.351 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:46.351 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0136757 s, 767 MB/s 2024-05-09T09:54:46.355 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:46.355 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:46.355 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:46.355 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:46.369 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:46.411 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:46.409+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:46.477 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:46.475+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:46.492 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.31 2024-05-09T09:54:46.492 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:46.492 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 32 2024-05-09T09:54:46.506 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:46.506 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:46.507 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120413 s, 871 MB/s 2024-05-09T09:54:46.532 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:46.532 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:46.533 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:46.533 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:46.546 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:46.591 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:46.589+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:46.675 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.32 2024-05-09T09:54:46.675 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:46.675 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 33 2024-05-09T09:54:46.678 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:46.679+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:46.679 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.679 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.529101898999997, 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:54:46.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:54:46.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:54:46.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1158 3.2c 3:367a58d5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.196035956999999, 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021363626, 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1158 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481220+0000", 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486955+0000", 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057345460000000001 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486994+0000", 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8982e-05 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487016+0000", 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2103000000000002e-05 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487145+0000", 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012962499999999999 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487392+0000", 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024650300000000002 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487614+0000", 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022186999999999999 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.500091+0000", 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012477054 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502399+0000", 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023086449999999998 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502492+0000", 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2662000000000002e-05 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502581+0000", 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1167 3.26 3:65d9db40:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.081381311000001, 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021114266, 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.692 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1167 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595875+0000", 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1499999999999999e-06 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599908+0000", 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040330510000000002 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599945+0000", 2024-05-09T09:54:46.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7366000000000001e-05 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599964+0000", 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199e-05 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600143+0000", 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017947500000000001 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600531+0000", 2024-05-09T09:54:46.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000387914 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600968+0000", 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043724399999999999 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.615593+0000", 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014624727000000001 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616799+0000", 2024-05-09T09:54:46.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012065159999999999 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616910+0000", 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110555 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616986+0000", 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6069000000000006e-05 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1175 3.20 3:0625bb6d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.992631013, 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017491074999999998, 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1175 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.698 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684622+0000", 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.684627+0000", 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.843e-06 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688715+0000", 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040879360000000003 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688766+0000", 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0791999999999998e-05 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688783+0000", 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7816999999999999e-05 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.688978+0000", 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019497699999999999 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.689380+0000", 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040179099999999998 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.689741+0000", 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036100500000000002 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.700248+0000", 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010507011 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.701823+0000", 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015747669999999999 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.701994+0000", 2024-05-09T09:54:46.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017048399999999999 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.702113+0000", 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000119652 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1208 3.a 3:5055ce64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.211802966, 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018795551000000001, 2024-05-09T09:54:46.703 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1208 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.704 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465453+0000", 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8609999999999998e-06 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469227+0000", 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003774281 2024-05-09T09:54:46.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469250+0000", 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3156e-05 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469262+0000", 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1531e-05 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469334+0000", 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2290000000000001e-05 2024-05-09T09:54:46.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469342+0000", 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1659999999999994e-06 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473383+0000", 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040406940000000001 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473477+0000", 2024-05-09T09:54:46.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3929000000000001e-05 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473588+0000", 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110938 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.479810+0000", 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062221070000000002 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484173+0000", 2024-05-09T09:54:46.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436265 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484212+0000", 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9322000000000001e-05 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484246+0000", 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3626e-05 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1215 3.33 e58/18 3:cc65bbc6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_3:head v 58'3, mlcod=57'1)", 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.814279228, 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018005263000000001, 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9999999999999998e-07 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867905+0000", 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049302390000000003 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.711 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867938+0000", 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3309999999999998e-05 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867960+0000", 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1889999999999999e-05 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.868111+0000", 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151154 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.712 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.868155+0000", 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3545999999999999e-05 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.880884+0000", 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012729835 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.880979+0000", 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4789000000000003e-05 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.713 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1229 3.2c 3:34904b64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.561717364, 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020735874000000001, 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.714 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1229 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.715 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115539+0000", 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6200000000000001e-06 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119644+0000", 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041042090000000002 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119669+0000", 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5754000000000001e-05 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.716 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119684+0000", 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4209000000000001e-05 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119768+0000", 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4524999999999995e-05 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119922+0000", 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015423600000000001 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.120056+0000", 2024-05-09T09:54:46.717 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013380999999999999 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.129703+0000", 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009646422 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136158+0000", 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064555810000000002 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.718 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136223+0000", 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4523999999999994e-05 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136272+0000", 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8983999999999997e-05 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1356 3.35 3:af70797a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:46.719 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.444742849000001, 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018963760999999999, 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1356 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.720 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232514+0000", 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.237973+0000", 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054590610000000003 2024-05-09T09:54:46.721 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238009+0000", 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188999999999998e-05 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238033+0000", 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4769999999999998e-05 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238179+0000", 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014558299999999999 2024-05-09T09:54:46.722 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238427+0000", 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000247827 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238654+0000", 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022734200000000001 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.247463+0000", 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008808471 2024-05-09T09:54:46.723 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251130+0000", 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036668830000000001 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251327+0000", 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000197441 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251474+0000", 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147047 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.724 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1358 3.3b 3:dc65933b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.423364036000001, 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017217211999999999, 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.725 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1358 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253889+0000", 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.726 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.253892+0000", 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9399999999999998e-06 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259312+0000", 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054195659999999998 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259356+0000", 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4365e-05 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.727 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259384+0000", 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7662999999999999e-05 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259566+0000", 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000182246 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.259813+0000", 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024673000000000002 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:46.728 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.260045+0000", 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023265499999999999 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.269980+0000", 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009934801 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.270919+0000", 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00093904399999999999 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.729 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.271020+0000", 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101084 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.271106+0000", 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6118000000000005e-05 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1374 3.14 e59/31 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head v 59'2, mlcod=0'0)", 2024-05-09T09:54:46.730 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.312250684, 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018480588999999999, 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:46.731 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365005+0000", 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9529999999999999e-06 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369409+0000", 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044040859999999998 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.732 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369451+0000", 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1128999999999999e-05 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369469+0000", 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369600+0000", 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013082 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.733 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369641+0000", 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1051999999999999e-05 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383383+0000", 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013741913999999999 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383483+0000", 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010019200000000001 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.734 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1375 3.2c 3:35a92b62:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.298900596999999, 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018309355999999999, 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.735 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1375 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.736 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378356+0000", 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3400000000000002e-06 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384131+0000", 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057751529999999999 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384166+0000", 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4965999999999997e-05 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.737 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384189+0000", 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3329e-05 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384311+0000", 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121914 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384551+0000", 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000239471 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.738 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384817+0000", 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026635 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.393368+0000", 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085508100000000007 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396327+0000", 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029596599999999998 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.739 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396514+0000", 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018649000000000001 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396662+0000", 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147873 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1393 3.10 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.740 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.754103395, 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02062228, 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1393 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.741 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923152+0000", 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0190000000000001e-06 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.742 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926928+0000", 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037758520000000001 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926954+0000", 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6152e-05 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926967+0000", 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2925000000000001e-05 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.743 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927050+0000", 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3015000000000004e-05 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927188+0000", 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013808000000000001 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927320+0000", 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132311 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.744 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.936936+0000", 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096158560000000008 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943673+0000", 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067373729999999996 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943728+0000", 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5053000000000003e-05 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.745 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943772+0000", 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643999999999998e-05 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1403 3.a 3:53fcb7d2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.527369852, 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018525527, 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.746 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1403 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.747 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149887+0000", 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5240000000000001e-06 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153623+0000", 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037363919999999998 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.748 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153652+0000", 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8836e-05 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153666+0000", 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3824e-05 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153761+0000", 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4975000000000005e-05 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.749 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153967+0000", 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206085 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.154165+0000", 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198118 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.161143+0000", 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069783700000000002 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.750 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168262+0000", 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071186340000000004 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168343+0000", 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1044999999999994e-05 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168409+0000", 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5723999999999996e-05 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.751 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1656 3.35 3:ad423f51:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.9440900499999998, 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021084454999999998, 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1656 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.752 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733164+0000", 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2300000000000001e-06 2024-05-09T09:54:46.753 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733175+0000", 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0526999999999999e-05 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733201+0000", 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5952000000000002e-05 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733210+0000", 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5629999999999998e-06 2024-05-09T09:54:46.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744680+0000", 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011469795 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744936+0000", 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255691 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.754248+0000", 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093116970000000007 2024-05-09T09:54:46.755 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1726 3.3f e63/18 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head v 63'7, mlcod=59'5)", 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.1282622340000001, 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018934763, 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548993+0000", 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8139999999999999e-06 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551287+0000", 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022947499999999999 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551311+0000", 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3252999999999999e-05 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551323+0000", 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1926999999999999e-05 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551470+0000", 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014753100000000001 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551538+0000", 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7618000000000002e-05 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567876+0000", 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016337872 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567926+0000", 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9997999999999998e-05 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1852 3.a 3:51b30bfb:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.-8YTMN3Np4-WPo_8kfekdJPZnlVrJ88_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.170924+0000", 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.506328839, 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017834789, 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.760 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1852 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.170924+0000", 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.170924+0000", 2024-05-09T09:54:46.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.170927+0000", 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3700000000000002e-06 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.175132+0000", 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042054350000000004 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.175158+0000", 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6367999999999999e-05 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.175173+0000", 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4595e-05 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.175300+0000", 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127451 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.175554+0000", 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025324499999999998 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.175795+0000", 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024096999999999999 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.186731+0000", 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010935970999999999 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.188672+0000", 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001941017 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.188709+0000", 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6897999999999998e-05 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.188759+0000", 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0469000000000001e-05 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1876 3.a 3:52ea8d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.QD71QSIjnzYUJvkbUpu9yZ6kMZGI2uX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.90828393699999999, 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024394813000000001, 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1876 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.766 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768972+0000", 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.616e-06 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773360+0000", 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043882620000000004 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773389+0000", 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8731999999999999e-05 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773401+0000", 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2094e-05 2024-05-09T09:54:46.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773506+0000", 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105173 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773713+0000", 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020665399999999999 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773888+0000", 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017540899999999999 2024-05-09T09:54:46.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.785628+0000", 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011740301999999999 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793268+0000", 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076399040000000003 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793319+0000", 2024-05-09T09:54:46.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0841999999999999e-05 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793364+0000", 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4824999999999999e-05 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1885 3.11 e65/31 3:89f00d0a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.28:head v 65'7, mlcod=59'5)", 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.974002+0000", 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.70325103700000002, 2024-05-09T09:54:46.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017405291999999999, 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.974002+0000", 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.974002+0000", 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.974003+0000", 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.58e-07 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.976255+0000", 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022523460000000001 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.976288+0000", 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179000000000002e-05 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.976303+0000", 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4474000000000001e-05 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.976403+0000", 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000100969 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.976442+0000", 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8108999999999997e-05 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991342+0000", 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014900127000000001 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991407+0000", 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5629999999999993e-05 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1888 3.26 3:66cc2661:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.RVUWhTPr75VRTCdvqYW6zhcKOb-0e_t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:46.775 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.56265354700000003, 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021044698000000001, 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1888 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:46.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114602+0000", 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118409+0000", 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038070840000000001 2024-05-09T09:54:46.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118430+0000", 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1407e-05 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118441+0000", 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0438999999999999e-05 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118594+0000", 2024-05-09T09:54:46.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015285299999999999 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118989+0000", 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039577600000000003 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.119396+0000", 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040618000000000002 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.132480+0000", 2024-05-09T09:54:46.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013084760000000001 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135459+0000", 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029782390000000001 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135557+0000", 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8554999999999994e-05 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135644+0000", 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7145999999999995e-05 2024-05-09T09:54:46.780 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1916 3.36 3:6eedf4b4:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.VPNU2_fk3V70lu7RybtX1vlXVee9jX__1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.056162140999999999, 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024095032999999998, 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:46.781 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1916 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621094+0000", 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.36e-06 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626192+0000", 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050974690000000003 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626234+0000", 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2406e-05 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:46.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626253+0000", 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8776000000000001e-05 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626355+0000", 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101538 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626533+0000", 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017836699999999999 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:46.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626684+0000", 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151414 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.636642+0000", 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099573470000000001 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.644981+0000", 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083395520000000001 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:46.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645074+0000", 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3295999999999996e-05 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645186+0000", 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111508 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:46.786 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:46.787 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:46.787 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:46.787 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125517 s, 835 MB/s 2024-05-09T09:54:46.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:46.789 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:46.787+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:46.852 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.33 2024-05-09T09:54:46.852 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:46.852 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 34 2024-05-09T09:54:46.867 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:46.867 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:46.867 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123643 s, 848 MB/s 2024-05-09T09:54:46.889 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:46.885+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:46.960 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:46.960 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:46.960 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:46.960 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:46.974 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:46.990 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:46.987+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:47.014 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.34 2024-05-09T09:54:47.014 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.015 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 35 2024-05-09T09:54:47.030 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:47.030 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:47.030 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123398 s, 850 MB/s 2024-05-09T09:54:47.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:54:47.090 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:47.085+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:47.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:47.141 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:47.141 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:47.141 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:47.141 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:47.141 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:47.159 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:47.161 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.35 2024-05-09T09:54:47.161 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.161 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 36 2024-05-09T09:54:47.174 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:47.174 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:47.174 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011197 s, 936 MB/s 2024-05-09T09:54:47.207 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:47.205+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:47.269 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.36 2024-05-09T09:54:47.269 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.269 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 37 2024-05-09T09:54:47.280 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:47.281 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:47.281 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00945949 s, 1.1 GB/s 2024-05-09T09:54:47.292 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:47.291+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:47.292 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:47.292 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:47.310 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:47.310 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:47.338 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:47.338 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:47.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:47.338 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:47.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.338 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:47.338 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:54:47.338 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 106.03976121300001, 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020963909999999999, 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 113 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:54:47.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296494+0000", 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7599999999999996e-07 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296499+0000", 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296509+0000", 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026e-05 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296517+0000", 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2760000000000003e-06 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.341 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.311889+0000", 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015371839999999999 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312137+0000", 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024836900000000002 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312559+0000", 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042197099999999999 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313929+0000", 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013705659999999999 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317187+0000", 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00325743 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317332+0000", 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014464499999999999 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317457+0000", 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 106.039725968, 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.344 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:54:47.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:54:47.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:54:47.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 106.039691815, 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.350 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:47.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.352 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:47.355 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 106.03957129200001, 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:47.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:54:47.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 106.039535766, 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.361 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:54:47.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:54:47.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:54:47.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1157 3.13 3:cb26828e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.873154972000002, 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021985248999999998, 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1157 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463102+0000", 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3630000000000001e-06 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470773+0000", 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076712769999999998 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470806+0000", 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2802999999999997e-05 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470827+0000", 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1175999999999999e-05 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471017+0000", 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018967499999999999 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471279+0000", 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026242300000000002 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471498+0000", 2024-05-09T09:54:47.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021940300000000001 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.482134+0000", 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010635446999999999 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.484865+0000", 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027312460000000001 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485006+0000", 2024-05-09T09:54:47.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039099999999999 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485085+0000", 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9045e-05 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1169 3.39 3:9e334225:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.620745+0000", 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.715509741999998, 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020432082000000001, 2024-05-09T09:54:47.372 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1169 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.620745+0000", 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.620745+0000", 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.620748+0000", 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5669999999999999e-06 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.626385+0000", 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056370359999999998 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.626415+0000", 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9629999999999999e-05 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.626431+0000", 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6146000000000001e-05 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.626562+0000", 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000131261 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.626805+0000", 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000242453 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.627035+0000", 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023047399999999999 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.635295+0000", 2024-05-09T09:54:47.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0082596920000000008 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.640962+0000", 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0056671489999999998 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.641066+0000", 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104242 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.641177+0000", 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110432 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1178 3.37 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.618823799000001, 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030832948999999998, 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.378 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1178 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717434+0000", 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0060000000000001e-06 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721611+0000", 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041770929999999998 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721645+0000", 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4561999999999999e-05 2024-05-09T09:54:47.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721678+0000", 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2700000000000002e-05 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721844+0000", 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165914 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722121+0000", 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027709300000000001 2024-05-09T09:54:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722352+0000", 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023117600000000001 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.733566+0000", 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011213989000000001 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748089+0000", 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014523036 2024-05-09T09:54:47.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748187+0000", 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7974999999999996e-05 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748263+0000", 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6404999999999998e-05 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.383 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1179 3.15 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.608144038999999, 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021009254000000002, 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1179 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728138+0000", 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7906e-05 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734782+0000", 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066435950000000004 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734827+0000", 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5269000000000003e-05 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734858+0000", 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0654000000000002e-05 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735020+0000", 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016203699999999999 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735274+0000", 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025399299999999999 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735518+0000", 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024406300000000001 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747370+0000", 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011852339 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748991+0000", 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016208259999999999 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749065+0000", 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4018999999999997e-05 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.388 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749120+0000", 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4552999999999998e-05 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1214 3.39 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.505826809999999, 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028754392, 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.389 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1214 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.390 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830433+0000", 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.237e-06 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838120+0000", 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076874200000000004 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838164+0000", 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4002999999999999e-05 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838186+0000", 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.198e-05 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838356+0000", 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169421 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838666+0000", 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031002599999999998 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838898+0000", 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023215000000000001 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.849862+0000", 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010964649 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.858862+0000", 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089996999999999994 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859048+0000", 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186128 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859182+0000", 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133678 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.394 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1216 3.e 3:734f2773:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.464101299999999, 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027271179999999999, 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1216 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.395 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872156+0000", 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.304e-06 2024-05-09T09:54:47.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876935+0000", 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047782440000000001 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876974+0000", 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9520000000000001e-05 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876999+0000", 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5286000000000002e-05 2024-05-09T09:54:47.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877108+0000", 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109063 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877300+0000", 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019180299999999999 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877468+0000", 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759199999999999 2024-05-09T09:54:47.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.886506+0000", 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379599999999994 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899047+0000", 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012540936000000001 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899286+0000", 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023885700000000001 2024-05-09T09:54:47.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899424+0000", 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138615 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1217 3.11 3:8a7f3d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.450510006000002, 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021949672, 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.400 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1217 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885747+0000", 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0429999999999999e-06 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893119+0000", 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073719229999999998 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893163+0000", 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3476000000000002e-05 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893188+0000", 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5443e-05 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893364+0000", 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017547400000000001 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.403 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893619+0000", 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025488300000000002 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893842+0000", 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022347099999999999 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907393+0000", 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013550804 2024-05-09T09:54:47.404 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907498+0000", 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010539099999999999 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907590+0000", 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1419e-05 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907694+0000", 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104345 2024-05-09T09:54:47.405 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1223 3.15 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.333322612, 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021427795999999999, 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.406 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1223 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.407 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002934+0000", 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2050000000000001e-06 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007103+0000", 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004168878 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007133+0000", 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0577999999999998e-05 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.408 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007145+0000", 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1844e-05 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007222+0000", 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6569000000000005e-05 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007366+0000", 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144053 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.409 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007494+0000", 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012810799999999999 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.015333+0000", 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078388439999999993 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024121+0000", 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087886230000000006 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024253+0000", 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013161800000000001 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024360+0000", 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106476 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1357 3.37 3:eda39a4c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.243543+0000", 2024-05-09T09:54:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.092711592000001, 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020704225999999999, 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1357 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.243543+0000", 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.243543+0000", 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.243547+0000", 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5229999999999997e-06 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.248853+0000", 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053061080000000004 2024-05-09T09:54:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.248894+0000", 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0942000000000002e-05 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.248913+0000", 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8580000000000002e-05 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.249046+0000", 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132927 2024-05-09T09:54:47.414 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.249311+0000", 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264756 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.249545+0000", 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023422499999999999 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.261986+0000", 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012440895 2024-05-09T09:54:47.415 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.263921+0000", 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019354610000000001 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.264112+0000", 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019074200000000001 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.264247+0000", 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000135067 2024-05-09T09:54:47.416 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1374 3.14 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 15.977702046999999, 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025594499999999999, 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.417 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1374 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.418 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358555+0000", 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0000000000000001e-06 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364047+0000", 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054919599999999997 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364082+0000", 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4903000000000001e-05 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.419 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364099+0000", 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7316000000000002e-05 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364233+0000", 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013302600000000001 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364481+0000", 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024840499999999999 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.420 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364757+0000", 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027572700000000003 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.372096+0000", 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007339702 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383918+0000", 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01182211 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.421 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384024+0000", 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105251 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384147+0000", 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012310000000000001 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1720 3.d 3:b3cdf7d6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.CpCcCMLkwBimVYxoW8LjvANQOboLxkv_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.422081+0000", 2024-05-09T09:54:47.422 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.9141731029999995, 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020482877, 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1720 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.422081+0000", 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.423 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.422081+0000", 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.422086+0000", 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5560000000000001e-06 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.426809+0000", 2024-05-09T09:54:47.424 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047233090000000002 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.426834+0000", 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4448999999999999e-05 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.426846+0000", 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2099000000000001e-05 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.426976+0000", 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012994699999999999 2024-05-09T09:54:47.425 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.427116+0000", 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014066299999999999 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.427293+0000", 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0001771 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.438261+0000", 2024-05-09T09:54:47.426 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010967899999999999 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.442463+0000", 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042020740000000001 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.442519+0000", 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5775e-05 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.442564+0000", 2024-05-09T09:54:47.427 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5005e-05 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1726 3.3f 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.7915998469999996, 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023921398, 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.428 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1726 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.429 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544657+0000", 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548394+0000", 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003737326 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548421+0000", 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6865000000000001e-05 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.430 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548434+0000", 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2605e-05 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548514+0000", 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0352000000000006e-05 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548671+0000", 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156231 2024-05-09T09:54:47.431 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548814+0000", 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014296600000000001 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.559185+0000", 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010371949 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568269+0000", 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090838789999999996 2024-05-09T09:54:47.432 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568449+0000", 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179407 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568576+0000", 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012715400000000001 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.433 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1882 3.f 3:f105a2b8:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_._ZJGvmLNeGrzOnWnfWyHE4qGyf3IHqo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.939981+0000", 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.3962729460000001, 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020474077, 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1882 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.434 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.939981+0000", 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.939981+0000", 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.939989+0000", 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5020000000000003e-06 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.435 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.944214+0000", 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004225548 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.944239+0000", 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4477e-05 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.944250+0000", 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1528e-05 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.436 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.944330+0000", 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9808000000000006e-05 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.944465+0000", 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000134988 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.944580+0000", 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000115151 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.949365+0000", 2024-05-09T09:54:47.437 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047845969999999998 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.960356+0000", 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010991147 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.960411+0000", 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5075999999999999e-05 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.438 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.960455+0000", 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4255000000000002e-05 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1885 3.11 3:89f00d0a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.28:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.3671011470000001, 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022582944000000001, 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.439 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1885 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.440 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969162+0000", 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.268e-06 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973026+0000", 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038637680000000001 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973055+0000", 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8858000000000001e-05 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.441 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973067+0000", 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2184999999999999e-05 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973141+0000", 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3747999999999999e-05 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973302+0000", 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016143099999999999 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.442 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973741+0000", 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043816299999999999 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991002+0000", 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017261155 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991603+0000", 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060141600000000002 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.443 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991671+0000", 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7433000000000003e-05 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991736+0000", 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5518999999999994e-05 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1931 3.f 3:f2a153e3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:47.444 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.342872705, 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021453967000000001, 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1931 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:47.445 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993383+0000", 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.127e-06 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:47.446 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997421+0000", 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040380599999999996 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997440+0000", 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9477e-05 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997453+0000", 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2498e-05 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997539+0000", 2024-05-09T09:54:47.447 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6473999999999999e-05 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997702+0000", 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016321 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.998188+0000", 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048555899999999999 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.006182+0000", 2024-05-09T09:54:47.448 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079940800000000006 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014666+0000", 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084836749999999995 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014767+0000", 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010093499999999999 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014836+0000", 2024-05-09T09:54:47.449 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8872000000000001e-05 2024-05-09T09:54:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:47.450 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:47.450 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:47.451 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:47.451 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:47.452 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:47.452 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:47.452 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.37 2024-05-09T09:54:47.453 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.453 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 38 2024-05-09T09:54:47.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:47.453 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:47.453 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:47.454 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00882027 s, 1.2 GB/s 2024-05-09T09:54:47.454 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:47.454 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:47.454 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:47.455 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:47.455 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:47.455 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:47.455 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:47.456 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:47.456 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:47.451+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:47.471 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.38 2024-05-09T09:54:47.471 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.471 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 39 2024-05-09T09:54:47.481 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:47.482 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:47.482 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00902484 s, 1.2 GB/s 2024-05-09T09:54:47.552 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:47.549+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:47.591 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:47.591 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:47.594 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.39 2024-05-09T09:54:47.594 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.594 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 40 2024-05-09T09:54:47.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:47.608 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:47.608 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:47.608 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112411 s, 933 MB/s 2024-05-09T09:54:47.694 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:47.695+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:47.698 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.40 2024-05-09T09:54:47.699 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.699 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 41 2024-05-09T09:54:47.711 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:47.712 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:47.712 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105558 s, 993 MB/s 2024-05-09T09:54:47.754 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:47.749+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:47.780 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:47.780 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:47.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:47.846 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.41 2024-05-09T09:54:47.846 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.846 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 42 2024-05-09T09:54:47.855 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:47.853+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:47.857 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:47.857 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:47.857 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0094771 s, 1.1 GB/s 2024-05-09T09:54:47.957 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:47.953+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:47.968 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:47.968 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:47.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:47.985 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.42 2024-05-09T09:54:47.985 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:47.985 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 43 2024-05-09T09:54:48.001 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:48.001 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:48.001 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0138818 s, 755 MB/s 2024-05-09T09:54:48.002 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:54:48.070 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:48.071+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:48.115 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.43 2024-05-09T09:54:48.115 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:48.115 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 44 2024-05-09T09:54:48.124 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:48.124 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:48.128 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:48.129 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:48.129 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106452 s, 985 MB/s 2024-05-09T09:54:48.140 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:48.159 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:48.157+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:48.252 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.44 2024-05-09T09:54:48.253 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:48.253 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 45 2024-05-09T09:54:48.259 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:48.257+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:48.264 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:48.264 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:48.264 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0100171 s, 1.0 GB/s 2024-05-09T09:54:48.316 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:48.316 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:48.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:48.363 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:48.361+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:48.400 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.45 2024-05-09T09:54:48.400 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:48.400 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 46 2024-05-09T09:54:48.411 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:48.411 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:48.411 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00893629 s, 1.2 GB/s 2024-05-09T09:54:48.460 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:48.460 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:48.464 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:48.463+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:48.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:48.537 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.46 2024-05-09T09:54:48.537 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:48.537 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 47 2024-05-09T09:54:48.550 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:48.550 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:48.550 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112857 s, 929 MB/s 2024-05-09T09:54:48.565 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:48.561+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:48.654 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:48.654 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:48.660 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.47 2024-05-09T09:54:48.660 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:48.660 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 48 2024-05-09T09:54:48.666 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:48.661+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:48.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:48.674 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:48.674 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:48.674 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109711 s, 956 MB/s 2024-05-09T09:54:48.767 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:48.765+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:48.787 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.48 2024-05-09T09:54:48.787 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:48.787 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 49 2024-05-09T09:54:48.801 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:48.801 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:48.801 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112726 s, 930 MB/s 2024-05-09T09:54:48.817 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:48.817 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:48.831 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:48.868 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:48.865+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:48.915 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.49 2024-05-09T09:54:48.915 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:48.915 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 50 2024-05-09T09:54:48.929 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:48.929 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:48.929 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114015 s, 920 MB/s 2024-05-09T09:54:48.957 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:48.957 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:48.970 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:48.965+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:48.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:49.038 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.50 2024-05-09T09:54:49.038 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:49.038 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 51 2024-05-09T09:54:49.050 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:49.051 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:49.051 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104879 s, 1000 MB/s 2024-05-09T09:54:49.070 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:49.071+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:49.109 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:49.109 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:49.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:49.172 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.51 2024-05-09T09:54:49.172 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:49.172 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 52 2024-05-09T09:54:49.172 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:49.171+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:49.183 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:49.183 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:49.183 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0096746 s, 1.1 GB/s 2024-05-09T09:54:49.272 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:49.271+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:49.299 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.52 2024-05-09T09:54:49.299 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:49.299 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 53 2024-05-09T09:54:49.303 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:49.304 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:49.313 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:49.313 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:49.313 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114438 s, 916 MB/s 2024-05-09T09:54:49.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:49.406 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:49.407+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:49.433 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.53 2024-05-09T09:54:49.433 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:49.433 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 54 2024-05-09T09:54:49.445 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:49.445 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:49.446 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104932 s, 999 MB/s 2024-05-09T09:54:49.469 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:49.473 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:49.469+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:49.490 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:49.490 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:49.509 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:49.558 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.54 2024-05-09T09:54:49.558 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:49.558 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 55 2024-05-09T09:54:49.568 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:49.568 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:49.568 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00890896 s, 1.2 GB/s 2024-05-09T09:54:49.573 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:49.569+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:49.623 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:49.623 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:49.638 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:49.639 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:49.643 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:49.643 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:49.656 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:49.662 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:49.662 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:49.676 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.55 2024-05-09T09:54:49.676 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:49.676 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 56 2024-05-09T09:54:49.679 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:49.679 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:49.686 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:49.686 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:49.686 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00897056 s, 1.2 GB/s 2024-05-09T09:54:49.699 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:49.700 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:49.703 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:49.701+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:49.719 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:49.719 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:49.741 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:49.741 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:49.760 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:49.760 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:49.775 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:49.773+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:49.780 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.56 2024-05-09T09:54:49.780 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:49.780 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 57 2024-05-09T09:54:49.791 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:49.791 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:49.791 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00891863 s, 1.2 GB/s 2024-05-09T09:54:49.826 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:49.827 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:49.827 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:49.827 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:49.827 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:49.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:49.876 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:49.875+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:49.887 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.57 2024-05-09T09:54:49.887 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:49.887 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 58 2024-05-09T09:54:49.901 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:49.901 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:49.901 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114509 s, 916 MB/s 2024-05-09T09:54:49.977 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:49.973+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.895285384000005, 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019579709000000001, 2024-05-09T09:54:50.019 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "reached pg", 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 43 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119947+0000", 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119950+0000", 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1200000000000002e-06 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.119985+0000", 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4941999999999999e-05 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120018+0000", 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3179999999999997e-05 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120040+0000", 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2432000000000001e-05 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120194+0000", 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015399700000000001 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.022 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.120215+0000", 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0886e-05 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139214+0000", 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018999381999999999 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:13.139526+0000", 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031177000000000001 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.023 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.813035413999998, 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787665, 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.024 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 211 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202197+0000", 2024-05-09T09:54:50.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202200+0000", 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202215+0000", 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5656999999999999e-05 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202254+0000", 2024-05-09T09:54:50.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8506e-05 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202272+0000", 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8300000000000001e-05 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202427+0000", 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015497699999999999 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.202662+0000", 2024-05-09T09:54:50.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000234928 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.203104+0000", 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000442151 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.204510+0000", 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014061329999999999 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205816+0000", 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013059009999999999 2024-05-09T09:54:50.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205907+0000", 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0841000000000007e-05 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.205984+0000", 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7164999999999997e-05 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.029 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.737715589999993, 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034049729999999999, 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 232 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:50.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277516+0000", 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277519+0000", 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.65e-06 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277531+0000", 2024-05-09T09:54:50.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2320000000000001e-05 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277564+0000", 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2669999999999997e-05 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277579+0000", 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5415999999999999e-05 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277729+0000", 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014924 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.277957+0000", 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022849599999999999 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.278368+0000", 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041114500000000002 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.279935+0000", 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0015665290000000001 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280758+0000", 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00082300099999999996 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280850+0000", 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1978000000000006e-05 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.280921+0000", 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.1527999999999997e-05 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:281 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.709387661999997, 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030930129999999999, 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.035 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 281 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305844+0000", 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305847+0000", 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3300000000000001e-06 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305858+0000", 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.099e-05 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305882+0000", 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4026999999999999e-05 2024-05-09T09:54:50.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.305905+0000", 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3376000000000001e-05 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306060+0000", 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000154757 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.306388+0000", 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032792699999999999 2024-05-09T09:54:50.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.307138+0000", 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074994099999999995 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308466+0000", 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013284569999999999 2024-05-09T09:54:50.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308604+0000", 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137677 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308776+0000", 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017272000000000001 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.308937+0000", 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016081099999999999 2024-05-09T09:54:50.040 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:360 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.696094346999999, 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038853109999999998, 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 360 2024-05-09T09:54:50.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319138+0000", 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319140+0000", 2024-05-09T09:54:50.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.057e-06 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319151+0000", 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1739999999999999e-05 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319180+0000", 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8578999999999999e-05 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319200+0000", 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0236000000000001e-05 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319337+0000", 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013646400000000001 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.319617+0000", 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00028014499999999998 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:50.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.320147+0000", 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052992600000000001 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.321598+0000", 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014515820000000001 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.045 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322829+0000", 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012307959999999999 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.322925+0000", 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5494000000000004e-05 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.323023+0000", 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8292e-05 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.046 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:378 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.691048398999996, 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036244110000000001, 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 378 2024-05-09T09:54:50.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324184+0000", 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324187+0000", 2024-05-09T09:54:50.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0759999999999999e-06 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324203+0000", 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.609e-05 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324240+0000", 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7052999999999999e-05 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324262+0000", 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2195999999999999e-05 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324396+0000", 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013415700000000001 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.324628+0000", 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023225200000000001 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.325138+0000", 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050956299999999999 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.326372+0000", 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012345489999999999 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327556+0000", 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011832430000000001 2024-05-09T09:54:50.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327701+0000", 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014539699999999999 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.327808+0000", 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106835 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.675690833000004, 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0030876559999999998, 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 406 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.053 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339541+0000", 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339543+0000", 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2570000000000002e-06 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339553+0000", 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7429999999999997e-06 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339576+0000", 2024-05-09T09:54:50.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2857000000000002e-05 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339591+0000", 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4905e-05 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.339738+0000", 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014698599999999999 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340100+0000", 2024-05-09T09:54:50.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036169499999999999 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.340703+0000", 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060361099999999999 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342128+0000", 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014245690000000001 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342467+0000", 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033892500000000001 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342554+0000", 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7527000000000004e-05 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.342629+0000", 2024-05-09T09:54:50.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4580999999999996e-05 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:438 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'3, mlcod=30'1)", 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.655302378000002, 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036072999999999999, 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.059 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359930+0000", 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359931+0000", 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.891e-06 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359945+0000", 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3934000000000001e-05 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359978+0000", 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2465000000000002e-05 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.359996+0000", 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8091e-05 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360123+0000", 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012710900000000001 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.062 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.360164+0000", 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0719000000000001e-05 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363453+0000", 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003289555 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.363537+0000", 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3535999999999994e-05 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:443 6.6 e30/24 6:64760185:::obj_delete_at_hint.0000000010:head v 30'4, mlcod=30'2)", 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.650319576000001, 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0034263010000000001, 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364912+0000", 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364914+0000", 2024-05-09T09:54:50.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.677e-06 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364925+0000", 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0628000000000001e-05 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364948+0000", 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3594000000000001e-05 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.364960+0000", 2024-05-09T09:54:50.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2017e-05 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365077+0000", 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116706 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.365114+0000", 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6908e-05 2024-05-09T09:54:50.067 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368217+0000", 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031027820000000001 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.368339+0000", 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121989 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.068 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:499 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.619635904999996, 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028199750000000002, 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 499 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.069 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395596+0000", 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.070 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395598+0000", 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0470000000000001e-06 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395609+0000", 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1083e-05 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395631+0000", 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1953000000000001e-05 2024-05-09T09:54:50.071 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395644+0000", 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2860000000000001e-05 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395771+0000", 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127231 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.072 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.395990+0000", 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000218779 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.396428+0000", 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000437854 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.397598+0000", 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011703239999999999 2024-05-09T09:54:50.073 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398222+0000", 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00062386500000000003 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398324+0000", 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010160100000000001 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.074 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.398416+0000", 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2378000000000002e-05 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.533217448000002, 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085482570000000001, 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.075 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 633 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.076 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482014+0000", 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482016+0000", 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9300000000000002e-06 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.077 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482024+0000", 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0630000000000006e-06 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482042+0000", 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7713000000000001e-05 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482053+0000", 2024-05-09T09:54:50.078 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1246e-05 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482171+0000", 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117465 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482382+0000", 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000210719 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.482853+0000", 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047157999999999998 2024-05-09T09:54:50.079 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.485997+0000", 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031434620000000001 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490455+0000", 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004458414 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490516+0000", 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0488000000000001e-05 2024-05-09T09:54:50.080 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.490563+0000", 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7176999999999999e-05 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.463551160999998, 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003787257, 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.081 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 709 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551681+0000", 2024-05-09T09:54:50.082 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551683+0000", 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4059999999999999e-06 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551696+0000", 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2697000000000001e-05 2024-05-09T09:54:50.083 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551725+0000", 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8890999999999998e-05 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551743+0000", 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7878999999999999e-05 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.551889+0000", 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014628199999999999 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.084 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552237+0000", 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034787300000000001 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.552746+0000", 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00050886300000000002 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.554142+0000", 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013964120000000001 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.085 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555320+0000", 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001177974 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555400+0000", 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9468000000000006e-05 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.555468+0000", 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8511999999999997e-05 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.086 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.425707255000006, 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028728, 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 727 2024-05-09T09:54:50.087 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589525+0000", 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.088 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589527+0000", 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.356e-06 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589538+0000", 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1463e-05 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589571+0000", 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2140000000000001e-05 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.089 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589592+0000", 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1219000000000001e-05 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.589739+0000", 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147424 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590004+0000", 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264632 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.090 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.590346+0000", 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034226299999999999 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592098+0000", 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001752116 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.091 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592249+0000", 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015033000000000001 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592335+0000", 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5890999999999995e-05 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.592397+0000", 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2966000000000007e-05 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.092 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.421941140000001, 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031054329999999999, 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 729 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.093 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593291+0000", 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593292+0000", 2024-05-09T09:54:50.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.344e-06 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593300+0000", 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5229999999999998e-06 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593321+0000", 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1299999999999999e-05 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593339+0000", 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8206000000000002e-05 2024-05-09T09:54:50.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593428+0000", 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8928e-05 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593547+0000", 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118794 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.593824+0000", 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027681500000000003 2024-05-09T09:54:50.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.595408+0000", 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001584086 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596242+0000", 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00083392999999999998 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596333+0000", 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0878000000000006e-05 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.596396+0000", 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.3628999999999997e-05 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.320160389999998, 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031859179999999998, 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.098 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 775 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695072+0000", 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695074+0000", 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.723e-06 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695086+0000", 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1457000000000001e-05 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695117+0000", 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1343000000000001e-05 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695138+0000", 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0622999999999999e-05 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695261+0000", 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123621 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.695596+0000", 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00033511000000000001 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.696142+0000", 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00054512500000000004 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.697459+0000", 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013177480000000001 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698089+0000", 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00063017800000000001 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698179+0000", 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9511000000000004e-05 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.698257+0000", 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8479000000000005e-05 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.103 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.229389178999995, 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002852074, 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 814 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785843+0000", 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785845+0000", 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1600000000000001e-06 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785856+0000", 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1323e-05 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785887+0000", 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0602999999999998e-05 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.785901+0000", 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4612e-05 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786031+0000", 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012920100000000001 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786246+0000", 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021583299999999999 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.786562+0000", 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031516999999999998 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.787822+0000", 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001260359 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788501+0000", 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00067859300000000001 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788589+0000", 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7961999999999996e-05 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.788695+0000", 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106258 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.072168433000002, 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029203889999999998, 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 880 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943063+0000", 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943067+0000", 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1870000000000001e-06 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943079+0000", 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2319e-05 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943111+0000", 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1779999999999997e-05 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943126+0000", 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5285999999999999e-05 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943239+0000", 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112631 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943472+0000", 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023326299999999999 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.943790+0000", 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031812600000000001 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.944926+0000", 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0011362519999999999 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945815+0000", 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00088909199999999996 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945906+0000", 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0997999999999998e-05 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.945984+0000", 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7454999999999996e-05 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 91.064943808999999, 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028357909999999998, 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.115 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 883 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950288+0000", 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950290+0000", 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3e-06 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950303+0000", 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.261e-05 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950334+0000", 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0919e-05 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950354+0000", 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9865999999999999e-05 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950487+0000", 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013334800000000001 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.950710+0000", 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000223002 2024-05-09T09:54:50.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.951056+0000", 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034612999999999999 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952129+0000", 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010729820000000001 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.952975+0000", 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00084584999999999999 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953059+0000", 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4371999999999998e-05 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:18.953124+0000", 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4412000000000006e-05 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.120 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.995241003999993, 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0028784679999999999, 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 913 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019991+0000", 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.019993+0000", 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3769999999999999e-06 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020005+0000", 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1797000000000001e-05 2024-05-09T09:54:50.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020036+0000", 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0876000000000001e-05 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020051+0000", 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4739000000000001e-05 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020163+0000", 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000112432 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020385+0000", 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022189200000000001 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.020709+0000", 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032386699999999998 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.021761+0000", 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001051979 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022727+0000", 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00096616099999999999 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022805+0000", 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.8009000000000005e-05 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.022869+0000", 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4338999999999995e-05 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.125 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 90.958286557999998, 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00285995, 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 928 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.126 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056945+0000", 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056947+0000", 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.81e-06 2024-05-09T09:54:50.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056957+0000", 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5829999999999996e-06 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056980+0000", 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3278999999999999e-05 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.056992+0000", 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2437e-05 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057171+0000", 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017842199999999999 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057393+0000", 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022195 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.057705+0000", 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000311687 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.058914+0000", 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012093029999999999 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059652+0000", 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00073784800000000004 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059738+0000", 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6231999999999997e-05 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:19.059805+0000", 2024-05-09T09:54:50.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7398999999999996e-05 2024-05-09T09:54:50.131 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.131 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.131 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.131 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.131 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.131 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:50.131 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:54:50.132 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.58 2024-05-09T09:54:50.132 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:50.132 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 59 2024-05-09T09:54:50.133 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:50.133 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:50.133 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.013382 s, 784 MB/s 2024-05-09T09:54:50.134 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:50.134 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:50.129+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:50.173 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.59 2024-05-09T09:54:50.173 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:50.173 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 60 2024-05-09T09:54:50.185 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:50.185 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:50.185 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00993777 s, 1.1 GB/s 2024-05-09T09:54:50.233 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:50.231+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:50.287 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.60 2024-05-09T09:54:50.287 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:50.287 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 61 2024-05-09T09:54:50.299 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:50.299 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:50.299 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109274 s, 960 MB/s 2024-05-09T09:54:50.312 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:50.312 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:50.312 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:50.312 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:50.326 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:50.334 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:50.335+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:50.388 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.61 2024-05-09T09:54:50.388 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:50.388 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 62 2024-05-09T09:54:50.400 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:50.400 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:50.400 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00982293 s, 1.1 GB/s 2024-05-09T09:54:50.435 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:50.435+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:50.446 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:50.446 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:50.446 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:50.447 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:50.447 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:50.461 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:50.507 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.62 2024-05-09T09:54:50.508 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:50.508 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 63 2024-05-09T09:54:50.518 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:50.518 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:50.519 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00959028 s, 1.1 GB/s 2024-05-09T09:54:50.536 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:50.535+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:50.593 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:50.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1161 3.1d 3:b8b74cb5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.071836868999998, 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020326487000000001, 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.594 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1161 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:50.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518545+0000", 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639999999999998e-06 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522778+0000", 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042321429999999998 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522816+0000", 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624000000000002e-05 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522834+0000", 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522974+0000", 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523215+0000", 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024094700000000001 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523432+0000", 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217333 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.532230+0000", 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087981150000000004 2024-05-09T09:54:50.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538624+0000", 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063944249999999996 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538717+0000", 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2608999999999994e-05 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538867+0000", 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150357 2024-05-09T09:54:50.599 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1164 3.2a 3:563cc67e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.030042616999999, 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023925154000000001, 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.600 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1164 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560338+0000", 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2499999999999998e-06 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564645+0000", 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043069290000000001 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564681+0000", 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5746e-05 2024-05-09T09:54:50.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564697+0000", 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6269999999999998e-05 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564822+0000", 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012474099999999999 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565074+0000", 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025190400000000001 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565300+0000", 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226133 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.572636+0000", 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073360760000000004 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584083+0000", 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011446424 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584177+0000", 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4518999999999994e-05 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584260+0000", 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3162000000000001e-05 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.608 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1178 3.37 e57/18 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.867825698000001, 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025242840999999999, 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722556+0000", 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5159999999999999e-06 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728655+0000", 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060999039999999997 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728694+0000", 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8009999999999997e-05 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728710+0000", 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6880000000000001e-05 2024-05-09T09:54:50.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728899+0000", 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018883699999999999 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728968+0000", 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9041999999999994e-05 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747653+0000", 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018684905000000002 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747795+0000", 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014174700000000001 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.613 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1201 3.2a 3:54ff7f97:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.242196979999999, 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020960774000000001, 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348183+0000", 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9889999999999999e-06 2024-05-09T09:54:50.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352065+0000", 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038826189999999999 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352086+0000", 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0407e-05 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352100+0000", 2024-05-09T09:54:50.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3745e-05 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352173+0000", 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3335000000000002e-05 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352330+0000", 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015688400000000001 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:50.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352462+0000", 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013203100000000001 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.365714+0000", 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013252553 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.368997+0000", 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032823800000000001 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369079+0000", 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2639999999999995e-05 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369142+0000", 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2191000000000001e-05 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1213 3.22 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.774410344, 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022416997000000001, 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.620 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1213 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:50.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815970+0000", 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6079999999999998e-06 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819807+0000", 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038369699999999999 2024-05-09T09:54:50.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819837+0000", 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0423999999999999e-05 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819850+0000", 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2594e-05 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819953+0000", 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102543 2024-05-09T09:54:50.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820186+0000", 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023374800000000001 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820600+0000", 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041405700000000001 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.833246+0000", 2024-05-09T09:54:50.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012645854 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838263+0000", 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050170529999999996 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838332+0000", 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9202000000000006e-05 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838384+0000", 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1944000000000003e-05 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1234 3.2f 3:f547a26d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.353388166999999, 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021134344999999999, 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1234 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236992+0000", 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.12e-06 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.240966+0000", 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039738539999999998 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241001+0000", 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5169999999999997e-05 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241018+0000", 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7523000000000001e-05 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241186+0000", 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016797099999999999 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241562+0000", 2024-05-09T09:54:50.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037583099999999997 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241922+0000", 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036000099999999998 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.255413+0000", 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013490925000000001 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.257956+0000", 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025432250000000001 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258047+0000", 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1108999999999998e-05 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258124+0000", 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6616e-05 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.631 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1354 3.2f 3:f6a59ae0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.381631785, 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019275487000000001, 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1354 2024-05-09T09:54:50.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208748+0000", 2024-05-09T09:54:50.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4569999999999999e-06 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212622+0000", 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038735649999999998 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212658+0000", 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5709e-05 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212674+0000", 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6373000000000001e-05 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212860+0000", 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000185479 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213131+0000", 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027101700000000002 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213376+0000", 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024525700000000003 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.220719+0000", 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073430400000000003 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227786+0000", 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070674259999999999 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.636 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227893+0000", 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106884 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.228021+0000", 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012828000000000001 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1394 3.1d 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:50.637 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.642468729000001, 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021946568999999999, 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1394 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.638 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947912+0000", 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5979999999999999e-06 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.639 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952060+0000", 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041480270000000003 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952101+0000", 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0948999999999997e-05 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952129+0000", 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8634999999999999e-05 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.640 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952302+0000", 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017274599999999999 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952559+0000", 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025720799999999998 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952811+0000", 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252124 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.641 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.961321+0000", 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085092090000000002 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969641+0000", 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083202880000000003 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969737+0000", 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6642000000000001e-05 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.642 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969856+0000", 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118143 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1729 3.3a 3:5ffa07d6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.574263+0000", 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.0161145789999999, 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017767160000000001, 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.643 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1729 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.574263+0000", 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.574263+0000", 2024-05-09T09:54:50.644 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.574267+0000", 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6600000000000001e-06 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579395+0000", 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051283600000000002 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579435+0000", 2024-05-09T09:54:50.645 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9526000000000001e-05 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579453+0000", 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8267e-05 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579545+0000", 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2063000000000003e-05 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.579707+0000", 2024-05-09T09:54:50.646 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016210000000000001 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.580185+0000", 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00047816800000000001 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.591328+0000", 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011142887000000001 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.591891+0000", 2024-05-09T09:54:50.647 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056308900000000002 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.591979+0000", 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8066999999999996e-05 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.592030+0000", 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0973000000000001e-05 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.648 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1732 3.2a 3:57cad4d0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.z7A6gvGdCsGpYkA4afvy42BiLcIeNy9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 7.9207858069999997, 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020981109000000001, 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1732 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.649 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669595+0000", 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8159999999999998e-06 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.650 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673343+0000", 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037477550000000002 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673372+0000", 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9085999999999999e-05 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673384+0000", 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2615e-05 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.651 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673496+0000", 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111888 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673731+0000", 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023452 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673945+0000", 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021394900000000001 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.652 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.686870+0000", 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012925624 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690449+0000", 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035790399999999999 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690522+0000", 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2745999999999998e-05 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.653 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690573+0000", 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1069999999999997e-05 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1864 3.30 3:0f8e5753:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.vjrfU8R0YhW7bZ2SDYx38ZOxKyLoEJ4_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.1442800670000004, 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020719274999999999, 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.654 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1864 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:50.655 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446101+0000", 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.49e-06 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450033+0000", 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039319380000000003 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450059+0000", 2024-05-09T09:54:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5548e-05 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450071+0000", 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2245999999999999e-05 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450231+0000", 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000160464 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450626+0000", 2024-05-09T09:54:50.657 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039443900000000001 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.451035+0000", 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040921300000000001 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.463627+0000", 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012592067 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.658 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466538+0000", 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029110289999999999 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466696+0000", 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015758999999999999 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466817+0000", 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012125099999999999 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.659 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1873 3.38 3:1e64df2a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.26:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.9637033339999999, 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019915188, 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1873 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.660 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626678+0000", 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8e-06 2024-05-09T09:54:50.661 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630890+0000", 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042116360000000004 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630924+0000", 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3708999999999999e-05 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630937+0000", 2024-05-09T09:54:50.662 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3841e-05 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.631046+0000", 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010836 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.631313+0000", 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026688200000000002 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.663 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.632056+0000", 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074307599999999996 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.640884+0000", 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008828743 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646477+0000", 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055922339999999997 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.664 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646542+0000", 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5617999999999994e-05 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646590+0000", 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7289000000000001e-05 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1879 3.3a 3:5c465ff6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.27:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:50.665 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.797883+0000", 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.7924947710000003, 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018545826000000001, 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1879 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.666 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.797883+0000", 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.797883+0000", 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.797885+0000", 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9139999999999998e-06 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.667 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802068+0000", 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041826490000000001 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802096+0000", 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8228000000000001e-05 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802107+0000", 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.166e-05 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.668 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802190+0000", 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2826999999999998e-05 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802347+0000", 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015719599999999999 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.802801+0000", 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00045321100000000002 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.669 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.814288+0000", 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011487212 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.816324+0000", 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002035902 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.816386+0000", 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2558999999999995e-05 2024-05-09T09:54:50.670 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.816429+0000", 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2468000000000001e-05 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1891 3.38 3:1c43b68b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.448998274, 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020059576999999999, 2024-05-09T09:54:50.671 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1891 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.672 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141381+0000", 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.615e-06 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146198+0000", 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048167419999999997 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.673 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146231+0000", 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3565999999999997e-05 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146248+0000", 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6540000000000001e-05 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146358+0000", 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010968600000000001 2024-05-09T09:54:50.674 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146575+0000", 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000216899 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.147140+0000", 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056583299999999996 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.160803+0000", 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013662934 2024-05-09T09:54:50.675 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161343+0000", 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053952500000000001 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161400+0000", 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7092000000000002e-05 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161439+0000", 2024-05-09T09:54:50.676 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9144999999999999e-05 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1894 3.16 3:69a35412:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Ig8kFEWIjDq7HYYp5tuK_irJqtS6Tda_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.283939+0000", 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.306438333, 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019047972, 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.677 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1894 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.283939+0000", 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.283939+0000", 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.678 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.283942+0000", 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4959999999999999e-06 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.287687+0000", 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037452090000000002 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.287716+0000", 2024-05-09T09:54:50.679 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8759999999999999e-05 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.287727+0000", 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1093e-05 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.287808+0000", 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1011000000000001e-05 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.287983+0000", 2024-05-09T09:54:50.680 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017492399999999999 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.288156+0000", 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000172802 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.302702+0000", 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014546125 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.302863+0000", 2024-05-09T09:54:50.681 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000160977 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.302931+0000", 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7700999999999994e-05 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.302987+0000", 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6873999999999998e-05 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.682 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1922 3.5 3:a3ee2791:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.0Ed7ZEVcL9CnMwDM9Yiij5ANu2WW139_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.7904009780000001, 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02035182, 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1922 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.683 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799980+0000", 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1599999999999998e-06 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.684 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804290+0000", 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043101099999999998 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804327+0000", 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7143e-05 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804345+0000", 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7946000000000001e-05 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.685 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804484+0000", 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013861099999999999 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804756+0000", 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027221899999999998 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.805005+0000", 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024909200000000002 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.686 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.818965+0000", 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013960006 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820010+0000", 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010453179999999999 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820196+0000", 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186047 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.687 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820329+0000", 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132168 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1934 3.1 e65/62 3:83810aba:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.bd0uPieH5yAMY0BuB5M_Z7ovAps42t5_1:head v 65'5, mlcod=59'3)", 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4742165429999998, 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023284467, 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.688 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116163+0000", 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.04e-06 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121321+0000", 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051577749999999999 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121366+0000", 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4948999999999999e-05 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.690 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121384+0000", 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7533e-05 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121537+0000", 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015350699999999999 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121594+0000", 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6545999999999997e-05 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.691 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.139359+0000", 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017765689000000001 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.139446+0000", 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6428000000000007e-05 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1937 3.38 3:1c8e92cb:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.35:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:47.142747+0000", 2024-05-09T09:54:50.692 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.4476311800000001, 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018922831000000001, 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1937 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.142747+0000", 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.693 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.142747+0000", 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.142749+0000", 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.973e-06 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.146519+0000", 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037705730000000002 2024-05-09T09:54:50.694 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.146544+0000", 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5174e-05 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.146557+0000", 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2733e-05 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.146709+0000", 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015149 2024-05-09T09:54:50.695 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.146977+0000", 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026841499999999998 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.147886+0000", 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000908657 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.161563+0000", 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013677523 2024-05-09T09:54:50.696 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.161583+0000", 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9983000000000002e-05 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.161632+0000", 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9007e-05 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.161669+0000", 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7302999999999998e-05 2024-05-09T09:54:50.697 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2063 3.3c 3:3eb6c819:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.drYfIz3DDji66DRgGfM7LrUldQKIp5V_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:49.744461+0000", 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.84591714299999998, 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019085393999999999, 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.698 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2063 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.744461+0000", 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.744461+0000", 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.699 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.744464+0000", 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.687e-06 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.748622+0000", 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004157493 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.700 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.748648+0000", 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5791000000000001e-05 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.748661+0000", 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3284e-05 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.748784+0000", 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123094 2024-05-09T09:54:50.701 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.748922+0000", 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137575 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.749052+0000", 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000130476 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.759483+0000", 2024-05-09T09:54:50.702 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010430790000000001 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.763449+0000", 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039662630000000003 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.763504+0000", 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4486e-05 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.763546+0000", 2024-05-09T09:54:50.703 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2454999999999999e-05 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2078 3.2 3:41c71c3b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.58:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.58491733999999995, 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024084686000000001, 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:50.704 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2078 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:50.705 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005463+0000", 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010468+0000", 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050052610000000004 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:50.706 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010508+0000", 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9950000000000002e-05 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010527+0000", 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8278999999999999e-05 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.707 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010652+0000", 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125785 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010924+0000", 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027113799999999998 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:50.708 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.011795+0000", 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00087143799999999999 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.027012+0000", 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015217101 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029226+0000", 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002213717 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.709 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029422+0000", 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019575699999999999 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029545+0000", 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123557 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:50.710 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:50.711 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.63 2024-05-09T09:54:50.711 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:50.712 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 64 2024-05-09T09:54:50.712 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:50.712 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:50.712 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127278 s, 824 MB/s 2024-05-09T09:54:50.713 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:50.711+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:50.713 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:50.804 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.64 2024-05-09T09:54:50.804 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:50.804 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 65 2024-05-09T09:54:50.813 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:50.811+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:50.819 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:50.819 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:50.819 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120713 s, 869 MB/s 2024-05-09T09:54:50.843 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:50.843 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:50.843 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:50.843 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:50.857 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:50.914 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:50.909+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:50.970 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.65 2024-05-09T09:54:50.970 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:50.970 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 66 2024-05-09T09:54:50.981 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:50.982 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:50.982 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:50.982 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:50.982 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:50.984 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:50.984 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:50.984 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121222 s, 865 MB/s 2024-05-09T09:54:50.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:51.015 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:51.015+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:54:51.104 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.66 2024-05-09T09:54:51.104 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:51.104 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 67 2024-05-09T09:54:51.116 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:51.115+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:51.119 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:51.119 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:51.119 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126596 s, 828 MB/s 2024-05-09T09:54:51.171 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 96.020692517000001, 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.172 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:54:51.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:54:51.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:54:51.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:54:51.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1158 3.2c 3:367a58d5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.687626574999999, 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021363626, 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1158 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481220+0000", 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486955+0000", 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057345460000000001 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486994+0000", 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8982e-05 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487016+0000", 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2103000000000002e-05 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487145+0000", 2024-05-09T09:54:51.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012962499999999999 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487392+0000", 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024650300000000002 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487614+0000", 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022186999999999999 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.500091+0000", 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012477054 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502399+0000", 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023086449999999998 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502492+0000", 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2662000000000002e-05 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502581+0000", 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1167 3.26 3:65d9db40:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.572971929000001, 2024-05-09T09:54:51.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021114266, 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1167 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:51.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595875+0000", 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1499999999999999e-06 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599908+0000", 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040330510000000002 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599945+0000", 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7366000000000001e-05 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599964+0000", 2024-05-09T09:54:51.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199e-05 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600143+0000", 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017947500000000001 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600531+0000", 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000387914 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600968+0000", 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043724399999999999 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.615593+0000", 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014624727000000001 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616799+0000", 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012065159999999999 2024-05-09T09:54:51.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616910+0000", 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110555 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616986+0000", 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6069000000000006e-05 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1208 3.a 3:5055ce64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.703393584000001, 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018795551000000001, 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1208 2024-05-09T09:54:51.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465453+0000", 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8609999999999998e-06 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469227+0000", 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003774281 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469250+0000", 2024-05-09T09:54:51.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3156e-05 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469262+0000", 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1531e-05 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469334+0000", 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2290000000000001e-05 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469342+0000", 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1659999999999994e-06 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473383+0000", 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040406940000000001 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473477+0000", 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3929000000000001e-05 2024-05-09T09:54:51.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473588+0000", 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110938 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.479810+0000", 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062221070000000002 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484173+0000", 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436265 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484212+0000", 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9322000000000001e-05 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484246+0000", 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3626e-05 2024-05-09T09:54:51.199 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1215 3.33 e58/18 3:cc65bbc6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_3:head v 58'3, mlcod=57'1)", 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.305869846, 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018005263000000001, 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.200 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.862974+0000", 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9999999999999998e-07 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867905+0000", 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0049302390000000003 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867938+0000", 2024-05-09T09:54:51.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3309999999999998e-05 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.867960+0000", 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1889999999999999e-05 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.868111+0000", 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151154 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.868155+0000", 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3545999999999999e-05 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.880884+0000", 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012729835 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.880979+0000", 2024-05-09T09:54:51.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4789000000000003e-05 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1229 3.2c 3:34904b64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.053307982, 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020735874000000001, 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.205 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1229 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115539+0000", 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6200000000000001e-06 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119644+0000", 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041042090000000002 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119669+0000", 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5754000000000001e-05 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119684+0000", 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4209000000000001e-05 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119768+0000", 2024-05-09T09:54:51.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4524999999999995e-05 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119922+0000", 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015423600000000001 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.120056+0000", 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013380999999999999 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.129703+0000", 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009646422 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136158+0000", 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064555810000000002 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136223+0000", 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4523999999999994e-05 2024-05-09T09:54:51.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136272+0000", 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8983999999999997e-05 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1356 3.35 3:af70797a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:51.211 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.936333467000001, 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018963760999999999, 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1356 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232514+0000", 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.237973+0000", 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054590610000000003 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238009+0000", 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188999999999998e-05 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238033+0000", 2024-05-09T09:54:51.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4769999999999998e-05 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238179+0000", 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014558299999999999 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238427+0000", 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000247827 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:51.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238654+0000", 2024-05-09T09:54:51.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022734200000000001 2024-05-09T09:54:51.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.247463+0000", 2024-05-09T09:54:51.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008808471 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251130+0000", 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036668830000000001 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251327+0000", 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000197441 2024-05-09T09:54:51.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251474+0000", 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147047 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1374 3.14 e59/31 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head v 59'2, mlcod=0'0)", 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:51.219 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.803841301999999, 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018480588999999999, 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365002+0000", 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.365005+0000", 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9529999999999999e-06 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369409+0000", 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044040859999999998 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369451+0000", 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1128999999999999e-05 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369469+0000", 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8442999999999999e-05 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369600+0000", 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013082 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.369641+0000", 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1051999999999999e-05 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383383+0000", 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013741913999999999 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383483+0000", 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010019200000000001 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1375 3.2c 3:35a92b62:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.790491214999999, 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018309355999999999, 2024-05-09T09:54:51.224 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1375 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:51.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378352+0000", 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.378356+0000", 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3400000000000002e-06 2024-05-09T09:54:51.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384131+0000", 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057751529999999999 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384166+0000", 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4965999999999997e-05 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384189+0000", 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3329e-05 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384311+0000", 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000121914 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384551+0000", 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000239471 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384817+0000", 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026635 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.393368+0000", 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085508100000000007 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396327+0000", 2024-05-09T09:54:51.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029596599999999998 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396514+0000", 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018649000000000001 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.396662+0000", 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147873 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.230 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1393 3.10 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.245694013000001, 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02062228, 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.231 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1393 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923152+0000", 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0190000000000001e-06 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926928+0000", 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037758520000000001 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926954+0000", 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6152e-05 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926967+0000", 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2925000000000001e-05 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927050+0000", 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3015000000000004e-05 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927188+0000", 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013808000000000001 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927320+0000", 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132311 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.936936+0000", 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096158560000000008 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943673+0000", 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067373729999999996 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943728+0000", 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5053000000000003e-05 2024-05-09T09:54:51.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943772+0000", 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643999999999998e-05 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1403 3.a 3:53fcb7d2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 19.01896047, 2024-05-09T09:54:51.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018525527, 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1403 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:51.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149887+0000", 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5240000000000001e-06 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153623+0000", 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037363919999999998 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153652+0000", 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8836e-05 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153666+0000", 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3824e-05 2024-05-09T09:54:51.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153761+0000", 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4975000000000005e-05 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153967+0000", 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206085 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:51.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.154165+0000", 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198118 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.161143+0000", 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069783700000000002 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168262+0000", 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071186340000000004 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168343+0000", 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1044999999999994e-05 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168409+0000", 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5723999999999996e-05 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1656 3.35 3:ad423f51:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.435680668, 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021084454999999998, 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1656 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.244 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733164+0000", 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2300000000000001e-06 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733175+0000", 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0526999999999999e-05 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733201+0000", 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5952000000000002e-05 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733210+0000", 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5629999999999998e-06 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744680+0000", 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011469795 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744936+0000", 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255691 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.754248+0000", 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093116970000000007 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1726 3.3f e63/18 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head v 63'7, mlcod=59'5)", 2024-05-09T09:54:51.248 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.6198528519999993, 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018934763, 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548993+0000", 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8139999999999999e-06 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551287+0000", 2024-05-09T09:54:51.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022947499999999999 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551311+0000", 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3252999999999999e-05 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551323+0000", 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1926999999999999e-05 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551470+0000", 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014753100000000001 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551538+0000", 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7618000000000002e-05 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567876+0000", 2024-05-09T09:54:51.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016337872 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567926+0000", 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9997999999999998e-05 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1876 3.a 3:52ea8d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.QD71QSIjnzYUJvkbUpu9yZ6kMZGI2uX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:51.253 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.3998745550000002, 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024394813000000001, 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1876 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.254 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768972+0000", 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.616e-06 2024-05-09T09:54:51.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773360+0000", 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043882620000000004 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773389+0000", 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8731999999999999e-05 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773401+0000", 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2094e-05 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773506+0000", 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105173 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773713+0000", 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020665399999999999 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773888+0000", 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017540899999999999 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.785628+0000", 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011740301999999999 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793268+0000", 2024-05-09T09:54:51.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076399040000000003 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793319+0000", 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0841999999999999e-05 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793364+0000", 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4824999999999999e-05 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.259 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1888 3.26 3:66cc2661:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.RVUWhTPr75VRTCdvqYW6zhcKOb-0e_t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.0542441650000001, 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021044698000000001, 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1888 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:51.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114602+0000", 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118409+0000", 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038070840000000001 2024-05-09T09:54:51.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118430+0000", 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1407e-05 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118441+0000", 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0438999999999999e-05 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118594+0000", 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015285299999999999 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118989+0000", 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039577600000000003 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.119396+0000", 2024-05-09T09:54:51.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040618000000000002 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.132480+0000", 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013084760000000001 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135459+0000", 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029782390000000001 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135557+0000", 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8554999999999994e-05 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135644+0000", 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7145999999999995e-05 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1916 3.36 3:6eedf4b4:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.VPNU2_fk3V70lu7RybtX1vlXVee9jX__1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.5477527589999998, 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024095032999999998, 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1916 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.267 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621094+0000", 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.36e-06 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626192+0000", 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050974690000000003 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626234+0000", 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2406e-05 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626253+0000", 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8776000000000001e-05 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626355+0000", 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101538 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626533+0000", 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017836699999999999 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626684+0000", 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151414 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.636642+0000", 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099573470000000001 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.644981+0000", 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083395520000000001 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645074+0000", 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3295999999999996e-05 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645186+0000", 2024-05-09T09:54:51.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111508 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2075 3.a 3:53469b12:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.6RHkQ-W_EKbk_OF2lFq2sr_HPaXtnXH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.191115887, 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020026097999999999, 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.273 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2075 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977731+0000", 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4300000000000002e-06 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981866+0000", 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041346309999999997 2024-05-09T09:54:51.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981892+0000", 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6545000000000001e-05 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981907+0000", 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4489e-05 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982017+0000", 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109706 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982270+0000", 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025379899999999997 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982518+0000", 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024785900000000001 2024-05-09T09:54:51.277 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.996151+0000", 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013632513000000001 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997589+0000", 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014381960000000001 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.278 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997687+0000", 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7575e-05 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997754+0000", 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7354999999999995e-05 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.279 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2081 3.36 3:6cf6c747:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.n_zpFFFU2OZoJK0JchjxtEuV5CgxBIK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.038506454, 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019931259999999999, 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2081 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.280 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.281 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130340+0000", 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8399999999999999e-06 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134268+0000", 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039274799999999997 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134304+0000", 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5929000000000001e-05 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.282 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134322+0000", 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8260000000000001e-05 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134453+0000", 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013139799999999999 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.283 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134700+0000", 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000246815 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134954+0000", 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025361900000000001 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.144764+0000", 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098099399999999996 2024-05-09T09:54:51.284 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150087+0000", 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053232160000000004 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150179+0000", 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2244000000000007e-05 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.285 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150269+0000", 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9518999999999995e-05 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2099 3.1e 3:789e79c5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.gqxJ-lp-L0uUFrshZonEkrXrhQkW2Gi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.703587242, 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021689172, 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.286 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2099 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.287 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465260+0000", 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2100000000000002e-06 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471028+0000", 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057687509999999999 2024-05-09T09:54:51.288 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471069+0000", 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0955999999999999e-05 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471095+0000", 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5375999999999999e-05 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.289 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471261+0000", 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165747 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471520+0000", 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025964199999999998 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471893+0000", 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037329000000000003 2024-05-09T09:54:51.290 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.484923+0000", 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013029618 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486774+0000", 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018512190000000001 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.291 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486872+0000", 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7934000000000001e-05 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486946+0000", 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3429000000000005e-05 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2105 3.10 3:0bd3bb69:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.9DoRBdszHtn66r2rQmpiH3p-scscd-l_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:51.292 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.56726739199999998, 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023605516999999999, 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2105 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.293 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601596+0000", 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9896000000000001e-05 2024-05-09T09:54:51.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605653+0000", 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040566650000000001 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605687+0000", 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4421000000000001e-05 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605708+0000", 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0750999999999998e-05 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605899+0000", 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019071499999999999 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606144+0000", 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024554600000000002 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606373+0000", 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022909199999999999 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.616518+0000", 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010144497000000001 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625017+0000", 2024-05-09T09:54:51.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084995699999999997 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625112+0000", 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4628000000000003e-05 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625182+0000", 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9735999999999998e-05 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.298 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.299 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.299 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:51.300 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.67 2024-05-09T09:54:51.300 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:51.300 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 68 2024-05-09T09:54:51.301 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:51.301 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:51.301 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012272 s, 854 MB/s 2024-05-09T09:54:51.301 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:51.299+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:51.302 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:51.376 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.68 2024-05-09T09:54:51.377 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:51.377 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 69 2024-05-09T09:54:51.391 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:51.391 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:51.391 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122545 s, 856 MB/s 2024-05-09T09:54:51.401 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:51.399+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:51.431 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:51.432 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:51.432 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:51.432 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:51.447 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:51.502 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:51.497+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:51.540 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.69 2024-05-09T09:54:51.540 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:51.540 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 70 2024-05-09T09:54:51.555 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:51.555 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:51.555 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122877 s, 853 MB/s 2024-05-09T09:54:51.570 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:51.570 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:51.570 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:51.570 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:51.570 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:51.585 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:51.603 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:51.603+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:51.725 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:51.703+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 110.453631035, 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020963909999999999, 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.753 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 113 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.754 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296493+0000", 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296494+0000", 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7599999999999996e-07 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296499+0000", 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.2569999999999998e-06 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.755 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296509+0000", 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.026e-05 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296517+0000", 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2760000000000003e-06 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.311889+0000", 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015371839999999999 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.756 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312137+0000", 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024836900000000002 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.312559+0000", 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00042197099999999999 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.313929+0000", 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0013705659999999999 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.757 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317187+0000", 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00325743 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317332+0000", 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014464499999999999 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317457+0000", 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012552 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.758 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 110.45359578999999, 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:54:51.759 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:54:51.760 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:54:51.761 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:54:51.762 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:54:51.763 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.764 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 110.45356163700001, 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:51.765 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.766 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.767 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.768 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.769 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 110.453441114, 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.770 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.771 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:54:51.772 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:54:51.773 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:54:51.774 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.775 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 110.453405588, 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.776 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.777 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.778 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.779 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.780 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1157 3.13 3:cb26828e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.287024794000001, 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021985248999999998, 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.781 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1157 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.782 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463102+0000", 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3630000000000001e-06 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470773+0000", 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076712769999999998 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470806+0000", 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2802999999999997e-05 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.783 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470827+0000", 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1175999999999999e-05 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471017+0000", 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018967499999999999 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471279+0000", 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026242300000000002 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471498+0000", 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021940300000000001 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.482134+0000", 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010635446999999999 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.484865+0000", 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027312460000000001 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485006+0000", 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039099999999999 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485085+0000", 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9045e-05 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.786 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1178 3.37 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.032693621, 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030832948999999998, 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1178 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717434+0000", 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0060000000000001e-06 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721611+0000", 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041770929999999998 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721645+0000", 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4561999999999999e-05 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721678+0000", 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2700000000000002e-05 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721844+0000", 2024-05-09T09:54:51.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165914 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722121+0000", 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027709300000000001 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722352+0000", 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023117600000000001 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.733566+0000", 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011213989000000001 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748089+0000", 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014523036 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748187+0000", 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7974999999999996e-05 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748263+0000", 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6404999999999998e-05 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1179 3.15 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.022013861000001, 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021009254000000002, 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.792 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1179 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728138+0000", 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7906e-05 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734782+0000", 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066435950000000004 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734827+0000", 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5269000000000003e-05 2024-05-09T09:54:51.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734858+0000", 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0654000000000002e-05 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735020+0000", 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016203699999999999 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735274+0000", 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025399299999999999 2024-05-09T09:54:51.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735518+0000", 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024406300000000001 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747370+0000", 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011852339 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748991+0000", 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016208259999999999 2024-05-09T09:54:51.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749065+0000", 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4018999999999997e-05 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749120+0000", 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4552999999999998e-05 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.797 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1214 3.39 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.919696632000001, 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028754392, 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1214 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830433+0000", 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.237e-06 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838120+0000", 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076874200000000004 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838164+0000", 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4002999999999999e-05 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838186+0000", 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.198e-05 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838356+0000", 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169421 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838666+0000", 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031002599999999998 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838898+0000", 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023215000000000001 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.849862+0000", 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010964649 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.858862+0000", 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089996999999999994 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859048+0000", 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186128 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859182+0000", 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133678 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1216 3.e 3:734f2773:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.877971122000002, 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027271179999999999, 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.803 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1216 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872156+0000", 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.304e-06 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876935+0000", 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047782440000000001 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876974+0000", 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9520000000000001e-05 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876999+0000", 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5286000000000002e-05 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877108+0000", 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109063 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.806 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877300+0000", 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019180299999999999 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877468+0000", 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759199999999999 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.886506+0000", 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379599999999994 2024-05-09T09:54:51.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899047+0000", 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012540936000000001 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899286+0000", 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023885700000000001 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899424+0000", 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138615 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.808 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1217 3.11 3:8a7f3d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.864379828000001, 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021949672, 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1217 2024-05-09T09:54:51.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885747+0000", 2024-05-09T09:54:51.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0429999999999999e-06 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893119+0000", 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073719229999999998 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893163+0000", 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3476000000000002e-05 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893188+0000", 2024-05-09T09:54:51.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5443e-05 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893364+0000", 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017547400000000001 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893619+0000", 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025488300000000002 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893842+0000", 2024-05-09T09:54:51.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022347099999999999 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907393+0000", 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013550804 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907498+0000", 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010539099999999999 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907590+0000", 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1419e-05 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907694+0000", 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104345 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1223 3.15 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.747192433999999, 2024-05-09T09:54:51.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021427795999999999, 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1223 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002934+0000", 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2050000000000001e-06 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007103+0000", 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004168878 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007133+0000", 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0577999999999998e-05 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007145+0000", 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1844e-05 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007222+0000", 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6569000000000005e-05 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007366+0000", 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144053 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007494+0000", 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012810799999999999 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.015333+0000", 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078388439999999993 2024-05-09T09:54:51.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024121+0000", 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087886230000000006 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024253+0000", 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013161800000000001 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024360+0000", 2024-05-09T09:54:51.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106476 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1357 3.37 3:eda39a4c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.243543+0000", 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.506581413999999, 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020704225999999999, 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.820 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1357 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.243543+0000", 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.243543+0000", 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.243547+0000", 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5229999999999997e-06 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.248853+0000", 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053061080000000004 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.248894+0000", 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0942000000000002e-05 2024-05-09T09:54:51.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.248913+0000", 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8580000000000002e-05 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.249046+0000", 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132927 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.249311+0000", 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000264756 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.249545+0000", 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023422499999999999 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.261986+0000", 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012440895 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.263921+0000", 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0019354610000000001 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.264112+0000", 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019074200000000001 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.264247+0000", 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000135067 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1374 3.14 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:51.825 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 20.391571869, 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025594499999999999, 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1374 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:51.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358555+0000", 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0000000000000001e-06 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364047+0000", 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054919599999999997 2024-05-09T09:54:51.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364082+0000", 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4903000000000001e-05 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364099+0000", 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7316000000000002e-05 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364233+0000", 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013302600000000001 2024-05-09T09:54:51.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364481+0000", 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024840499999999999 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364757+0000", 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027572700000000003 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.372096+0000", 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007339702 2024-05-09T09:54:51.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383918+0000", 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01182211 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384024+0000", 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105251 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384147+0000", 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012310000000000001 2024-05-09T09:54:51.830 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1720 3.d 3:b3cdf7d6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.CpCcCMLkwBimVYxoW8LjvANQOboLxkv_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.422081+0000", 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.3280429250000001, 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020482877, 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.831 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1720 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.422081+0000", 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.422081+0000", 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.422086+0000", 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5560000000000001e-06 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.426809+0000", 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047233090000000002 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.426834+0000", 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4448999999999999e-05 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.426846+0000", 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2099000000000001e-05 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.426976+0000", 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012994699999999999 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.427116+0000", 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014066299999999999 2024-05-09T09:54:51.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.427293+0000", 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0001771 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.438261+0000", 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010967899999999999 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.442463+0000", 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042020740000000001 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.442519+0000", 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5775e-05 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.442564+0000", 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5005e-05 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.836 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1726 3.3f 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.2054696689999993, 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023921398, 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1726 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544657+0000", 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548394+0000", 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003737326 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548421+0000", 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6865000000000001e-05 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548434+0000", 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2605e-05 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548514+0000", 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0352000000000006e-05 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548671+0000", 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156231 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548814+0000", 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014296600000000001 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.559185+0000", 2024-05-09T09:54:51.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010371949 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568269+0000", 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090838789999999996 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568449+0000", 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179407 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568576+0000", 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012715400000000001 2024-05-09T09:54:51.841 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1885 3.11 3:89f00d0a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.28:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.7809709690000002, 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022582944000000001, 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.842 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1885 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969162+0000", 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.268e-06 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973026+0000", 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038637680000000001 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973055+0000", 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8858000000000001e-05 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973067+0000", 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2184999999999999e-05 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973141+0000", 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3747999999999999e-05 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973302+0000", 2024-05-09T09:54:51.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016143099999999999 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973741+0000", 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043816299999999999 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991002+0000", 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017261155 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991603+0000", 2024-05-09T09:54:51.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060141600000000002 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991671+0000", 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7433000000000003e-05 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991736+0000", 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5518999999999994e-05 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1931 3.f 3:f2a153e3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.7567425270000001, 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021453967000000001, 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1931 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993383+0000", 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.127e-06 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997421+0000", 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040380599999999996 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997440+0000", 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9477e-05 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997453+0000", 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2498e-05 2024-05-09T09:54:51.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997539+0000", 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6473999999999999e-05 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997702+0000", 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016321 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.998188+0000", 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048555899999999999 2024-05-09T09:54:51.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.006182+0000", 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079940800000000006 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014666+0000", 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084836749999999995 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014767+0000", 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010093499999999999 2024-05-09T09:54:51.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014836+0000", 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8872000000000001e-05 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2117 3.2d 3:b465dcda:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.GFV4vCspRy1zUXkFAuI6fs_j51KMCUd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.82989619699999995, 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021398311, 2024-05-09T09:54:51.853 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2117 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920230+0000", 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.503e-06 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924562+0000", 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043315610000000003 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924591+0000", 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9077999999999998e-05 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924611+0000", 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0339999999999998e-05 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924703+0000", 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1440000000000005e-05 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924855+0000", 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015229100000000001 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924978+0000", 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012243099999999999 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.931560+0000", 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065820380000000001 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941452+0000", 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098919860000000002 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941554+0000", 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010251000000000001 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941626+0000", 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2132999999999995e-05 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.858 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2151 3.3f 3:fcdd6a3a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.e_T4R69E113FUtA8H-_HY1rmD7y3cXZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.255895029, 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021326852, 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2151 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.859 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494232+0000", 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9299999999999999e-06 2024-05-09T09:54:51.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498235+0000", 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040031620000000002 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498266+0000", 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0391000000000001e-05 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498279+0000", 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3825000000000001e-05 2024-05-09T09:54:51.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498387+0000", 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107236 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498604+0000", 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021725800000000001 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498826+0000", 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000221759 2024-05-09T09:54:51.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.513219+0000", 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014393764 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515433+0000", 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022133209999999999 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515502+0000", 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9191999999999998e-05 2024-05-09T09:54:51.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515556+0000", 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4014000000000002e-05 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:51.864 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:51.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:51.865 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.70 2024-05-09T09:54:51.866 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:51.866 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 71 2024-05-09T09:54:51.866 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:51.866 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:51.866 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122175 s, 858 MB/s 2024-05-09T09:54:51.867 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:51.867+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:51.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:51.909 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.71 2024-05-09T09:54:51.909 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:51.909 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 72 2024-05-09T09:54:51.923 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:51.923 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:51.923 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.01206 s, 869 MB/s 2024-05-09T09:54:51.966 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:51.965+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:52.029 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:52.030 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:52.034 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.72 2024-05-09T09:54:52.034 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.034 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 73 2024-05-09T09:54:52.041 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:52.041 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:52.044 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.044 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.044 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00891141 s, 1.2 GB/s 2024-05-09T09:54:52.048 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:52.048 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:52.057 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:52.065 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:52.065 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:52.067 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:52.067+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:52.086 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:52.086 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:52.111 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:52.111 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:52.133 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:52.143 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.73 2024-05-09T09:54:52.143 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.144 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 74 2024-05-09T09:54:52.155 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:52.155 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:52.157 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.157 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.157 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107155 s, 979 MB/s 2024-05-09T09:54:52.167 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:52.167+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:52.175 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:52.176 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:52.205 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:52.205 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:52.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:52.270 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.74 2024-05-09T09:54:52.270 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.270 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 75 2024-05-09T09:54:52.270 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:52.271+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:52.281 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.281 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.281 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00933554 s, 1.1 GB/s 2024-05-09T09:54:52.369 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:52.367+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:52.377 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.75 2024-05-09T09:54:52.377 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.377 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 76 2024-05-09T09:54:52.389 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.390 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.390 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0103656 s, 1.0 GB/s 2024-05-09T09:54:52.398 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:52.398 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:52.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:52.470 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:52.465+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:52.494 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.76 2024-05-09T09:54:52.494 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.494 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 77 2024-05-09T09:54:52.504 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.505 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.505 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00889475 s, 1.2 GB/s 2024-05-09T09:54:52.572 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:52.569+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:52.589 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:52.589 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:52.602 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.77 2024-05-09T09:54:52.602 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.602 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 78 2024-05-09T09:54:52.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:52.616 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.616 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.616 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111624 s, 939 MB/s 2024-05-09T09:54:52.672 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:52.671+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:52.720 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.78 2024-05-09T09:54:52.720 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.720 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 79 2024-05-09T09:54:52.732 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.732 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.732 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102679 s, 1.0 GB/s 2024-05-09T09:54:52.751 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:52.751 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:52.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:52.773 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:52.769+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:52.839 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.79 2024-05-09T09:54:52.839 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.840 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 80 2024-05-09T09:54:52.850 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.850 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.850 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00922345 s, 1.1 GB/s 2024-05-09T09:54:52.874 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:52.869+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:52.945 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:52.945 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:52.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:52.974 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:52.973+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:52.980 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.80 2024-05-09T09:54:52.980 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:52.980 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 81 2024-05-09T09:54:52.991 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:52.991 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:52.991 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00907742 s, 1.2 GB/s 2024-05-09T09:54:53.057 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:54:53.075 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:53.073+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:53.116 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.81 2024-05-09T09:54:53.116 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:53.116 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 82 2024-05-09T09:54:53.116 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:53.116 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:53.126 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:53.126 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:53.126 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00933867 s, 1.1 GB/s 2024-05-09T09:54:53.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:53.176 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:53.173+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:53.223 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.82 2024-05-09T09:54:53.224 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:53.224 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 83 2024-05-09T09:54:53.234 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:53.234 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:53.234 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00883821 s, 1.2 GB/s 2024-05-09T09:54:53.277 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:53.273+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:53.306 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:53.307 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:53.328 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:53.345 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.83 2024-05-09T09:54:53.345 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:53.345 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 84 2024-05-09T09:54:53.355 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:53.355 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:53.355 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00885039 s, 1.2 GB/s 2024-05-09T09:54:53.378 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:53.379+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:53.462 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:53.463 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:53.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:53.479 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:53.473+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:53.487 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.84 2024-05-09T09:54:53.487 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:53.487 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 85 2024-05-09T09:54:53.497 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:53.498 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:53.498 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0091511 s, 1.1 GB/s 2024-05-09T09:54:53.579 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:53.579+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:53.609 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.85 2024-05-09T09:54:53.609 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:53.609 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 86 2024-05-09T09:54:53.620 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:53.620 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:53.621 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:53.621 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:53.621 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105621 s, 993 MB/s 2024-05-09T09:54:53.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:53.680 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:53.677+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:53.733 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.86 2024-05-09T09:54:53.733 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:53.733 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 87 2024-05-09T09:54:53.748 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:53.748 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:53.748 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012075 s, 868 MB/s 2024-05-09T09:54:53.781 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:53.777+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:53.812 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:53.812 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:53.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:53.849 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.87 2024-05-09T09:54:53.849 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:53.849 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 88 2024-05-09T09:54:53.859 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:53.859 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:53.860 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00893392 s, 1.2 GB/s 2024-05-09T09:54:53.881 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:53.879+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:53.956 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:53.956 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:53.970 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:53.975 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.88 2024-05-09T09:54:53.975 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:53.976 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 89 2024-05-09T09:54:53.982 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:53.983+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:53.986 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:53.986 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:53.986 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00877582 s, 1.2 GB/s 2024-05-09T09:54:54.083 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:54.083+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:54.100 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:54.100 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:54.119 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:54.120 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.89 2024-05-09T09:54:54.120 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:54.120 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 90 2024-05-09T09:54:54.134 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:54.134 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:54.134 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123902 s, 846 MB/s 2024-05-09T09:54:54.184 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:54.181+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:54.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:54.243 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:54.243 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:54.257 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.90 2024-05-09T09:54:54.257 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:54.257 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 91 2024-05-09T09:54:54.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:54.272 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:54.272 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:54.272 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116208 s, 902 MB/s 2024-05-09T09:54:54.284 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:54.283+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:54.354 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:54.354 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:54.372 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:54:54.382 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:54.383 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:54.385 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:54.383+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:54.388 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.91 2024-05-09T09:54:54.388 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:54.388 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 92 2024-05-09T09:54:54.399 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:54.399 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:54.399 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00896085 s, 1.2 GB/s 2024-05-09T09:54:54.404 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:54.404 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:54.421 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:54.421 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:54.432 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:54.432 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:54.443 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:54.444 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:54.446 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:54.465 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:54.465 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:54.485 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:54.486 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:54.490 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:54.489+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:54.492 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.92 2024-05-09T09:54:54.492 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:54.492 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 93 2024-05-09T09:54:54.502 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:54.502 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:54.502 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00875928 s, 1.2 GB/s 2024-05-09T09:54:54.504 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:54.504 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:54.567 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:54.567 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:54.567 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:54.567 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:54.582 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:54.587 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:54.587+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:54.604 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.93 2024-05-09T09:54:54.604 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:54.604 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 94 2024-05-09T09:54:54.615 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:54.615 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:54.615 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00912232 s, 1.1 GB/s 2024-05-09T09:54:54.689 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:54.687+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:54.716 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.94 2024-05-09T09:54:54.716 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:54.717 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 95 2024-05-09T09:54:54.729 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:54.730 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:54.730 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106318 s, 986 MB/s 2024-05-09T09:54:54.750 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:54.750 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:54.751 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:54.751 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:54.751 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:54.764 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:54.790 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:54.791+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:54.852 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.95 2024-05-09T09:54:54.852 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:54.852 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 96 2024-05-09T09:54:54.867 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:54.867 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:54.867 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124023 s, 845 MB/s 2024-05-09T09:54:54.893 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:54.889+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1161 3.1d 3:b8b74cb5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.376131343000001, 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020326487000000001, 2024-05-09T09:54:54.897 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1161 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.898 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518545+0000", 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639999999999998e-06 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522778+0000", 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042321429999999998 2024-05-09T09:54:54.899 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522816+0000", 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624000000000002e-05 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522834+0000", 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522974+0000", 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:54.900 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523215+0000", 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024094700000000001 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523432+0000", 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217333 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.901 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.532230+0000", 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087981150000000004 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538624+0000", 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063944249999999996 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538717+0000", 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2608999999999994e-05 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.902 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538867+0000", 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150357 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1164 3.2a 3:563cc67e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.334337090999998, 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023925154000000001, 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.903 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1164 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.904 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560338+0000", 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2499999999999998e-06 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564645+0000", 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043069290000000001 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.905 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564681+0000", 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5746e-05 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564697+0000", 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6269999999999998e-05 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564822+0000", 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012474099999999999 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.906 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565074+0000", 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025190400000000001 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565300+0000", 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226133 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.572636+0000", 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073360760000000004 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.907 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584083+0000", 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011446424 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584177+0000", 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4518999999999994e-05 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.908 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584260+0000", 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3162000000000001e-05 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1178 3.37 e57/18 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.172120172, 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025242840999999999, 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.909 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.910 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722556+0000", 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5159999999999999e-06 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728655+0000", 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060999039999999997 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728694+0000", 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8009999999999997e-05 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.911 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728710+0000", 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6880000000000001e-05 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728899+0000", 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018883699999999999 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728968+0000", 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9041999999999994e-05 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.912 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747653+0000", 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018684905000000002 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747795+0000", 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014174700000000001 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1201 3.2a 3:54ff7f97:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:54.913 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 27.546491454000002, 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020960774000000001, 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:54.914 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348183+0000", 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9889999999999999e-06 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352065+0000", 2024-05-09T09:54:54.915 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038826189999999999 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352086+0000", 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0407e-05 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352100+0000", 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3745e-05 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.916 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352173+0000", 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3335000000000002e-05 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352330+0000", 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015688400000000001 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352462+0000", 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013203100000000001 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.917 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.365714+0000", 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013252553 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.368997+0000", 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032823800000000001 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369079+0000", 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2639999999999995e-05 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.918 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369142+0000", 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2191000000000001e-05 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1213 3.22 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 27.078704817999999, 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022416997000000001, 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.919 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1213 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.920 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815970+0000", 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6079999999999998e-06 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819807+0000", 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038369699999999999 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.921 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819837+0000", 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0423999999999999e-05 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819850+0000", 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2594e-05 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819953+0000", 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102543 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.922 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820186+0000", 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023374800000000001 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820600+0000", 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041405700000000001 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.833246+0000", 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012645854 2024-05-09T09:54:54.923 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838263+0000", 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050170529999999996 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838332+0000", 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9202000000000006e-05 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838384+0000", 2024-05-09T09:54:54.924 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1944000000000003e-05 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1234 3.2f 3:f547a26d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.657682641000001, 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021134344999999999, 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.925 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1234 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:54.926 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236992+0000", 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.12e-06 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.240966+0000", 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039738539999999998 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.927 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241001+0000", 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5169999999999997e-05 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241018+0000", 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7523000000000001e-05 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241186+0000", 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016797099999999999 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.928 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241562+0000", 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037583099999999997 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241922+0000", 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036000099999999998 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.255413+0000", 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013490925000000001 2024-05-09T09:54:54.929 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.257956+0000", 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025432250000000001 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258047+0000", 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1108999999999998e-05 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258124+0000", 2024-05-09T09:54:54.930 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6616e-05 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1354 3.2f 3:f6a59ae0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.685926258999999, 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019275487000000001, 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.931 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1354 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208746+0000", 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.932 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.208748+0000", 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4569999999999999e-06 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212622+0000", 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038735649999999998 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212658+0000", 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5709e-05 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.933 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212674+0000", 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6373000000000001e-05 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.212860+0000", 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000185479 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213131+0000", 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027101700000000002 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.934 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.213376+0000", 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024525700000000003 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.220719+0000", 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073430400000000003 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227786+0000", 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0070674259999999999 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.935 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.227893+0000", 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106884 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.228021+0000", 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012828000000000001 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1394 3.1d 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:54.936 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.946763203, 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021946568999999999, 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1394 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:54.937 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947912+0000", 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5979999999999999e-06 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.938 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952060+0000", 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041480270000000003 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952101+0000", 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0948999999999997e-05 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952129+0000", 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8634999999999999e-05 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.939 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952302+0000", 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017274599999999999 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952559+0000", 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025720799999999998 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.940 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952811+0000", 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252124 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.961321+0000", 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085092090000000002 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969641+0000", 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083202880000000003 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.941 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969737+0000", 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6642000000000001e-05 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969856+0000", 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118143 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1732 3.2a 3:57cad4d0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.z7A6gvGdCsGpYkA4afvy42BiLcIeNy9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-05-09T09:54:54.942 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.225080281, 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020981109000000001, 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1732 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:54.943 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669595+0000", 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8159999999999998e-06 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673343+0000", 2024-05-09T09:54:54.944 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037477550000000002 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673372+0000", 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9085999999999999e-05 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673384+0000", 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2615e-05 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.945 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673496+0000", 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111888 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673731+0000", 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023452 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673945+0000", 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021394900000000001 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.946 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.686870+0000", 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012925624 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690449+0000", 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035790399999999999 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690522+0000", 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2745999999999998e-05 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.947 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690573+0000", 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1069999999999997e-05 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1864 3.30 3:0f8e5753:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.vjrfU8R0YhW7bZ2SDYx38ZOxKyLoEJ4_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.4485745409999993, 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020719274999999999, 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.948 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1864 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.949 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446101+0000", 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.49e-06 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450033+0000", 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039319380000000003 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450059+0000", 2024-05-09T09:54:54.950 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5548e-05 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450071+0000", 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2245999999999999e-05 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450231+0000", 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000160464 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.951 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450626+0000", 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039443900000000001 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.451035+0000", 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040921300000000001 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.463627+0000", 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012592067 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466538+0000", 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029110289999999999 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466696+0000", 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015758999999999999 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466817+0000", 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012125099999999999 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.953 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1873 3.38 3:1e64df2a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.26:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.2679978080000005, 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019915188, 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.954 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1873 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626678+0000", 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8e-06 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630890+0000", 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042116360000000004 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630924+0000", 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3708999999999999e-05 2024-05-09T09:54:54.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630937+0000", 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3841e-05 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.631046+0000", 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010836 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.631313+0000", 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026688200000000002 2024-05-09T09:54:54.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.632056+0000", 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074307599999999996 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.640884+0000", 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008828743 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646477+0000", 2024-05-09T09:54:54.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055922339999999997 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646542+0000", 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5617999999999994e-05 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646590+0000", 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7289000000000001e-05 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1891 3.38 3:1c43b68b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.7532927479999998, 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020059576999999999, 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1891 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141381+0000", 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.615e-06 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146198+0000", 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048167419999999997 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146231+0000", 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3565999999999997e-05 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146248+0000", 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6540000000000001e-05 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146358+0000", 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010968600000000001 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146575+0000", 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000216899 2024-05-09T09:54:54.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.147140+0000", 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056583299999999996 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.160803+0000", 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013662934 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161343+0000", 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053952500000000001 2024-05-09T09:54:54.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161400+0000", 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7092000000000002e-05 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161439+0000", 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9144999999999999e-05 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1922 3.5 3:a3ee2791:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.0Ed7ZEVcL9CnMwDM9Yiij5ANu2WW139_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.0946954519999998, 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02035182, 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1922 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799980+0000", 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1599999999999998e-06 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804290+0000", 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043101099999999998 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804327+0000", 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7143e-05 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804345+0000", 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7946000000000001e-05 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804484+0000", 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013861099999999999 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804756+0000", 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027221899999999998 2024-05-09T09:54:54.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.805005+0000", 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024909200000000002 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.818965+0000", 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013960006 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820010+0000", 2024-05-09T09:54:54.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010453179999999999 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820196+0000", 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186047 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820329+0000", 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132168 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1934 3.1 e65/62 3:83810aba:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.bd0uPieH5yAMY0BuB5M_Z7ovAps42t5_1:head v 65'5, mlcod=59'3)", 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 7.7785110169999996, 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023284467, 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116163+0000", 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.04e-06 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121321+0000", 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051577749999999999 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121366+0000", 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4948999999999999e-05 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121384+0000", 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7533e-05 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121537+0000", 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015350699999999999 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121594+0000", 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6545999999999997e-05 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.139359+0000", 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017765689000000001 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.139446+0000", 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6428000000000007e-05 2024-05-09T09:54:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2078 3.2 3:41c71c3b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.58:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.8892118140000003, 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024084686000000001, 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2078 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.977 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005463+0000", 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010468+0000", 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050052610000000004 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010508+0000", 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9950000000000002e-05 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010527+0000", 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8278999999999999e-05 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010652+0000", 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125785 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010924+0000", 2024-05-09T09:54:54.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027113799999999998 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.011795+0000", 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00087143799999999999 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.027012+0000", 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015217101 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029226+0000", 2024-05-09T09:54:54.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002213717 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029422+0000", 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019575699999999999 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029545+0000", 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123557 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2111 3.28 3:15d70eee:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.lgea9Z83k54346rKmMLqWontMqssjIw_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.759440+0000", 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.1352324109999996, 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021769648999999999, 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2111 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.759440+0000", 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.759440+0000", 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.759442+0000", 2024-05-09T09:54:54.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6599999999999999e-06 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763262+0000", 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038199420000000002 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763292+0000", 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9094e-05 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763304+0000", 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2687999999999999e-05 2024-05-09T09:54:54.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763414+0000", 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110142 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763647+0000", 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023309000000000001 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763885+0000", 2024-05-09T09:54:54.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023791200000000001 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.772692+0000", 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088068539999999994 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.781105+0000", 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084125829999999995 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.781161+0000", 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6162999999999997e-05 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.781209+0000", 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8520999999999998e-05 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2126 3.3a 3:5c8ab91a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.66:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.083568+0000", 2024-05-09T09:54:54.987 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.811103964, 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021395483999999999, 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2126 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.083568+0000", 2024-05-09T09:54:54.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.083568+0000", 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.083574+0000", 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6450000000000002e-06 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.087993+0000", 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044188270000000002 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088020+0000", 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6808000000000002e-05 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088032+0000", 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2554e-05 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088119+0000", 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6600000000000004e-05 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088281+0000", 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016252199999999999 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088833+0000", 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00055137399999999998 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.101106+0000", 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012273874000000001 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.104810+0000", 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037037699999999999 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.104902+0000", 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1644000000000006e-05 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.104964+0000", 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1865999999999993e-05 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2129 3.22 3:443473dc:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.M5FtRVGnH4PCmXQBPm5Ulxr478hzqci_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.194819+0000", 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.699852785, 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021783567, 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.993 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2129 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.194819+0000", 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:54.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.194819+0000", 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.194823+0000", 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3069999999999998e-06 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200670+0000", 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058470040000000003 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:54.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200710+0000", 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.977e-05 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200748+0000", 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8293000000000001e-05 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200850+0000", 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102649 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:54.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200961+0000", 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011009 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.201058+0000", 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6973999999999997e-05 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.207036+0000", 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059788380000000002 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:54.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.216551+0000", 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095150830000000006 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.216582+0000", 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0883999999999998e-05 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.216603+0000", 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0675000000000001e-05 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:54.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:2163 3.27 e67/62 3:e7b1cd89:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.mnLCFQJlnKvb689d2vFaEnVSGZYm_Se_1:head v 67'6, mlcod=58'4)", 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.870141+0000", 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.0245314599999999, 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020546331000000001, 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.870141+0000", 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:54.999 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.870141+0000", 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.870144+0000", 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1e-06 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875545+0000", 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054009009999999996 2024-05-09T09:54:55.000 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875575+0000", 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0190999999999999e-05 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875589+0000", 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4289e-05 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.001 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875752+0000", 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016271100000000001 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875795+0000", 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3216000000000001e-05 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.890570+0000", 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014775224 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.890687+0000", 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116699 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2301 3.3a 3:5e9a2131:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.UPzna9Mz7t2tLq5Bpr360DOhZ3CrQtz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.674499+0000", 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 0.22017344, 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021140340000000001, 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.003 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2301 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.674499+0000", 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.674499+0000", 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.674527+0000", 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8566999999999999e-05 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680493+0000", 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059653919999999999 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.005 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680538+0000", 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5055999999999997e-05 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680557+0000", 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8987e-05 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680674+0000", 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117617 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680905+0000", 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023067699999999999 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.681117+0000", 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021180600000000001 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.692575+0000", 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011458403000000001 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.695490+0000", 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029149430000000001 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.695572+0000", 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2000000000000001e-05 2024-05-09T09:54:55.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.695639+0000", 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6891999999999996e-05 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.009 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:55.010 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.96 2024-05-09T09:54:55.010 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:55.010 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 97 2024-05-09T09:54:55.011 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:55.012 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:55.011+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:55.015 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:55.015 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:55.015 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123872 s, 846 MB/s 2024-05-09T09:54:55.111 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:55.111+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:55.145 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.97 2024-05-09T09:54:55.145 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:55.145 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 98 2024-05-09T09:54:55.162 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:55.162 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:55.162 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0135861 s, 772 MB/s 2024-05-09T09:54:55.190 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:55.190 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:55.190 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:55.190 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:55.204 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:55.212 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:55.211+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:55.293 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.98 2024-05-09T09:54:55.293 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:55.293 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 99 2024-05-09T09:54:55.309 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:55.309 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:55.309 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129994 s, 807 MB/s 2024-05-09T09:54:55.314 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:55.309+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:55.332 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:55.332 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:55.332 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:55.332 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:55.332 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:55.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:55.435 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:55.433+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:55.453 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.99 2024-05-09T09:54:55.453 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:54:55.453 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 100 2024-05-09T09:54:55.469 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-05-09T09:54:55.469 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-05-09T09:54:55.469 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126196 s, 831 MB/s 2024-05-09T09:54:55.516 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:55.513+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:55.518 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:55.518 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:55.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:55.518 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:55.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.518 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 100.36755143400001, 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:54:55.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:55.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:54:55.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:54:55.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1158 3.2c 3:367a58d5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.034485492000002, 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021363626, 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1158 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481220+0000", 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486955+0000", 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057345460000000001 2024-05-09T09:54:55.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486994+0000", 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8982e-05 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487016+0000", 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2103000000000002e-05 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487145+0000", 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012962499999999999 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487392+0000", 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024650300000000002 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487614+0000", 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022186999999999999 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.500091+0000", 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012477054 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502399+0000", 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023086449999999998 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502492+0000", 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2662000000000002e-05 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502581+0000", 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1167 3.26 3:65d9db40:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.919830846, 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021114266, 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.533 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1167 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595875+0000", 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1499999999999999e-06 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599908+0000", 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040330510000000002 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599945+0000", 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7366000000000001e-05 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599964+0000", 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199e-05 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600143+0000", 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017947500000000001 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600531+0000", 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000387914 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600968+0000", 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043724399999999999 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.615593+0000", 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014624727000000001 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616799+0000", 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012065159999999999 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616910+0000", 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110555 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616986+0000", 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6069000000000006e-05 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.538 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1208 3.a 3:5055ce64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.050252500999999, 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018795551000000001, 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.539 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1208 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465453+0000", 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8609999999999998e-06 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469227+0000", 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003774281 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469250+0000", 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3156e-05 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469262+0000", 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1531e-05 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469334+0000", 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2290000000000001e-05 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469342+0000", 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1659999999999994e-06 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473383+0000", 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040406940000000001 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473477+0000", 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3929000000000001e-05 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473588+0000", 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110938 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.479810+0000", 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062221070000000002 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484173+0000", 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436265 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484212+0000", 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9322000000000001e-05 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484246+0000", 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3626e-05 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1229 3.2c 3:34904b64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 27.400166898999998, 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020735874000000001, 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.545 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1229 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115539+0000", 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6200000000000001e-06 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119644+0000", 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041042090000000002 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119669+0000", 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5754000000000001e-05 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119684+0000", 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4209000000000001e-05 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119768+0000", 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4524999999999995e-05 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119922+0000", 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015423600000000001 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.120056+0000", 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013380999999999999 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.129703+0000", 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009646422 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136158+0000", 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064555810000000002 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136223+0000", 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4523999999999994e-05 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136272+0000", 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8983999999999997e-05 2024-05-09T09:54:55.550 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1356 3.35 3:af70797a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.283192383999999, 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018963760999999999, 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.551 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1356 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232514+0000", 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.237973+0000", 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054590610000000003 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238009+0000", 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188999999999998e-05 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238033+0000", 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4769999999999998e-05 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238179+0000", 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014558299999999999 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238427+0000", 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000247827 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238654+0000", 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022734200000000001 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.247463+0000", 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008808471 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251130+0000", 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036668830000000001 2024-05-09T09:54:55.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251327+0000", 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000197441 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251474+0000", 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147047 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1393 3.10 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.59255293, 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02062228, 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1393 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923152+0000", 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0190000000000001e-06 2024-05-09T09:54:55.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926928+0000", 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037758520000000001 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926954+0000", 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6152e-05 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926967+0000", 2024-05-09T09:54:55.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2925000000000001e-05 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927050+0000", 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3015000000000004e-05 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927188+0000", 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013808000000000001 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:55.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927320+0000", 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132311 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.936936+0000", 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096158560000000008 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943673+0000", 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067373729999999996 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943728+0000", 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5053000000000003e-05 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943772+0000", 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643999999999998e-05 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1403 3.a 3:53fcb7d2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:55.562 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.365819386999998, 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018525527, 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1403 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:55.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149883+0000", 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.149887+0000", 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5240000000000001e-06 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153623+0000", 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037363919999999998 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153652+0000", 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8836e-05 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153666+0000", 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3824e-05 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153761+0000", 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4975000000000005e-05 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.153967+0000", 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000206085 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.154165+0000", 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000198118 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.161143+0000", 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0069783700000000002 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168262+0000", 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0071186340000000004 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168343+0000", 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1044999999999994e-05 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:32.168409+0000", 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5723999999999996e-05 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1656 3.35 3:ad423f51:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.782539584999999, 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021084454999999998, 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.568 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1656 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733164+0000", 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2300000000000001e-06 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733175+0000", 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0526999999999999e-05 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733201+0000", 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5952000000000002e-05 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733210+0000", 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5629999999999998e-06 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744680+0000", 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011469795 2024-05-09T09:54:55.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744936+0000", 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255691 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.754248+0000", 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093116970000000007 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1726 3.3f e63/18 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head v 63'7, mlcod=59'5)", 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.966711769, 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018934763, 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548993+0000", 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8139999999999999e-06 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551287+0000", 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022947499999999999 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551311+0000", 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3252999999999999e-05 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551323+0000", 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1926999999999999e-05 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551470+0000", 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014753100000000001 2024-05-09T09:54:55.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551538+0000", 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7618000000000002e-05 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567876+0000", 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016337872 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567926+0000", 2024-05-09T09:54:55.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9997999999999998e-05 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1876 3.a 3:52ea8d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.QD71QSIjnzYUJvkbUpu9yZ6kMZGI2uX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.7467334720000007, 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024394813000000001, 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.577 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1876 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768972+0000", 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.616e-06 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773360+0000", 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043882620000000004 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773389+0000", 2024-05-09T09:54:55.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8731999999999999e-05 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773401+0000", 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2094e-05 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773506+0000", 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105173 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773713+0000", 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020665399999999999 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773888+0000", 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017540899999999999 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.785628+0000", 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011740301999999999 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793268+0000", 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076399040000000003 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793319+0000", 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0841999999999999e-05 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793364+0000", 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4824999999999999e-05 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.582 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1888 3.26 3:66cc2661:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.RVUWhTPr75VRTCdvqYW6zhcKOb-0e_t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.4011030820000006, 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021044698000000001, 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.583 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1888 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114602+0000", 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118409+0000", 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038070840000000001 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118430+0000", 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1407e-05 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118441+0000", 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0438999999999999e-05 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118594+0000", 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015285299999999999 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118989+0000", 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039577600000000003 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.119396+0000", 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040618000000000002 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.132480+0000", 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013084760000000001 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135459+0000", 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029782390000000001 2024-05-09T09:54:55.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135557+0000", 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8554999999999994e-05 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135644+0000", 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7145999999999995e-05 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1916 3.36 3:6eedf4b4:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.VPNU2_fk3V70lu7RybtX1vlXVee9jX__1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.8946116760000002, 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024095032999999998, 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1916 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621094+0000", 2024-05-09T09:54:55.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.36e-06 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626192+0000", 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050974690000000003 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626234+0000", 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2406e-05 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626253+0000", 2024-05-09T09:54:55.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8776000000000001e-05 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626355+0000", 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101538 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626533+0000", 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017836699999999999 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626684+0000", 2024-05-09T09:54:55.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151414 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.636642+0000", 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099573470000000001 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.644981+0000", 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083395520000000001 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645074+0000", 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3295999999999996e-05 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645186+0000", 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111508 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2075 3.a 3:53469b12:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.6RHkQ-W_EKbk_OF2lFq2sr_HPaXtnXH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:54:55.594 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.5379748040000001, 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020026097999999999, 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2075 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:54:55.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977731+0000", 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4300000000000002e-06 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981866+0000", 2024-05-09T09:54:55.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041346309999999997 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981892+0000", 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6545000000000001e-05 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981907+0000", 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4489e-05 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982017+0000", 2024-05-09T09:54:55.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109706 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982270+0000", 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025379899999999997 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982518+0000", 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024785900000000001 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.996151+0000", 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013632513000000001 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997589+0000", 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014381960000000001 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997687+0000", 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7575e-05 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997754+0000", 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7354999999999995e-05 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2081 3.36 3:6cf6c747:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.n_zpFFFU2OZoJK0JchjxtEuV5CgxBIK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.3853653709999998, 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019931259999999999, 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.600 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2081 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:54:55.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130340+0000", 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8399999999999999e-06 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134268+0000", 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039274799999999997 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134304+0000", 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5929000000000001e-05 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134322+0000", 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8260000000000001e-05 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134453+0000", 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013139799999999999 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134700+0000", 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000246815 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134954+0000", 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025361900000000001 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.144764+0000", 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098099399999999996 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150087+0000", 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053232160000000004 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150179+0000", 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2244000000000007e-05 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150269+0000", 2024-05-09T09:54:55.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9518999999999995e-05 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2099 3.1e 3:789e79c5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.gqxJ-lp-L0uUFrshZonEkrXrhQkW2Gi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.0504461589999998, 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021689172, 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.606 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2099 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:54:55.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465260+0000", 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2100000000000002e-06 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471028+0000", 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057687509999999999 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471069+0000", 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0955999999999999e-05 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471095+0000", 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5375999999999999e-05 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471261+0000", 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165747 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471520+0000", 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025964199999999998 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471893+0000", 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037329000000000003 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.484923+0000", 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013029618 2024-05-09T09:54:55.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486774+0000", 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018512190000000001 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486872+0000", 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7934000000000001e-05 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486946+0000", 2024-05-09T09:54:55.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3429000000000005e-05 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2105 3.10 3:0bd3bb69:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.9DoRBdszHtn66r2rQmpiH3p-scscd-l_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.9141263090000002, 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023605516999999999, 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.612 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2105 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601596+0000", 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9896000000000001e-05 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605653+0000", 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040566650000000001 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605687+0000", 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4421000000000001e-05 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605708+0000", 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0750999999999998e-05 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605899+0000", 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019071499999999999 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606144+0000", 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024554600000000002 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606373+0000", 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022909199999999999 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.616518+0000", 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010144497000000001 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625017+0000", 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084995699999999997 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625112+0000", 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4628000000000003e-05 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625182+0000", 2024-05-09T09:54:55.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9735999999999998e-05 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2120 3.a 3:50dc6130:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.568245396, 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022303443999999999, 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.618 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2120 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947461+0000", 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.924e-06 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951651+0000", 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004190208 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951695+0000", 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3782999999999997e-05 2024-05-09T09:54:55.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951714+0000", 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9279e-05 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951813+0000", 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8303999999999999e-05 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951972+0000", 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015941499999999999 2024-05-09T09:54:55.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.952494+0000", 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052197500000000004 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.965422+0000", 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012927467 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969426+0000", 2024-05-09T09:54:55.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004004479 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969628+0000", 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020216599999999999 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969761+0000", 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013244400000000001 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2157 3.3b 3:dd466707:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.kmq4W5FDvTJuiVHTRZOzwfAwhKijRHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.8569034379999998, 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069844506000000001, 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658802+0000", 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7810000000000001e-06 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662839+0000", 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040367909999999996 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662873+0000", 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4075999999999997e-05 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662896+0000", 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2821000000000001e-05 2024-05-09T09:54:55.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663002+0000", 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105882 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663159+0000", 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015773 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663293+0000", 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013406599999999999 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.670298+0000", 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007004845 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728516+0000", 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058218029999999997 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728590+0000", 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3422000000000003e-05 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728644+0000", 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4061999999999998e-05 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2172 3.26 3:64119a6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.72:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 3.5029956420000001, 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022271427, 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:55.629 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2172 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:55.630 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012709+0000", 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1339999999999998e-06 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016768+0000", 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004058412 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:55.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016801+0000", 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3831999999999997e-05 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016817+0000", 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5843000000000001e-05 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016972+0000", 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015504399999999999 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.017233+0000", 2024-05-09T09:54:55.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026038899999999998 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.018157+0000", 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092440100000000004 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034009+0000", 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015851714999999999 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:55.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034761+0000", 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00075227699999999998 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034898+0000", 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136558 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034978+0000", 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0822000000000006e-05 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.634 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:55.635 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:55.635 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:55.636 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:54:55.637 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:55.633+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:55.737 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:55.735+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:55.813 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:55.814 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:55.814 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:55.814 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:55.828 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:54:55.838 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:55.839+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:55.939 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:55.939+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:55.946 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:55.946 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:55.946 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:55.946 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:55.946 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:55.960 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:54:56.039 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:56.037+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:56.090 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:56.091 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:56.091 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:56.091 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:56.091 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.091 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:56.091 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 114.79093062699999, 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.092 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.093 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.094 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.095 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.096 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.097 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 114.79089647399999, 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:56.098 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:56.099 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.100 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.101 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.102 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.103 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 114.790775951, 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:54:56.104 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.105 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:54:56.106 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:54:56.107 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:56.108 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.109 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:54:56.110 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 114.790740425, 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.111 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:54:56.112 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.113 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.114 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.115 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1157 3.13 3:cb26828e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.624359631000001, 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021985248999999998, 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1157 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.116 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463102+0000", 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3630000000000001e-06 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.117 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470773+0000", 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076712769999999998 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470806+0000", 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2802999999999997e-05 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470827+0000", 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1175999999999999e-05 2024-05-09T09:54:56.118 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471017+0000", 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018967499999999999 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471279+0000", 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026242300000000002 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471498+0000", 2024-05-09T09:54:56.119 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021940300000000001 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.482134+0000", 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010635446999999999 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.484865+0000", 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027312460000000001 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485006+0000", 2024-05-09T09:54:56.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039099999999999 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485085+0000", 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9045e-05 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1178 3.37 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.370028458, 2024-05-09T09:54:56.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030832948999999998, 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1178 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717434+0000", 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0060000000000001e-06 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721611+0000", 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041770929999999998 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721645+0000", 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4561999999999999e-05 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721678+0000", 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2700000000000002e-05 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721844+0000", 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165914 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722121+0000", 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027709300000000001 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722352+0000", 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023117600000000001 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.733566+0000", 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011213989000000001 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748089+0000", 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014523036 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748187+0000", 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7974999999999996e-05 2024-05-09T09:54:56.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748263+0000", 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6404999999999998e-05 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1179 3.15 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.359348698000002, 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021009254000000002, 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.127 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1179 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728138+0000", 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7906e-05 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734782+0000", 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066435950000000004 2024-05-09T09:54:56.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734827+0000", 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5269000000000003e-05 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734858+0000", 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0654000000000002e-05 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735020+0000", 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016203699999999999 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735274+0000", 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025399299999999999 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735518+0000", 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024406300000000001 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747370+0000", 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011852339 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748991+0000", 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016208259999999999 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749065+0000", 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4018999999999997e-05 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749120+0000", 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4552999999999998e-05 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1214 3.39 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.257031469000001, 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028754392, 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.133 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1214 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830433+0000", 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.237e-06 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838120+0000", 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076874200000000004 2024-05-09T09:54:56.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838164+0000", 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4002999999999999e-05 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838186+0000", 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.198e-05 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838356+0000", 2024-05-09T09:54:56.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169421 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838666+0000", 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031002599999999998 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838898+0000", 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023215000000000001 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.849862+0000", 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010964649 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.858862+0000", 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089996999999999994 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859048+0000", 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186128 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859182+0000", 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133678 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1216 3.e 3:734f2773:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.215305958999998, 2024-05-09T09:54:56.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027271179999999999, 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1216 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872156+0000", 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.304e-06 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876935+0000", 2024-05-09T09:54:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047782440000000001 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876974+0000", 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9520000000000001e-05 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876999+0000", 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5286000000000002e-05 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877108+0000", 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109063 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877300+0000", 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019180299999999999 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877468+0000", 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759199999999999 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.886506+0000", 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379599999999994 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899047+0000", 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012540936000000001 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899286+0000", 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023885700000000001 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.144 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899424+0000", 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138615 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1217 3.11 3:8a7f3d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.201714665000001, 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021949672, 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.145 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1217 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885747+0000", 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0429999999999999e-06 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893119+0000", 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073719229999999998 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893163+0000", 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3476000000000002e-05 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893188+0000", 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5443e-05 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893364+0000", 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017547400000000001 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893619+0000", 2024-05-09T09:54:56.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025488300000000002 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893842+0000", 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022347099999999999 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907393+0000", 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013550804 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907498+0000", 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010539099999999999 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907590+0000", 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1419e-05 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907694+0000", 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104345 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1223 3.15 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.084527270999999, 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021427795999999999, 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1223 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002934+0000", 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2050000000000001e-06 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007103+0000", 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004168878 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007133+0000", 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0577999999999998e-05 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007145+0000", 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1844e-05 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007222+0000", 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6569000000000005e-05 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007366+0000", 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144053 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007494+0000", 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012810799999999999 2024-05-09T09:54:56.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.015333+0000", 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078388439999999993 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024121+0000", 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087886230000000006 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024253+0000", 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013161800000000001 2024-05-09T09:54:56.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024360+0000", 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106476 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1374 3.14 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 24.728906706, 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025594499999999999, 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.156 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1374 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:54:56.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358555+0000", 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0000000000000001e-06 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364047+0000", 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054919599999999997 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364082+0000", 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4903000000000001e-05 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364099+0000", 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7316000000000002e-05 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364233+0000", 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013302600000000001 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364481+0000", 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024840499999999999 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364757+0000", 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027572700000000003 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.372096+0000", 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007339702 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383918+0000", 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01182211 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384024+0000", 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105251 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384147+0000", 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012310000000000001 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.161 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1726 3.3f 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.542804506, 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023921398, 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1726 2024-05-09T09:54:56.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544657+0000", 2024-05-09T09:54:56.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548394+0000", 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003737326 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548421+0000", 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6865000000000001e-05 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548434+0000", 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2605e-05 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548514+0000", 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0352000000000006e-05 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548671+0000", 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156231 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548814+0000", 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014296600000000001 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.559185+0000", 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010371949 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568269+0000", 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090838789999999996 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568449+0000", 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179407 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568576+0000", 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012715400000000001 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1885 3.11 3:89f00d0a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.28:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:56.167 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.118305806, 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022582944000000001, 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1885 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:56.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969162+0000", 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.268e-06 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973026+0000", 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038637680000000001 2024-05-09T09:54:56.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973055+0000", 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8858000000000001e-05 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973067+0000", 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2184999999999999e-05 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973141+0000", 2024-05-09T09:54:56.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3747999999999999e-05 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973302+0000", 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016143099999999999 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973741+0000", 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043816299999999999 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991002+0000", 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017261155 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991603+0000", 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060141600000000002 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991671+0000", 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7433000000000003e-05 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991736+0000", 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5518999999999994e-05 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1931 3.f 3:f2a153e3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.0940773640000003, 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021453967000000001, 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.173 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1931 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:54:56.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993383+0000", 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.127e-06 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997421+0000", 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040380599999999996 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997440+0000", 2024-05-09T09:54:56.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9477e-05 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997453+0000", 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2498e-05 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997539+0000", 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6473999999999999e-05 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997702+0000", 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016321 2024-05-09T09:54:56.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.998188+0000", 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048555899999999999 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.006182+0000", 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079940800000000006 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014666+0000", 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084836749999999995 2024-05-09T09:54:56.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014767+0000", 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010093499999999999 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014836+0000", 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8872000000000001e-05 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2117 3.2d 3:b465dcda:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.GFV4vCspRy1zUXkFAuI6fs_j51KMCUd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.1672310340000003, 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021398311, 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2117 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920230+0000", 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.503e-06 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924562+0000", 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043315610000000003 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924591+0000", 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9077999999999998e-05 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924611+0000", 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0339999999999998e-05 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924703+0000", 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1440000000000005e-05 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924855+0000", 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015229100000000001 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924978+0000", 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012243099999999999 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.931560+0000", 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065820380000000001 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941452+0000", 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098919860000000002 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941554+0000", 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010251000000000001 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941626+0000", 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2132999999999995e-05 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2151 3.3f 3:fcdd6a3a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.e_T4R69E113FUtA8H-_HY1rmD7y3cXZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.5932298659999997, 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021326852, 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.184 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2151 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494232+0000", 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9299999999999999e-06 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498235+0000", 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040031620000000002 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498266+0000", 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0391000000000001e-05 2024-05-09T09:54:56.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498279+0000", 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3825000000000001e-05 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498387+0000", 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107236 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498604+0000", 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021725800000000001 2024-05-09T09:54:56.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498826+0000", 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000221759 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.513219+0000", 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014393764 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515433+0000", 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022133209999999999 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515502+0000", 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9191999999999998e-05 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515556+0000", 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4014000000000002e-05 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.189 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2160 3.15 3:aacab97a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.70:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.3513829299999998, 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023051668000000001, 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2160 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736079+0000", 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.163e-06 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.191 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740589+0000", 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045100990000000001 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740631+0000", 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1440000000000003e-05 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740655+0000", 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4413000000000002e-05 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740841+0000", 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018621299999999999 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.741107+0000", 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026576600000000002 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.741966+0000", 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085910000000000001 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.755114+0000", 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013147653 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.758937+0000", 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003822757 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.759053+0000", 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116078 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.759128+0000", 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4986000000000003e-05 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2298 3.11 3:8808c42e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.93:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.5037638, 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021413894999999999, 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.195 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2298 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:54:56.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583697+0000", 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2639999999999998e-06 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.587989+0000", 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042911590000000001 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588022+0000", 2024-05-09T09:54:56.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3686000000000002e-05 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588039+0000", 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6762999999999999e-05 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588181+0000", 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014182499999999999 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588455+0000", 2024-05-09T09:54:56.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027390500000000001 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.589403+0000", 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00094826800000000005 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.604719+0000", 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015316065 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.604920+0000", 2024-05-09T09:54:56.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020117099999999999 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.605052+0000", 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013208499999999999 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.605109+0000", 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6703999999999998e-05 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2313 3.13 3:ca22356b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.AtuHcbB9TtgV74F70V_2UZQQNVaym6E_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 1.138646289, 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023208837999999999, 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2313 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948816+0000", 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953841+0000", 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050255650000000001 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953882+0000", 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0176000000000003e-05 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953909+0000", 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7118999999999999e-05 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954013+0000", 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010416600000000001 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954153+0000", 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039200000000001 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954272+0000", 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011833299999999999 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.961157+0000", 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068856890000000004 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.971932+0000", 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010774522 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.971975+0000", 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3393000000000003e-05 2024-05-09T09:54:56.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.972022+0000", 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6377e-05 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:56.206 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:56.208 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:56.205+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:56.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:54:56.308 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:56.307+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:56.346 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:56.347 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:56.347 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:54:56.347 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:56.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:54:56.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:54:56.408 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:56.405+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:56.509 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:56.505+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:56.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:54:56.531 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:54:56.531 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:54:56.531 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:54:56.531 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:54:56.531 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:54:56.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:54:56.642 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:56.643+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:56.703 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:56.704 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:56.710 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:54:56.705+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:54:56.725 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:56.725 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:56.739 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:56.739 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:56.758 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:56.758 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:56.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:54:56.778 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:56.778 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:56.799 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:56.799 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:56.811 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:56.809+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:56.820 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:56.820 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:56.840 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:56.840 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:56.861 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:56.861 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:56.895 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:56.896 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:56.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:54:56.912 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:56.909+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:57.013 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:57.011+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:57.075 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:57.075 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:57.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:54:57.138 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:57.139+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:57.215 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:57.215+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:57.268 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:57.268 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:57.283 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:54:57.316 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:57.313+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:57.401 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:54:57.418 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:54:57.413+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:54:57.465 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:57.465 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:57.479 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:54:57.522 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:57.523+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:57.620 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:57.621+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:57.649 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:57.649 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:57.668 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:54:57.721 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:57.721+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:57.787 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:57.787 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:57.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:54:57.850 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:57.851+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:57.923 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:57.923+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:57.930 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:57.930 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:57.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:54:58.024 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:58.021+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:58.114 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:58.114 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:58.125 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:58.123+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:58.128 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:54:58.226 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:58.225+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:58.308 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:58.308 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:58.323 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:54:58.326 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:58.325+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:58.427 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:58.425+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:58.461 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:58.461 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:58.475 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:54:58.563 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:58.561+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:58.629 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:58.627+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:58.644 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:58.644 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:58.658 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:54:58.729 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:54:58.731+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:54:58.830 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:58.831+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:58.831 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:58.831 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:58.846 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:54:58.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:54:58.932 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:58.931+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:58.970 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:58.970 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:58.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:54:59.033 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:59.029+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:59.035 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:54:59.035 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:54:59.053 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:54:59.053 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:54:59.070 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:54:59.070 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:54:59.090 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:54:59.091 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:54:59.109 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:54:59.109 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:54:59.112 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:54:59.112 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:54:59.124 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:54:59.133 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:54:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:54:59.154 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:54:59.155 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:54:59.167 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:59.165+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:59.178 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:54:59.179 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:54:59.246 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:54:59.247+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1161 3.1d 3:b8b74cb5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.771910753, 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020326487000000001, 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.293 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1161 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.294 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518541+0000", 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.518545+0000", 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5639999999999998e-06 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522778+0000", 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042321429999999998 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.295 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522816+0000", 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8624000000000002e-05 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522834+0000", 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8059000000000001e-05 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.522974+0000", 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013931100000000001 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.296 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523215+0000", 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024094700000000001 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.523432+0000", 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000217333 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.532230+0000", 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087981150000000004 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.297 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538624+0000", 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0063944249999999996 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538717+0000", 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2608999999999994e-05 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.538867+0000", 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000150357 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.298 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1164 3.2a 3:563cc67e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.730116500999998, 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023925154000000001, 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1164 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.299 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560335+0000", 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.560338+0000", 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2499999999999998e-06 2024-05-09T09:54:59.300 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564645+0000", 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043069290000000001 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564681+0000", 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5746e-05 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564697+0000", 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6269999999999998e-05 2024-05-09T09:54:59.301 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.564822+0000", 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012474099999999999 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565074+0000", 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025190400000000001 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.565300+0000", 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000226133 2024-05-09T09:54:59.302 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.572636+0000", 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073360760000000004 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584083+0000", 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011446424 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584177+0000", 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4518999999999994e-05 2024-05-09T09:54:59.303 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.584260+0000", 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3162000000000001e-05 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1178 3.37 e57/18 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head v 57'2, mlcod=0'0)", 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.567899582000003, 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025242840999999999, 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.304 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722552+0000", 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.305 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722556+0000", 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5159999999999999e-06 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728655+0000", 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0060999039999999997 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728694+0000", 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8009999999999997e-05 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.306 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728710+0000", 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6880000000000001e-05 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728899+0000", 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018883699999999999 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728968+0000", 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9041999999999994e-05 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.307 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747653+0000", 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018684905000000002 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747795+0000", 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014174700000000001 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1201 3.2a 3:54ff7f97:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.942270864000001, 2024-05-09T09:54:59.308 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020960774000000001, 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1201 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.309 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348181+0000", 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.348183+0000", 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9889999999999999e-06 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352065+0000", 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038826189999999999 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.310 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352086+0000", 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0407e-05 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352100+0000", 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3745e-05 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352173+0000", 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3335000000000002e-05 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.311 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352330+0000", 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015688400000000001 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.352462+0000", 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013203100000000001 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.365714+0000", 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013252553 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.312 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.368997+0000", 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0032823800000000001 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369079+0000", 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2639999999999995e-05 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.369142+0000", 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.2191000000000001e-05 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.313 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1213 3.22 3:4403c19e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.474484228000001, 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022416997000000001, 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1213 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.314 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815967+0000", 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.815970+0000", 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6079999999999998e-06 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.315 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819807+0000", 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038369699999999999 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819837+0000", 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0423999999999999e-05 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819850+0000", 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2594e-05 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.316 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.819953+0000", 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102543 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820186+0000", 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023374800000000001 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.820600+0000", 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041405700000000001 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.317 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.833246+0000", 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012645854 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838263+0000", 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050170529999999996 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838332+0000", 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9202000000000006e-05 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.318 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838384+0000", 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1944000000000003e-05 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1234 3.2f 3:f547a26d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.053462051, 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021134344999999999, 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.319 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1234 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236990+0000", 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.320 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.236992+0000", 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.12e-06 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.240966+0000", 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039738539999999998 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241001+0000", 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5169999999999997e-05 2024-05-09T09:54:59.321 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241018+0000", 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7523000000000001e-05 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241186+0000", 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016797099999999999 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241562+0000", 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037583099999999997 2024-05-09T09:54:59.322 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.241922+0000", 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00036000099999999998 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.255413+0000", 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013490925000000001 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.257956+0000", 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0025432250000000001 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.323 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258047+0000", 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1108999999999998e-05 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.258124+0000", 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6616e-05 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1394 3.1d 3:bbe93ed1:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:59.324 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 27.342542612999999, 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021946568999999999, 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1394 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.325 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947909+0000", 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.947912+0000", 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5979999999999999e-06 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952060+0000", 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041480270000000003 2024-05-09T09:54:59.326 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952101+0000", 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0948999999999997e-05 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952129+0000", 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8634999999999999e-05 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952302+0000", 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017274599999999999 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.327 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952559+0000", 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025720799999999998 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.952811+0000", 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000252124 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.961321+0000", 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0085092090000000002 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.328 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969641+0000", 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083202880000000003 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969737+0000", 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6642000000000001e-05 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.969856+0000", 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000118143 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.329 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1732 3.2a 3:57cad4d0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.z7A6gvGdCsGpYkA4afvy42BiLcIeNy9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.620859691, 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020981109000000001, 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1732 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.330 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669592+0000", 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.669595+0000", 2024-05-09T09:54:59.331 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8159999999999998e-06 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673343+0000", 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037477550000000002 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673372+0000", 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9085999999999999e-05 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673384+0000", 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2615e-05 2024-05-09T09:54:59.332 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673496+0000", 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111888 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673731+0000", 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023452 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.673945+0000", 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021394900000000001 2024-05-09T09:54:59.333 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.686870+0000", 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012925624 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690449+0000", 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0035790399999999999 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690522+0000", 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2745999999999998e-05 2024-05-09T09:54:59.334 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.690573+0000", 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.1069999999999997e-05 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1864 3.30 3:0f8e5753:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.vjrfU8R0YhW7bZ2SDYx38ZOxKyLoEJ4_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.844353951, 2024-05-09T09:54:59.335 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020719274999999999, 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1864 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:59.336 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446098+0000", 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.446101+0000", 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.49e-06 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450033+0000", 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039319380000000003 2024-05-09T09:54:59.337 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450059+0000", 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5548e-05 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450071+0000", 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2245999999999999e-05 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450231+0000", 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000160464 2024-05-09T09:54:59.338 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.450626+0000", 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039443900000000001 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.451035+0000", 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040921300000000001 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.463627+0000", 2024-05-09T09:54:59.339 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012592067 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466538+0000", 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029110289999999999 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466696+0000", 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015758999999999999 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.466817+0000", 2024-05-09T09:54:59.340 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012125099999999999 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1873 3.38 3:1e64df2a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.26:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.663777218, 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019915188, 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.341 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1873 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626674+0000", 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.342 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.626678+0000", 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8e-06 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630890+0000", 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042116360000000004 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630924+0000", 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3708999999999999e-05 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.343 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.630937+0000", 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3841e-05 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.631046+0000", 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010836 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.631313+0000", 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026688200000000002 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.344 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.632056+0000", 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00074307599999999996 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.640884+0000", 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008828743 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646477+0000", 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0055922339999999997 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.345 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646542+0000", 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5617999999999994e-05 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.646590+0000", 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.7289000000000001e-05 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1891 3.38 3:1c43b68b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:59.346 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.149072157999999, 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020059576999999999, 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1891 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.347 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141379+0000", 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.141381+0000", 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.615e-06 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146198+0000", 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0048167419999999997 2024-05-09T09:54:59.348 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146231+0000", 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3565999999999997e-05 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146248+0000", 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6540000000000001e-05 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146358+0000", 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010968600000000001 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.349 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.146575+0000", 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000216899 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.147140+0000", 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00056583299999999996 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.160803+0000", 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013662934 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.350 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161343+0000", 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00053952500000000001 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161400+0000", 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.7092000000000002e-05 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.161439+0000", 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9144999999999999e-05 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.351 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1922 3.5 3:a3ee2791:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.0Ed7ZEVcL9CnMwDM9Yiij5ANu2WW139_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.490474861999999, 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02035182, 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1922 2024-05-09T09:54:59.352 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799977+0000", 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.799980+0000", 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1599999999999998e-06 2024-05-09T09:54:59.353 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804290+0000", 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043101099999999998 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804327+0000", 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7143e-05 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804345+0000", 2024-05-09T09:54:59.354 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7946000000000001e-05 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804484+0000", 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013861099999999999 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.804756+0000", 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027221899999999998 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.805005+0000", 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024909200000000002 2024-05-09T09:54:59.355 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.818965+0000", 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013960006 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820010+0000", 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0010453179999999999 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.356 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820196+0000", 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186047 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.820329+0000", 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132168 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1934 3.1 e65/62 3:83810aba:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.bd0uPieH5yAMY0BuB5M_Z7ovAps42t5_1:head v 65'5, mlcod=59'3)", 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:59.357 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.174290427000001, 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023284467, 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116161+0000", 2024-05-09T09:54:59.358 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.116163+0000", 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.04e-06 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121321+0000", 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0051577749999999999 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121366+0000", 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4948999999999999e-05 2024-05-09T09:54:59.359 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121384+0000", 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7533e-05 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121537+0000", 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015350699999999999 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.121594+0000", 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6545999999999997e-05 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.360 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.139359+0000", 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017765689000000001 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.139446+0000", 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6428000000000007e-05 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2078 3.2 3:41c71c3b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.58:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:59.361 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.2849912240000005, 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024084686000000001, 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2078 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:59.362 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005460+0000", 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.005463+0000", 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7030000000000002e-06 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010468+0000", 2024-05-09T09:54:59.363 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050052610000000004 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010508+0000", 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9950000000000002e-05 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010527+0000", 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8278999999999999e-05 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010652+0000", 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000125785 2024-05-09T09:54:59.364 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.010924+0000", 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027113799999999998 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.011795+0000", 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00087143799999999999 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.027012+0000", 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015217101 2024-05-09T09:54:59.365 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029226+0000", 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.002213717 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029422+0000", 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019575699999999999 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.029545+0000", 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000123557 2024-05-09T09:54:59.366 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2111 3.28 3:15d70eee:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.lgea9Z83k54346rKmMLqWontMqssjIw_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.759440+0000", 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.5310118209999999, 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021769648999999999, 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.367 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2111 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.759440+0000", 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.759440+0000", 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.368 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.759442+0000", 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6599999999999999e-06 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763262+0000", 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038199420000000002 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763292+0000", 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9094e-05 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.369 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763304+0000", 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2687999999999999e-05 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763414+0000", 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110142 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763647+0000", 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023309000000000001 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.370 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.763885+0000", 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023791200000000001 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.772692+0000", 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0088068539999999994 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.781105+0000", 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084125829999999995 2024-05-09T09:54:59.371 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.781161+0000", 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6162999999999997e-05 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.781209+0000", 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8520999999999998e-05 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2126 3.3a 3:5c8ab91a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.66:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:54:59.372 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.083568+0000", 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.2068833740000002, 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021395483999999999, 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2126 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.083568+0000", 2024-05-09T09:54:59.373 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.083568+0000", 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.083574+0000", 2024-05-09T09:54:59.374 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6450000000000002e-06 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.087993+0000", 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0044188270000000002 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088020+0000", 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6808000000000002e-05 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088032+0000", 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2554e-05 2024-05-09T09:54:59.375 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088119+0000", 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6600000000000004e-05 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088281+0000", 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016252199999999999 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.088833+0000", 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00055137399999999998 2024-05-09T09:54:59.376 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.101106+0000", 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012273874000000001 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.104810+0000", 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037037699999999999 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.104902+0000", 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1644000000000006e-05 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.377 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.104964+0000", 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1865999999999993e-05 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2129 3.22 3:443473dc:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.M5FtRVGnH4PCmXQBPm5Ulxr478hzqci_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.194819+0000", 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.0956321950000003, 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021783567, 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.378 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2129 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.194819+0000", 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.379 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.194819+0000", 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.194823+0000", 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3069999999999998e-06 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200670+0000", 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0058470040000000003 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.380 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200710+0000", 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.977e-05 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200748+0000", 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8293000000000001e-05 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200850+0000", 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102649 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.381 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.200961+0000", 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011009 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.201058+0000", 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.6973999999999997e-05 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.207036+0000", 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059788380000000002 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.382 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.216551+0000", 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0095150830000000006 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.216582+0000", 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0883999999999998e-05 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.216603+0000", 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0675000000000001e-05 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.383 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:2163 3.27 e67/62 3:e7b1cd89:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.mnLCFQJlnKvb689d2vFaEnVSGZYm_Se_1:head v 67'6, mlcod=58'4)", 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.870141+0000", 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 7.4203108699999998, 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020546331000000001, 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.870141+0000", 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.384 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.870141+0000", 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.870144+0000", 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1e-06 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875545+0000", 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054009009999999996 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.385 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875575+0000", 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0190999999999999e-05 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875589+0000", 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4289e-05 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875752+0000", 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016271100000000001 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.386 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.875795+0000", 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3216000000000001e-05 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.890570+0000", 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014775224 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.890687+0000", 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116699 2024-05-09T09:54:59.387 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.389 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.389 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.389 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2301 3.3a 3:5e9a2131:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.UPzna9Mz7t2tLq5Bpr360DOhZ3CrQtz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.674499+0000", 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.6159528500000002, 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021140340000000001, 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2301 2024-05-09T09:54:59.390 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.674499+0000", 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.674499+0000", 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.674527+0000", 2024-05-09T09:54:59.391 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8566999999999999e-05 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680493+0000", 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0059653919999999999 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680538+0000", 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5055999999999997e-05 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.392 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680557+0000", 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8987e-05 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680674+0000", 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000117617 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.393 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.680905+0000", 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023067699999999999 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.681117+0000", 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021180600000000001 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.692575+0000", 2024-05-09T09:54:59.394 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011458403000000001 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.695490+0000", 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029149430000000001 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.695572+0000", 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.2000000000000001e-05 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.395 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.695639+0000", 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.6891999999999996e-05 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2319 3.1d 3:bb2a5b8a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Agg9fEly-nJearsgmp4K-WMecRVrdEs_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:55.094150+0000", 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.1963017960000002, 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020539658999999998, 2024-05-09T09:54:59.396 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2319 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.397 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.094150+0000", 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.094150+0000", 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.094153+0000", 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.977e-06 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.398 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.097947+0000", 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037937840000000001 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.097978+0000", 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1291000000000002e-05 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.399 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.097992+0000", 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4224e-05 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.098096+0000", 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000103732 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.098275+0000", 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000178982 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.400 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.098418+0000", 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014324499999999999 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.114232+0000", 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015813521000000001 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.114562+0000", 2024-05-09T09:54:59.401 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000330561 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.114617+0000", 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4753000000000002e-05 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.114690+0000", 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2589000000000006e-05 2024-05-09T09:54:59.402 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.403 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.403 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.403 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:59.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:54:59.405 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:59.401+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:59.430 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:54:59.505 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:54:59.501+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:54:59.576 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:59.576 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:59.576 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:54:59.576 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:59.594 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:54:59.606 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:54:59.607+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:54:59.707 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:59.705+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:59.767 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:59.767 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:54:59.767 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:54:59.768 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:54:59.768 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:54:59.782 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:54:59.827 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:54:59.825+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:54:59.908 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:54:59.907+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:54:59.952 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:54:59.952 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:54:59.952 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 104.802161164, 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:54:59.953 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:54:59.954 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:54:59.955 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:54:59.956 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:54:59.957 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:54:59.958 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1158 3.2c 3:367a58d5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:59.959 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.469095222, 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021363626, 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1158 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.960 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481220+0000", 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486955+0000", 2024-05-09T09:54:59.961 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057345460000000001 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486994+0000", 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8982e-05 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487016+0000", 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2103000000000002e-05 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487145+0000", 2024-05-09T09:54:59.962 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012962499999999999 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487392+0000", 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024650300000000002 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487614+0000", 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022186999999999999 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.500091+0000", 2024-05-09T09:54:59.963 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012477054 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502399+0000", 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023086449999999998 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502492+0000", 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2662000000000002e-05 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502581+0000", 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-05-09T09:54:59.964 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1167 3.26 3:65d9db40:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.354440576000002, 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021114266, 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.965 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1167 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.966 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595875+0000", 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1499999999999999e-06 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599908+0000", 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040330510000000002 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599945+0000", 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7366000000000001e-05 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.967 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599964+0000", 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199e-05 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600143+0000", 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017947500000000001 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600531+0000", 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000387914 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.968 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600968+0000", 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043724399999999999 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.615593+0000", 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014624727000000001 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616799+0000", 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012065159999999999 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.969 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616910+0000", 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110555 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616986+0000", 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6069000000000006e-05 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1208 3.a 3:5055ce64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:59.970 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.484862231000001, 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018795551000000001, 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1208 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.971 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465453+0000", 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8609999999999998e-06 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469227+0000", 2024-05-09T09:54:59.972 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003774281 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469250+0000", 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3156e-05 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469262+0000", 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1531e-05 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469334+0000", 2024-05-09T09:54:59.973 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2290000000000001e-05 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469342+0000", 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1659999999999994e-06 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473383+0000", 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040406940000000001 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.974 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473477+0000", 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3929000000000001e-05 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473588+0000", 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110938 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.479810+0000", 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062221070000000002 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.975 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484173+0000", 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436265 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484212+0000", 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9322000000000001e-05 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484246+0000", 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3626e-05 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.976 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1229 3.2c 3:34904b64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 31.834776629, 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020735874000000001, 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1229 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.977 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115539+0000", 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6200000000000001e-06 2024-05-09T09:54:59.978 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119644+0000", 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041042090000000002 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119669+0000", 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5754000000000001e-05 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119684+0000", 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4209000000000001e-05 2024-05-09T09:54:59.979 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119768+0000", 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4524999999999995e-05 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119922+0000", 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015423600000000001 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.120056+0000", 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013380999999999999 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.980 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.129703+0000", 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009646422 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136158+0000", 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064555810000000002 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136223+0000", 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4523999999999994e-05 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.981 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136272+0000", 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8983999999999997e-05 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1356 3.35 3:af70797a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.717802114000001, 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018963760999999999, 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.982 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1356 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:54:59.983 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232514+0000", 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.237973+0000", 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054590610000000003 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238009+0000", 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188999999999998e-05 2024-05-09T09:54:59.984 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238033+0000", 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4769999999999998e-05 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238179+0000", 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014558299999999999 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238427+0000", 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000247827 2024-05-09T09:54:59.985 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238654+0000", 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022734200000000001 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.247463+0000", 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008808471 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251130+0000", 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036668830000000001 2024-05-09T09:54:59.986 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251327+0000", 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000197441 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251474+0000", 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147047 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.987 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1393 3.10 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 28.027162659999998, 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02062228, 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1393 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.988 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923152+0000", 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0190000000000001e-06 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.989 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926928+0000", 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037758520000000001 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926954+0000", 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6152e-05 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926967+0000", 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2925000000000001e-05 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.990 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927050+0000", 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3015000000000004e-05 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927188+0000", 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013808000000000001 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927320+0000", 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132311 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.936936+0000", 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096158560000000008 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943673+0000", 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067373729999999996 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943728+0000", 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5053000000000003e-05 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943772+0000", 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643999999999998e-05 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1656 3.35 3:ad423f51:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.217149315, 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021084454999999998, 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:54:59.993 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1656 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.994 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733164+0000", 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2300000000000001e-06 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733175+0000", 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0526999999999999e-05 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733201+0000", 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5952000000000002e-05 2024-05-09T09:54:59.995 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733210+0000", 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5629999999999998e-06 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744680+0000", 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011469795 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744936+0000", 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255691 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.996 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.754248+0000", 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093116970000000007 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1726 3.3f e63/18 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head v 63'7, mlcod=59'5)", 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.401321499000002, 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018934763, 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:54:59.997 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:54:59.998 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:54:59.999 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:54:59.999 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:54:59.999 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548993+0000", 2024-05-09T09:55:00.001 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8139999999999999e-06 2024-05-09T09:55:00.001 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.001 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.001 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551287+0000", 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022947499999999999 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551311+0000", 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3252999999999999e-05 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.002 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551323+0000", 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1926999999999999e-05 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551470+0000", 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014753100000000001 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551538+0000", 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7618000000000002e-05 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.003 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567876+0000", 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016337872 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567926+0000", 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9997999999999998e-05 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.004 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.005 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1876 3.a 3:52ea8d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.QD71QSIjnzYUJvkbUpu9yZ6kMZGI2uX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:00.005 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:00.005 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.181343202000001, 2024-05-09T09:55:00.005 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024394813000000001, 2024-05-09T09:55:00.005 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.005 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.005 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1876 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.006 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768972+0000", 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.616e-06 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.007 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773360+0000", 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043882620000000004 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773389+0000", 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8731999999999999e-05 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773401+0000", 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2094e-05 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.008 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773506+0000", 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105173 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773713+0000", 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020665399999999999 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773888+0000", 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017540899999999999 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.009 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.785628+0000", 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011740301999999999 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793268+0000", 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076399040000000003 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793319+0000", 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0841999999999999e-05 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.010 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793364+0000", 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4824999999999999e-05 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1888 3.26 3:66cc2661:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.RVUWhTPr75VRTCdvqYW6zhcKOb-0e_t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.835712812000001, 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021044698000000001, 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.011 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1888 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.012 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114602+0000", 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118409+0000", 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038070840000000001 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118430+0000", 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1407e-05 2024-05-09T09:55:00.013 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118441+0000", 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0438999999999999e-05 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118594+0000", 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015285299999999999 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118989+0000", 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039577600000000003 2024-05-09T09:55:00.014 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.119396+0000", 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040618000000000002 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.132480+0000", 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013084760000000001 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135459+0000", 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029782390000000001 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.015 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135557+0000", 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8554999999999994e-05 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135644+0000", 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7145999999999995e-05 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1916 3.36 3:6eedf4b4:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.VPNU2_fk3V70lu7RybtX1vlXVee9jX__1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:00.016 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.329221406, 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024095032999999998, 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1916 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.017 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621094+0000", 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.36e-06 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.018 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626192+0000", 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050974690000000003 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626234+0000", 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2406e-05 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626253+0000", 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8776000000000001e-05 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.019 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626355+0000", 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101538 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626533+0000", 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017836699999999999 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626684+0000", 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151414 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.020 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.636642+0000", 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099573470000000001 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.644981+0000", 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083395520000000001 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645074+0000", 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3295999999999996e-05 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.021 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645186+0000", 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111508 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2075 3.a 3:53469b12:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.6RHkQ-W_EKbk_OF2lFq2sr_HPaXtnXH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.9725845339999992, 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020026097999999999, 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.022 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2075 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.023 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977731+0000", 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4300000000000002e-06 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981866+0000", 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041346309999999997 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.024 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981892+0000", 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6545000000000001e-05 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981907+0000", 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4489e-05 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982017+0000", 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109706 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982270+0000", 2024-05-09T09:55:00.025 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025379899999999997 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982518+0000", 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024785900000000001 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.996151+0000", 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013632513000000001 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.026 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997589+0000", 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014381960000000001 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997687+0000", 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7575e-05 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997754+0000", 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7354999999999995e-05 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.027 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2081 3.36 3:6cf6c747:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.n_zpFFFU2OZoJK0JchjxtEuV5CgxBIK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.8199751010000007, 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019931259999999999, 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2081 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.028 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130340+0000", 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8399999999999999e-06 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.029 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134268+0000", 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039274799999999997 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134304+0000", 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5929000000000001e-05 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134322+0000", 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8260000000000001e-05 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.030 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134453+0000", 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013139799999999999 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134700+0000", 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000246815 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134954+0000", 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025361900000000001 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.031 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.144764+0000", 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098099399999999996 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150087+0000", 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053232160000000004 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150179+0000", 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2244000000000007e-05 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.032 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150269+0000", 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9518999999999995e-05 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2099 3.1e 3:789e79c5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.gqxJ-lp-L0uUFrshZonEkrXrhQkW2Gi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.4850558889999999, 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021689172, 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.033 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2099 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:00.034 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465260+0000", 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2100000000000002e-06 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471028+0000", 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057687509999999999 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471069+0000", 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0955999999999999e-05 2024-05-09T09:55:00.035 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471095+0000", 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5375999999999999e-05 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471261+0000", 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165747 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471520+0000", 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025964199999999998 2024-05-09T09:55:00.036 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471893+0000", 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037329000000000003 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.484923+0000", 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013029618 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486774+0000", 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018512190000000001 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.037 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486872+0000", 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7934000000000001e-05 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486946+0000", 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3429000000000005e-05 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.038 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2105 3.10 3:0bd3bb69:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.9DoRBdszHtn66r2rQmpiH3p-scscd-l_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.3487360390000003, 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023605516999999999, 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2105 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.039 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601596+0000", 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9896000000000001e-05 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.040 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605653+0000", 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040566650000000001 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605687+0000", 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4421000000000001e-05 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605708+0000", 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0750999999999998e-05 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.041 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605899+0000", 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019071499999999999 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606144+0000", 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024554600000000002 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.042 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606373+0000", 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022909199999999999 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.616518+0000", 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010144497000000001 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625017+0000", 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084995699999999997 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.043 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625112+0000", 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4628000000000003e-05 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625182+0000", 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9735999999999998e-05 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.044 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2120 3.a 3:50dc6130:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.002855126, 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022303443999999999, 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2120 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.045 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947461+0000", 2024-05-09T09:55:00.046 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.924e-06 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951651+0000", 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004190208 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951695+0000", 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3782999999999997e-05 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951714+0000", 2024-05-09T09:55:00.047 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9279e-05 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951813+0000", 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8303999999999999e-05 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951972+0000", 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015941499999999999 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:00.048 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.952494+0000", 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052197500000000004 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.965422+0000", 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012927467 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969426+0000", 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004004479 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.049 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969628+0000", 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020216599999999999 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969761+0000", 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013244400000000001 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2157 3.3b 3:dd466707:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.kmq4W5FDvTJuiVHTRZOzwfAwhKijRHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:00.050 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.2915131679999998, 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069844506000000001, 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:00.051 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658802+0000", 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7810000000000001e-06 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662839+0000", 2024-05-09T09:55:00.052 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040367909999999996 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662873+0000", 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4075999999999997e-05 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662896+0000", 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2821000000000001e-05 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.053 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663002+0000", 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105882 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663159+0000", 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015773 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663293+0000", 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013406599999999999 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.054 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.670298+0000", 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007004845 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728516+0000", 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058218029999999997 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728590+0000", 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3422000000000003e-05 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.055 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728644+0000", 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4061999999999998e-05 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2172 3.26 3:64119a6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.72:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 7.9376053720000002, 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022271427, 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.056 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2172 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.057 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012709+0000", 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1339999999999998e-06 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016768+0000", 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004058412 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016801+0000", 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3831999999999997e-05 2024-05-09T09:55:00.058 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016817+0000", 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5843000000000001e-05 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016972+0000", 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015504399999999999 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.017233+0000", 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026038899999999998 2024-05-09T09:55:00.059 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.018157+0000", 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092440100000000004 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034009+0000", 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015851714999999999 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.060 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034761+0000", 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00075227699999999998 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034898+0000", 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136558 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034978+0000", 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0822000000000006e-05 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.061 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2337 3.36 3:6f80a6d6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.k49qI6xclWLMT4HOZ_xJfp3Cztqtf4E_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 4.3826321650000004, 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020721887000000001, 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2337 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.062 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567682+0000", 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.841e-06 2024-05-09T09:55:00.063 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572398+0000", 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047164319999999996 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572420+0000", 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1923999999999999e-05 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572431+0000", 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0481e-05 2024-05-09T09:55:00.064 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572558+0000", 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127625 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572712+0000", 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000153079 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572853+0000", 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000141524 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.065 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588287+0000", 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015433952000000001 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588315+0000", 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7804999999999999e-05 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588355+0000", 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0630000000000002e-05 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.066 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588402+0000", 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6594000000000001e-05 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.067 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:00.068 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:55:00.069 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:00.067+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:00.169 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:00.167+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:00.195 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:00.196 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:55:00.196 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:55:00.196 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:00.210 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:55:00.270 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:00.265+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:00.335 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:00.335 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:55:00.335 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:55:00.335 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:55:00.335 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:00.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:55:00.371 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:00.371+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:00.409 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:55:00.472 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:00.469+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:00.509 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.212260426, 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.510 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.511 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:55:00.512 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.513 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:55:00.514 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.515 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.212226273, 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.516 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.517 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.518 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.519 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.520 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.21210575000001, 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.521 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:00.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 119.212070224, 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1157 3.13 3:cb26828e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 34.045689430000003, 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021985248999999998, 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.532 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1157 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463102+0000", 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3630000000000001e-06 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470773+0000", 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076712769999999998 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470806+0000", 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2802999999999997e-05 2024-05-09T09:55:00.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470827+0000", 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1175999999999999e-05 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471017+0000", 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018967499999999999 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471279+0000", 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026242300000000002 2024-05-09T09:55:00.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471498+0000", 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021940300000000001 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.482134+0000", 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010635446999999999 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.484865+0000", 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027312460000000001 2024-05-09T09:55:00.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485006+0000", 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039099999999999 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485085+0000", 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9045e-05 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1178 3.37 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.791358256999999, 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030832948999999998, 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1178 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.538 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717434+0000", 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0060000000000001e-06 2024-05-09T09:55:00.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721611+0000", 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041770929999999998 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721645+0000", 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4561999999999999e-05 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721678+0000", 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2700000000000002e-05 2024-05-09T09:55:00.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721844+0000", 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165914 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722121+0000", 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027709300000000001 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722352+0000", 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023117600000000001 2024-05-09T09:55:00.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.733566+0000", 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011213989000000001 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748089+0000", 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014523036 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748187+0000", 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7974999999999996e-05 2024-05-09T09:55:00.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748263+0000", 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6404999999999998e-05 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1179 3.15 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.780678496999997, 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021009254000000002, 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.543 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1179 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728138+0000", 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7906e-05 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734782+0000", 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066435950000000004 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734827+0000", 2024-05-09T09:55:00.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5269000000000003e-05 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734858+0000", 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0654000000000002e-05 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735020+0000", 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016203699999999999 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735274+0000", 2024-05-09T09:55:00.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025399299999999999 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735518+0000", 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024406300000000001 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747370+0000", 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011852339 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748991+0000", 2024-05-09T09:55:00.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016208259999999999 2024-05-09T09:55:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749065+0000", 2024-05-09T09:55:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4018999999999997e-05 2024-05-09T09:55:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749120+0000", 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4552999999999998e-05 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1214 3.39 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.678361268000003, 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028754392, 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.549 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1214 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830433+0000", 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.237e-06 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838120+0000", 2024-05-09T09:55:00.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076874200000000004 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838164+0000", 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4002999999999999e-05 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838186+0000", 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.198e-05 2024-05-09T09:55:00.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838356+0000", 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169421 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838666+0000", 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031002599999999998 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838898+0000", 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023215000000000001 2024-05-09T09:55:00.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.849862+0000", 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010964649 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.858862+0000", 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089996999999999994 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859048+0000", 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186128 2024-05-09T09:55:00.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859182+0000", 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133678 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1216 3.e 3:734f2773:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.636635757999997, 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027271179999999999, 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.555 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1216 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872156+0000", 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.304e-06 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876935+0000", 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047782440000000001 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876974+0000", 2024-05-09T09:55:00.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9520000000000001e-05 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876999+0000", 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5286000000000002e-05 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877108+0000", 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109063 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.558 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877300+0000", 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019180299999999999 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877468+0000", 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759199999999999 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.886506+0000", 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379599999999994 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899047+0000", 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012540936000000001 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899286+0000", 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023885700000000001 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899424+0000", 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138615 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1217 3.11 3:8a7f3d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.623044464000003, 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021949672, 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1217 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.561 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885747+0000", 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0429999999999999e-06 2024-05-09T09:55:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893119+0000", 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073719229999999998 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893163+0000", 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3476000000000002e-05 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893188+0000", 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5443e-05 2024-05-09T09:55:00.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893364+0000", 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017547400000000001 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893619+0000", 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025488300000000002 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:00.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893842+0000", 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022347099999999999 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907393+0000", 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013550804 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907498+0000", 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010539099999999999 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907590+0000", 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1419e-05 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907694+0000", 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104345 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1223 3.15 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:00.566 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.505857069999998, 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021427795999999999, 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1223 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002934+0000", 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2050000000000001e-06 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007103+0000", 2024-05-09T09:55:00.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004168878 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007133+0000", 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0577999999999998e-05 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007145+0000", 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1844e-05 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007222+0000", 2024-05-09T09:55:00.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6569000000000005e-05 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007366+0000", 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144053 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007494+0000", 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012810799999999999 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.015333+0000", 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078388439999999993 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024121+0000", 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087886230000000006 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024253+0000", 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013161800000000001 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024360+0000", 2024-05-09T09:55:00.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106476 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1374 3.14 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 29.150236504999999, 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025594499999999999, 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1374 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358555+0000", 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0000000000000001e-06 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364047+0000", 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054919599999999997 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364082+0000", 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4903000000000001e-05 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364099+0000", 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7316000000000002e-05 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364233+0000", 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013302600000000001 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364481+0000", 2024-05-09T09:55:00.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024840499999999999 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364757+0000", 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027572700000000003 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.372096+0000", 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007339702 2024-05-09T09:55:00.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383918+0000", 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01182211 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384024+0000", 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105251 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384147+0000", 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012310000000000001 2024-05-09T09:55:00.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1726 3.3f 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.964134305000002, 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023921398, 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1726 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544657+0000", 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548394+0000", 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003737326 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548421+0000", 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6865000000000001e-05 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548434+0000", 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2605e-05 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548514+0000", 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0352000000000006e-05 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548671+0000", 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156231 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548814+0000", 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014296600000000001 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.559185+0000", 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010371949 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568269+0000", 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090838789999999996 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568449+0000", 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179407 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.583 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568576+0000", 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012715400000000001 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1885 3.11 3:89f00d0a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.28:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.539635605000001, 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022582944000000001, 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.584 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1885 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:00.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969162+0000", 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.268e-06 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973026+0000", 2024-05-09T09:55:00.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038637680000000001 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973055+0000", 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8858000000000001e-05 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973067+0000", 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2184999999999999e-05 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973141+0000", 2024-05-09T09:55:00.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3747999999999999e-05 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973302+0000", 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016143099999999999 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973741+0000", 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043816299999999999 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991002+0000", 2024-05-09T09:55:00.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017261155 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991603+0000", 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060141600000000002 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.589 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991671+0000", 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7433000000000003e-05 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991736+0000", 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5518999999999994e-05 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1931 3.f 3:f2a153e3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:00.590 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.515407163000001, 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021453967000000001, 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1931 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993383+0000", 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.127e-06 2024-05-09T09:55:00.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997421+0000", 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040380599999999996 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997440+0000", 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9477e-05 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997453+0000", 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2498e-05 2024-05-09T09:55:00.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997539+0000", 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6473999999999999e-05 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997702+0000", 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016321 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.998188+0000", 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048555899999999999 2024-05-09T09:55:00.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.006182+0000", 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079940800000000006 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014666+0000", 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084836749999999995 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014767+0000", 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010093499999999999 2024-05-09T09:55:00.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014836+0000", 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8872000000000001e-05 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2117 3.2d 3:b465dcda:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.GFV4vCspRy1zUXkFAuI6fs_j51KMCUd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.5885608330000007, 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021398311, 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.596 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2117 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.597 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920230+0000", 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.503e-06 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924562+0000", 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043315610000000003 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924591+0000", 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9077999999999998e-05 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924611+0000", 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0339999999999998e-05 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924703+0000", 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1440000000000005e-05 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924855+0000", 2024-05-09T09:55:00.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015229100000000001 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924978+0000", 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012243099999999999 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.931560+0000", 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065820380000000001 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941452+0000", 2024-05-09T09:55:00.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098919860000000002 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941554+0000", 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010251000000000001 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941626+0000", 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2132999999999995e-05 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2151 3.3f 3:fcdd6a3a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.e_T4R69E113FUtA8H-_HY1rmD7y3cXZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.0145596650000002, 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021326852, 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2151 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494232+0000", 2024-05-09T09:55:00.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9299999999999999e-06 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498235+0000", 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040031620000000002 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498266+0000", 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0391000000000001e-05 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498279+0000", 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3825000000000001e-05 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498387+0000", 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107236 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498604+0000", 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021725800000000001 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:00.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498826+0000", 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000221759 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.513219+0000", 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014393764 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515433+0000", 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022133209999999999 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515502+0000", 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9191999999999998e-05 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515556+0000", 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4014000000000002e-05 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2160 3.15 3:aacab97a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.70:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.7727127290000002, 2024-05-09T09:55:00.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023051668000000001, 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2160 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736079+0000", 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.163e-06 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740589+0000", 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045100990000000001 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740631+0000", 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1440000000000003e-05 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740655+0000", 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4413000000000002e-05 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740841+0000", 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018621299999999999 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.741107+0000", 2024-05-09T09:55:00.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026576600000000002 2024-05-09T09:55:00.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:00.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.741966+0000", 2024-05-09T09:55:00.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085910000000000001 2024-05-09T09:55:00.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.755114+0000", 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013147653 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.758937+0000", 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003822757 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.759053+0000", 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116078 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.759128+0000", 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4986000000000003e-05 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2298 3.11 3:8808c42e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.93:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.9250935990000002, 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021413894999999999, 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.615 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2298 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583697+0000", 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2639999999999998e-06 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.587989+0000", 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042911590000000001 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588022+0000", 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3686000000000002e-05 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588039+0000", 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6762999999999999e-05 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588181+0000", 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014182499999999999 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588455+0000", 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027390500000000001 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.589403+0000", 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00094826800000000005 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.604719+0000", 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015316065 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.619 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.604920+0000", 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020117099999999999 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.605052+0000", 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013208499999999999 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.605109+0000", 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6703999999999998e-05 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2313 3.13 3:ca22356b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.AtuHcbB9TtgV74F70V_2UZQQNVaym6E_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 5.559976088, 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023208837999999999, 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2313 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:00.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948816+0000", 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:55:00.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953841+0000", 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050255650000000001 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953882+0000", 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0176000000000003e-05 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953909+0000", 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7118999999999999e-05 2024-05-09T09:55:00.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954013+0000", 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010416600000000001 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954153+0000", 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039200000000001 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954272+0000", 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011833299999999999 2024-05-09T09:55:00.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.961157+0000", 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068856890000000004 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.971932+0000", 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010774522 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.971975+0000", 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3393000000000003e-05 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:00.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.972022+0000", 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6377e-05 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:00.626 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:00.628 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:00.625+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:00.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:55:00.729 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:00.725+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:00.757 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:55:00.757 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:00.770 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:55:00.830 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:00.831+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:00.896 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:00.896 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:00.897 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:55:00.897 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:55:00.897 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:00.911 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:55:00.954 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:55:00.955+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:55:01.032 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:01.029+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1174 3.3 3:c174dfac:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.410899825000001, 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016773575999999998, 2024-05-09T09:55:01.084 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1174 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672838+0000", 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6469999999999998e-06 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675089+0000", 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022509029999999998 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675122+0000", 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2679999999999999e-05 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675139+0000", 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6663999999999998e-05 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675224+0000", 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4950999999999994e-05 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675371+0000", 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014695800000000001 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675490+0000", 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119598 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.681815+0000", 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063248219999999999 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689490+0000", 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076750589999999997 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689558+0000", 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8034999999999995e-05 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689609+0000", 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1258999999999998e-05 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.089 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1214 3.39 e58/18 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head v 58'3, mlcod=57'1)", 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.244540078, 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019302639999999999, 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:01.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839197+0000", 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.074e-06 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845791+0000", 2024-05-09T09:55:01.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065941660000000003 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845848+0000", 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7389999999999998e-05 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845872+0000", 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3405999999999999e-05 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.846103+0000", 2024-05-09T09:55:01.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023154999999999999 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.846165+0000", 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1643000000000006e-05 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.858413+0000", 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012248235999999999 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.858498+0000", 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5174999999999997e-05 2024-05-09T09:55:01.093 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1218 3.1f 3:fb5d7f81:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.187454350000003, 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024564916999999999, 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.094 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1218 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896285+0000", 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.236e-06 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901084+0000", 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047989970000000002 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901133+0000", 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9616000000000001e-05 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901155+0000", 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1642999999999999e-05 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901259+0000", 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010411700000000001 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901462+0000", 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020326799999999999 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901640+0000", 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017785699999999999 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.907401+0000", 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057612549999999998 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920537+0000", 2024-05-09T09:55:01.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013136079 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920706+0000", 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016847800000000001 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920846+0000", 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140371 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1228 3.3d 3:bfece5e2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.986389052, 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017028782999999999, 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097350+0000", 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1329999999999999e-06 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101141+0000", 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037913640000000002 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101195+0000", 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3458999999999998e-05 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101214+0000", 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9593e-05 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101365+0000", 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015049099999999999 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101652+0000", 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028707 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101904+0000", 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025211999999999999 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.109872+0000", 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079686459999999994 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114206+0000", 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043330290000000004 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114298+0000", 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2619000000000002e-05 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114375+0000", 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7259e-05 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1355 3.3 3:c1d2f764:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.862239482, 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016507589999999999, 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.105 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1355 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:01.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221499+0000", 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3139999999999999e-06 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222734+0000", 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012346849999999999 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222768+0000", 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3729000000000002e-05 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222783+0000", 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5503999999999999e-05 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222879+0000", 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5171000000000001e-05 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.223093+0000", 2024-05-09T09:55:01.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021460500000000001 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.223263+0000", 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000169748 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.228460+0000", 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005197297 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.237927+0000", 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094671559999999991 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.237971+0000", 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3640000000000002e-05 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.238004+0000", 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2740999999999997e-05 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1393 3.10 e59/18 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head v 59'2, mlcod=0'0)", 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.156152548000001, 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015849678999999998, 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927598+0000", 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.491e-05 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932805+0000", 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052067770000000001 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932847+0000", 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1943000000000001e-05 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932881+0000", 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3787e-05 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.933020+0000", 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013958800000000001 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.933065+0000", 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5340000000000003e-05 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.943391+0000", 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010325235 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.943433+0000", 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2098999999999998e-05 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.114 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1407 3.17 3:e9776743:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 28.851941615000001, 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020564397000000002, 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1407 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231797+0000", 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8779999999999998e-06 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235222+0000", 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034247090000000002 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235265+0000", 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3575000000000002e-05 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235285+0000", 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0064e-05 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235421+0000", 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013553299999999999 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235731+0000", 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031049300000000001 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.236042+0000", 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031045999999999998 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.243329+0000", 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072875199999999996 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252033+0000", 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087035580000000001 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252224+0000", 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000191158 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252358+0000", 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134449 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.120 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1409 3.3d 3:bc138a7e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 28.805564005000001, 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016086515999999999, 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1409 2024-05-09T09:55:01.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278175+0000", 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2669999999999998e-06 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281654+0000", 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034793100000000002 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281709+0000", 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4812999999999998e-05 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281733+0000", 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3533e-05 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281947+0000", 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021395100000000001 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.282243+0000", 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029696699999999998 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.282564+0000", 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032077700000000001 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.290765+0000", 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0082010369999999996 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294086+0000", 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003321002 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294183+0000", 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6329000000000006e-05 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294258+0000", 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5530000000000004e-05 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1861 3.3 3:c3f5cf77:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:01.126 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.76312072, 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019402322, 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1861 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:01.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320617+0000", 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322500+0000", 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018829210000000001 2024-05-09T09:55:01.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322541+0000", 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0825999999999998e-05 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322559+0000", 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8236e-05 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322726+0000", 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016686899999999999 2024-05-09T09:55:01.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.323138+0000", 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041232200000000001 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.324376+0000", 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012381479999999999 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.338841+0000", 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014464785000000001 2024-05-09T09:55:01.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.339597+0000", 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075604299999999997 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.339813+0000", 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021524399999999999 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.340017+0000", 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000204718 2024-05-09T09:55:01.131 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1870 3.3d 3:beb3bbbd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.5SozmI9BQiP9i-OyMXnspWlmbImSGhb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.482505983999999, 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019492232000000002, 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.132 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1870 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601235+0000", 2024-05-09T09:55:01.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8770000000000001e-06 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605482+0000", 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042470579999999997 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605530+0000", 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8748999999999997e-05 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605554+0000", 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3283000000000001e-05 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605692+0000", 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013870399999999999 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605953+0000", 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026017899999999998 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:01.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.606181+0000", 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022812099999999999 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620300+0000", 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014119278000000001 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620507+0000", 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020707500000000001 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620604+0000", 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6637000000000003e-05 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620722+0000", 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011827100000000001 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1907 3.1f 3:faa4677d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.30:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.770189671000001, 2024-05-09T09:55:01.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020838817999999999, 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1907 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313549+0000", 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.79e-06 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316202+0000", 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026528200000000002 2024-05-09T09:55:01.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316249+0000", 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6962999999999997e-05 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316270+0000", 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1080000000000001e-05 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316444+0000", 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017407499999999999 2024-05-09T09:55:01.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316731+0000", 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028764699999999998 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.317692+0000", 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096093000000000003 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.331806+0000", 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014113888 2024-05-09T09:55:01.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334125+0000", 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023192199999999999 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334287+0000", 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016131899999999999 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334385+0000", 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8085999999999996e-05 2024-05-09T09:55:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1934 3.1 3:83810aba:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.bd0uPieH5yAMY0BuB5M_Z7ovAps42t5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.969855037, 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025148000000001, 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.143 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1934 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113884+0000", 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6090000000000001e-06 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115593+0000", 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017085030000000001 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115622+0000", 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9519999999999999e-05 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115640+0000", 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8125999999999999e-05 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115732+0000", 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1493e-05 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115930+0000", 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019849099999999999 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.116102+0000", 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206799999999999 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.124956+0000", 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088533650000000002 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139799+0000", 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014842912 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139861+0000", 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2207999999999998e-05 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139906+0000", 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4852999999999999e-05 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2057 3.3 3:c12b3099:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.JYYATTjyOHhgDIi3Y4dyj0yvpuhPS5R_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:01.148 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 11.448489806, 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021504227000000001, 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2057 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635256+0000", 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8169999999999994e-06 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637639+0000", 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023837350000000001 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637677+0000", 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.735e-05 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637692+0000", 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4969e-05 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637772+0000", 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9870999999999995e-05 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637904+0000", 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000132213 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.638011+0000", 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107524 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.645866+0000", 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078543350000000005 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656620+0000", 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010754289 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656695+0000", 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4902999999999998e-05 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656750+0000", 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5220999999999999e-05 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:2105 3.10 e66/18 3:0bd3bb69:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.9DoRBdszHtn66r2rQmpiH3p-scscd-l_1:head v 66'6, mlcod=65'4)", 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.476828975, 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017903960999999999, 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.154 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606909+0000", 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7860000000000001e-06 2024-05-09T09:55:01.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612512+0000", 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056024880000000001 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612541+0000", 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9422000000000001e-05 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612556+0000", 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5034e-05 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612675+0000", 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118428 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612714+0000", 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8818e-05 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.624726+0000", 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012012286 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.624811+0000", 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4698999999999997e-05 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2114 3.23 3:c524c8c3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.64:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.297682445, 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018633344, 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.158 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2114 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786055+0000", 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.629e-06 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788491+0000", 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024358190000000001 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788520+0000", 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.957e-05 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788532+0000", 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2119999999999999e-05 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788677+0000", 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144957 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788970+0000", 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029236699999999997 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.789866+0000", 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089592800000000005 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804391+0000", 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01452524 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804518+0000", 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012702699999999999 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804620+0000", 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010241100000000001 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804687+0000", 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6276e-05 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:2160 3.15 e67/62 3:aacab97a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.70:head v 67'6, mlcod=64'4)", 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.3412540629999992, 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016279577, 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742484+0000", 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0930000000000001e-06 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747389+0000", 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049051049999999999 2024-05-09T09:55:01.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747429+0000", 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0286e-05 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747477+0000", 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.829e-05 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747633+0000", 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015591100000000001 2024-05-09T09:55:01.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747676+0000", 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2330000000000003e-05 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.758581+0000", 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010905791 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.758761+0000", 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017977100000000001 2024-05-09T09:55:01.167 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2289 3.1f 3:f801594a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.2_o93ud7d60mlbWOIdPIOhVlkm1vVVF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.627415493, 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020838377000000002, 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.168 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2289 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456328+0000", 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7800000000000001e-06 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457637+0000", 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013087420000000001 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457663+0000", 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6026000000000001e-05 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457674+0000", 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1206000000000001e-05 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457748+0000", 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4482999999999998e-05 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457870+0000", 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121552 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457973+0000", 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102973 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.462180+0000", 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004207527 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477025+0000", 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014844540999999999 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477099+0000", 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3545000000000001e-05 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477159+0000", 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0001999999999999e-05 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2295 3.12 3:4934888e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.3CtOBEEDgwQbb-KODTbQbrgDi18Uqdl_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:01.173 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.52475717, 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021320862999999999, 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2295 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:01.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558981+0000", 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2819999999999999e-06 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560672+0000", 2024-05-09T09:55:01.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001691524 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560696+0000", 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4159999999999999e-05 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560706+0000", 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9019999999999994e-06 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560774+0000", 2024-05-09T09:55:01.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7714999999999998e-05 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560897+0000", 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012249200000000001 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.561003+0000", 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106869 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.565380+0000", 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004376685 2024-05-09T09:55:01.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580177+0000", 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014797181 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580246+0000", 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8530999999999998e-05 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580299+0000", 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3522e-05 2024-05-09T09:55:01.178 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2304 3.1b 3:d87fe2be:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.94:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 6.38381357, 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017499124000000001, 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.179 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2304 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699924+0000", 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7829999999999999e-06 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703863+0000", 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039386309999999997 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703901+0000", 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8488999999999997e-05 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703919+0000", 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7706999999999998e-05 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704051+0000", 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013233099999999999 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704199+0000", 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014797899999999999 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704577+0000", 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037753999999999999 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.711921+0000", 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073440729999999996 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717344+0000", 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054230140000000003 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717389+0000", 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5117999999999997e-05 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717421+0000", 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2459000000000002e-05 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2331 3.6 3:63b64f75:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.-FNYp6iQCDWTpLwCXUKfus22HOFp4mR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:01.184 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.6724000859999997, 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019086397000000001, 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2331 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:01.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411340+0000", 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9280000000000003e-06 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413842+0000", 2024-05-09T09:55:01.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025022220000000001 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413882+0000", 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9966000000000003e-05 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413899+0000", 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7666e-05 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414192+0000", 2024-05-09T09:55:01.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029248700000000002 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414435+0000", 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414664+0000", 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022880399999999999 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.425867+0000", 2024-05-09T09:55:01.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011202833000000001 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430324+0000", 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044573770000000002 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430380+0000", 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5652000000000002e-05 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430422+0000", 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2001e-05 2024-05-09T09:55:01.189 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.190 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.190 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.190 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:01.190 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:01.190 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:01.191 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:55:01.192 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:01.191+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:01.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:55:01.292 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:01.293+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:01.360 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:01.360 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:01.360 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:55:01.360 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:01.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:55:01.379 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:55:01.379 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:55:01.393 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:01.391+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:01.399 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:55:01.399 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:55:01.419 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:55:01.419 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:55:01.436 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:55:01.436 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:55:01.457 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:55:01.457 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:55:01.478 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:55:01.479 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:55:01.493 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:01.494 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:01.494 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:01.489+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:01.499 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:55:01.499 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:55:01.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:55:01.519 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:55:01.520 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:55:01.594 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:01.589+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:01.644 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:01.644 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:01.657 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:55:01.706 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:01.707+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:01.771 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:01.771 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:01.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:55:01.796 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:01.793+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:01.897 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:01.893+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:01.936 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:01.936 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:01.951 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:55:01.998 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:55:01.999+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:55:02.082 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:02.082 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:02.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:55:02.142 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:02.143+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:02.200 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:02.197+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:02.263 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:02.263 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:02.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:55:02.301 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:02.297+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:02.395 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:02.395 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:02.402 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:02.397+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:02.411 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:55:02.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-09T09:55:02.503 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:02.503+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:02.543 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:02.543 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:02.557 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:55:02.604 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:02.601+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:02.693 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:02.693 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:02.704 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:02.701+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:02.707 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:55:02.805 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:02.801+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:02.879 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:02.879 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:02.893 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:55:02.935 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:02.933+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:03.007 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:03.005+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:03.060 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:03.060 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:03.079 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:55:03.108 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:03.107+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:03.209 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:03.205+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:03.240 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:03.240 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:03.254 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:55:03.339 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:03.337+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:03.410 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:03.411+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:03.416 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:03.416 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:03.425 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-05-09T09:55:03.431 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:55:03.511 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:03.511+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:03.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:55:03.602 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:03.603 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:03.612 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:03.609+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:03.617 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:55:03.690 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:55:03.694 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:55:03.709 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:55:03.709 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:55:03.712 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:55:03.711+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:55:03.725 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:55:03.726 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:55:03.742 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:55:03.742 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:55:03.762 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:55:03.762 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:55:03.783 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:55:03.783 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:55:03.790 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:03.791 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:03.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:55:03.803 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:55:03.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:55:03.820 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:55:03.820 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:55:03.850 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:03.849+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:03.914 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:03.915+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:03.931 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:03.931 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:55:03.932 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:55:03.932 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:55:03.932 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:03.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:55:04.035 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:04.033+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:04.116 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:04.113+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:04.119 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:04.119 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 108.971146424, 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.120 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.121 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.122 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:55:04.123 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:55:04.124 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:55:04.125 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:55:04.126 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1158 3.2c 3:367a58d5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.638080481999999, 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021363626, 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.127 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1158 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.128 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481220+0000", 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486955+0000", 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057345460000000001 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486994+0000", 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8982e-05 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.129 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487016+0000", 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2103000000000002e-05 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487145+0000", 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012962499999999999 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487392+0000", 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024650300000000002 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.130 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487614+0000", 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022186999999999999 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.500091+0000", 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012477054 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502399+0000", 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023086449999999998 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.131 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502492+0000", 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2662000000000002e-05 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502581+0000", 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1167 3.26 3:65d9db40:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:04.132 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.523425836000001, 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021114266, 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1167 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:55:04.133 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595875+0000", 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1499999999999999e-06 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.134 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599908+0000", 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040330510000000002 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599945+0000", 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7366000000000001e-05 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599964+0000", 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199e-05 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600143+0000", 2024-05-09T09:55:04.135 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017947500000000001 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600531+0000", 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000387914 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600968+0000", 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043724399999999999 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.615593+0000", 2024-05-09T09:55:04.136 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014624727000000001 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616799+0000", 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012065159999999999 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616910+0000", 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110555 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616986+0000", 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6069000000000006e-05 2024-05-09T09:55:04.137 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1208 3.a 3:5055ce64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.653847491000001, 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018795551000000001, 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.138 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1208 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.139 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465453+0000", 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8609999999999998e-06 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469227+0000", 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003774281 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469250+0000", 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3156e-05 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.140 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469262+0000", 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1531e-05 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469334+0000", 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2290000000000001e-05 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469342+0000", 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1659999999999994e-06 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.141 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473383+0000", 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040406940000000001 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473477+0000", 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3929000000000001e-05 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473588+0000", 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110938 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.479810+0000", 2024-05-09T09:55:04.142 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062221070000000002 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484173+0000", 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436265 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484212+0000", 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9322000000000001e-05 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484246+0000", 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3626e-05 2024-05-09T09:55:04.143 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1229 3.2c 3:34904b64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.003761889000003, 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020735874000000001, 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.144 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1229 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.145 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115539+0000", 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6200000000000001e-06 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119644+0000", 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041042090000000002 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119669+0000", 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5754000000000001e-05 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.146 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119684+0000", 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4209000000000001e-05 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119768+0000", 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4524999999999995e-05 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119922+0000", 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015423600000000001 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.147 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.120056+0000", 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013380999999999999 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.129703+0000", 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009646422 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136158+0000", 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064555810000000002 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.148 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136223+0000", 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4523999999999994e-05 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136272+0000", 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8983999999999997e-05 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1356 3.35 3:af70797a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:55:04.149 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.886787374000001, 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018963760999999999, 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1356 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.150 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232514+0000", 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.237973+0000", 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054590610000000003 2024-05-09T09:55:04.151 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238009+0000", 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188999999999998e-05 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238033+0000", 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4769999999999998e-05 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238179+0000", 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014558299999999999 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.152 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238427+0000", 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000247827 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238654+0000", 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022734200000000001 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.247463+0000", 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008808471 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.153 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251130+0000", 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036668830000000001 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251327+0000", 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000197441 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251474+0000", 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147047 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.154 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1393 3.10 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 32.196147920000001, 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02062228, 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1393 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.155 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923152+0000", 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0190000000000001e-06 2024-05-09T09:55:04.156 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926928+0000", 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037758520000000001 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926954+0000", 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6152e-05 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926967+0000", 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2925000000000001e-05 2024-05-09T09:55:04.157 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927050+0000", 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3015000000000004e-05 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927188+0000", 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013808000000000001 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927320+0000", 2024-05-09T09:55:04.158 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132311 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.936936+0000", 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096158560000000008 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943673+0000", 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067373729999999996 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943728+0000", 2024-05-09T09:55:04.159 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5053000000000003e-05 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943772+0000", 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643999999999998e-05 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1656 3.35 3:ad423f51:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.386134575, 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021084454999999998, 2024-05-09T09:55:04.160 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1656 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.161 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733164+0000", 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2300000000000001e-06 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733175+0000", 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0526999999999999e-05 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733201+0000", 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5952000000000002e-05 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733210+0000", 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5629999999999998e-06 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744680+0000", 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011469795 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.163 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744936+0000", 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255691 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.754248+0000", 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093116970000000007 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.164 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1726 3.3f e63/18 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head v 63'7, mlcod=59'5)", 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.570306759000001, 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018934763, 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548993+0000", 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8139999999999999e-06 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551287+0000", 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022947499999999999 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551311+0000", 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3252999999999999e-05 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551323+0000", 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1926999999999999e-05 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551470+0000", 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014753100000000001 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551538+0000", 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7618000000000002e-05 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567876+0000", 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016337872 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567926+0000", 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9997999999999998e-05 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1876 3.a 3:52ea8d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.QD71QSIjnzYUJvkbUpu9yZ6kMZGI2uX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.350328462, 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024394813000000001, 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1876 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.169 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768972+0000", 2024-05-09T09:55:04.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.616e-06 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773360+0000", 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043882620000000004 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773389+0000", 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8731999999999999e-05 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773401+0000", 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2094e-05 2024-05-09T09:55:04.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773506+0000", 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105173 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773713+0000", 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020665399999999999 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773888+0000", 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017540899999999999 2024-05-09T09:55:04.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.785628+0000", 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011740301999999999 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793268+0000", 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076399040000000003 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793319+0000", 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0841999999999999e-05 2024-05-09T09:55:04.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793364+0000", 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4824999999999999e-05 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1888 3.26 3:66cc2661:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.RVUWhTPr75VRTCdvqYW6zhcKOb-0e_t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.004698072, 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021044698000000001, 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1888 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114602+0000", 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118409+0000", 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038070840000000001 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118430+0000", 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1407e-05 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118441+0000", 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0438999999999999e-05 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118594+0000", 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015285299999999999 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118989+0000", 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039577600000000003 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.119396+0000", 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040618000000000002 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.132480+0000", 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013084760000000001 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135459+0000", 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029782390000000001 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135557+0000", 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8554999999999994e-05 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135644+0000", 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7145999999999995e-05 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1916 3.36 3:6eedf4b4:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.VPNU2_fk3V70lu7RybtX1vlXVee9jX__1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.498206666000002, 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024095032999999998, 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1916 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.180 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621094+0000", 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.36e-06 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626192+0000", 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050974690000000003 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626234+0000", 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2406e-05 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626253+0000", 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8776000000000001e-05 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626355+0000", 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101538 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626533+0000", 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017836699999999999 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626684+0000", 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151414 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.636642+0000", 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099573470000000001 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.644981+0000", 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083395520000000001 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645074+0000", 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3295999999999996e-05 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645186+0000", 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111508 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2075 3.a 3:53469b12:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.6RHkQ-W_EKbk_OF2lFq2sr_HPaXtnXH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.141569794, 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020026097999999999, 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.185 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2075 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:04.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977731+0000", 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4300000000000002e-06 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981866+0000", 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041346309999999997 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981892+0000", 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6545000000000001e-05 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981907+0000", 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4489e-05 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982017+0000", 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109706 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982270+0000", 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025379899999999997 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982518+0000", 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024785900000000001 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.996151+0000", 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013632513000000001 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997589+0000", 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014381960000000001 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997687+0000", 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7575e-05 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997754+0000", 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7354999999999995e-05 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2081 3.36 3:6cf6c747:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.n_zpFFFU2OZoJK0JchjxtEuV5CgxBIK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.988960361, 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019931259999999999, 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2081 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.191 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130340+0000", 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8399999999999999e-06 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134268+0000", 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039274799999999997 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134304+0000", 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5929000000000001e-05 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134322+0000", 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8260000000000001e-05 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134453+0000", 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013139799999999999 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134700+0000", 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000246815 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134954+0000", 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025361900000000001 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.144764+0000", 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098099399999999996 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150087+0000", 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053232160000000004 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150179+0000", 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2244000000000007e-05 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150269+0000", 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9518999999999995e-05 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2099 3.1e 3:789e79c5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.gqxJ-lp-L0uUFrshZonEkrXrhQkW2Gi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.654041148999999, 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021689172, 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.196 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2099 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465260+0000", 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2100000000000002e-06 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471028+0000", 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057687509999999999 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471069+0000", 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0955999999999999e-05 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471095+0000", 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5375999999999999e-05 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471261+0000", 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165747 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471520+0000", 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025964199999999998 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471893+0000", 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037329000000000003 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.484923+0000", 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013029618 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486774+0000", 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018512190000000001 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486872+0000", 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7934000000000001e-05 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486946+0000", 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3429000000000005e-05 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2105 3.10 3:0bd3bb69:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.9DoRBdszHtn66r2rQmpiH3p-scscd-l_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:04.201 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.517721299, 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023605516999999999, 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2105 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:04.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601596+0000", 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9896000000000001e-05 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605653+0000", 2024-05-09T09:55:04.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040566650000000001 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605687+0000", 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4421000000000001e-05 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605708+0000", 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0750999999999998e-05 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605899+0000", 2024-05-09T09:55:04.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019071499999999999 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606144+0000", 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024554600000000002 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606373+0000", 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022909199999999999 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.616518+0000", 2024-05-09T09:55:04.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010144497000000001 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625017+0000", 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084995699999999997 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625112+0000", 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4628000000000003e-05 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625182+0000", 2024-05-09T09:55:04.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9735999999999998e-05 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2120 3.a 3:50dc6130:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.171840386, 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022303443999999999, 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.207 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2120 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.208 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947461+0000", 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.924e-06 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951651+0000", 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004190208 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951695+0000", 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3782999999999997e-05 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.209 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951714+0000", 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9279e-05 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951813+0000", 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8303999999999999e-05 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951972+0000", 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015941499999999999 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.952494+0000", 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052197500000000004 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.965422+0000", 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012927467 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969426+0000", 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004004479 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969628+0000", 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020216599999999999 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969761+0000", 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013244400000000001 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2157 3.3b 3:dd466707:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.kmq4W5FDvTJuiVHTRZOzwfAwhKijRHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:04.212 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.460498427999999, 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069844506000000001, 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658802+0000", 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7810000000000001e-06 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662839+0000", 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040367909999999996 2024-05-09T09:55:04.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662873+0000", 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4075999999999997e-05 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662896+0000", 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2821000000000001e-05 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663002+0000", 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105882 2024-05-09T09:55:04.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663159+0000", 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015773 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663293+0000", 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013406599999999999 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.670298+0000", 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007004845 2024-05-09T09:55:04.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728516+0000", 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058218029999999997 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728590+0000", 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3422000000000003e-05 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728644+0000", 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4061999999999998e-05 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.217 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2172 3.26 3:64119a6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.72:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.106590632, 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022271427, 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.218 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2172 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012709+0000", 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1339999999999998e-06 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016768+0000", 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004058412 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016801+0000", 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3831999999999997e-05 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016817+0000", 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5843000000000001e-05 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016972+0000", 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015504399999999999 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.017233+0000", 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026038899999999998 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:04.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.018157+0000", 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092440100000000004 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034009+0000", 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015851714999999999 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034761+0000", 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00075227699999999998 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034898+0000", 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136558 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034978+0000", 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0822000000000006e-05 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2337 3.36 3:6f80a6d6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.k49qI6xclWLMT4HOZ_xJfp3Cztqtf4E_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 8.5516174249999999, 2024-05-09T09:55:04.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020721887000000001, 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2337 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567682+0000", 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.841e-06 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572398+0000", 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047164319999999996 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572420+0000", 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1923999999999999e-05 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572431+0000", 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0481e-05 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572558+0000", 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127625 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572712+0000", 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000153079 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572853+0000", 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000141524 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588287+0000", 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015433952000000001 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588315+0000", 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7804999999999999e-05 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588355+0000", 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0630000000000002e-05 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588402+0000", 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6594000000000001e-05 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.228 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.229 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.229 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.229 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:04.230 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:55:04.231 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:04.225+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:04.331 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:04.329+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:04.408 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:04.408 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:55:04.408 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:55:04.408 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:04.423 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:55:04.432 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:04.431+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:04.533 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:04.529+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:04.593 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:04.594 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:55:04.594 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:55:04.594 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:55:04.594 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:04.608 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:55:04.634 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:04.635+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:04.735 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:04.735+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:04.783 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:04.783 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:55:04.783 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:55:04.783 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 123.48208086299999, 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.784 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:55:04.785 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:55:04.786 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:55:04.787 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:55:04.788 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 123.48204671000001, 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.789 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.790 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.791 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.792 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.793 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.794 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 123.481926187, 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:04.795 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.796 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.797 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.798 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.799 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:04.800 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 123.48189066099999, 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:04.801 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.802 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.803 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.804 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.805 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1157 3.13 3:cb26828e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.315509867000003, 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021985248999999998, 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.806 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1157 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.807 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463102+0000", 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3630000000000001e-06 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470773+0000", 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076712769999999998 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470806+0000", 2024-05-09T09:55:04.808 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2802999999999997e-05 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470827+0000", 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1175999999999999e-05 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471017+0000", 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018967499999999999 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.809 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471279+0000", 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026242300000000002 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471498+0000", 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021940300000000001 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.482134+0000", 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010635446999999999 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.810 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.484865+0000", 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027312460000000001 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485006+0000", 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039099999999999 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485085+0000", 2024-05-09T09:55:04.811 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9045e-05 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1178 3.37 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.061178693999999, 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030832948999999998, 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.812 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1178 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.813 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717434+0000", 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0060000000000001e-06 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721611+0000", 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041770929999999998 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721645+0000", 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4561999999999999e-05 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.814 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721678+0000", 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2700000000000002e-05 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721844+0000", 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165914 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722121+0000", 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027709300000000001 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.815 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722352+0000", 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023117600000000001 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.733566+0000", 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011213989000000001 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748089+0000", 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014523036 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.816 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748187+0000", 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7974999999999996e-05 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748263+0000", 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6404999999999998e-05 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1179 3.15 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:04.817 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 38.050498933999997, 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021009254000000002, 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1179 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:04.818 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728138+0000", 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7906e-05 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734782+0000", 2024-05-09T09:55:04.819 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066435950000000004 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734827+0000", 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5269000000000003e-05 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734858+0000", 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0654000000000002e-05 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735020+0000", 2024-05-09T09:55:04.820 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016203699999999999 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735274+0000", 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025399299999999999 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735518+0000", 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024406300000000001 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747370+0000", 2024-05-09T09:55:04.821 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011852339 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748991+0000", 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016208259999999999 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749065+0000", 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4018999999999997e-05 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.822 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749120+0000", 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4552999999999998e-05 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1214 3.39 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.948181705000003, 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028754392, 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.823 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1214 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.824 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830433+0000", 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.237e-06 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838120+0000", 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076874200000000004 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.825 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838164+0000", 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4002999999999999e-05 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838186+0000", 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.198e-05 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838356+0000", 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169421 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.826 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838666+0000", 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031002599999999998 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838898+0000", 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023215000000000001 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.849862+0000", 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010964649 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.827 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.858862+0000", 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089996999999999994 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859048+0000", 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186128 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859182+0000", 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133678 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.828 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1216 3.e 3:734f2773:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.906456194999997, 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027271179999999999, 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1216 2024-05-09T09:55:04.829 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872156+0000", 2024-05-09T09:55:04.830 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.304e-06 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876935+0000", 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047782440000000001 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876974+0000", 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9520000000000001e-05 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876999+0000", 2024-05-09T09:55:04.831 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5286000000000002e-05 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877108+0000", 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109063 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877300+0000", 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019180299999999999 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877468+0000", 2024-05-09T09:55:04.832 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759199999999999 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.886506+0000", 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379599999999994 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899047+0000", 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012540936000000001 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899286+0000", 2024-05-09T09:55:04.833 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023885700000000001 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899424+0000", 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138615 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1217 3.11 3:8a7f3d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:04.834 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.892864901000003, 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021949672, 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1217 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:04.835 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885747+0000", 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0429999999999999e-06 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893119+0000", 2024-05-09T09:55:04.836 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073719229999999998 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893163+0000", 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3476000000000002e-05 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893188+0000", 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5443e-05 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893364+0000", 2024-05-09T09:55:04.837 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017547400000000001 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893619+0000", 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025488300000000002 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893842+0000", 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022347099999999999 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.838 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907393+0000", 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013550804 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907498+0000", 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010539099999999999 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907590+0000", 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1419e-05 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.839 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907694+0000", 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104345 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1223 3.15 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.775677506999997, 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021427795999999999, 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.840 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1223 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.841 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002934+0000", 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2050000000000001e-06 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007103+0000", 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004168878 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007133+0000", 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0577999999999998e-05 2024-05-09T09:55:04.842 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007145+0000", 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1844e-05 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007222+0000", 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6569000000000005e-05 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007366+0000", 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144053 2024-05-09T09:55:04.843 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007494+0000", 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012810799999999999 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.015333+0000", 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078388439999999993 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024121+0000", 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087886230000000006 2024-05-09T09:55:04.844 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024253+0000", 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013161800000000001 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024360+0000", 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106476 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1374 3.14 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:04.845 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 33.420056942000002, 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025594499999999999, 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1374 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.846 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358555+0000", 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0000000000000001e-06 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.847 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364047+0000", 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054919599999999997 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364082+0000", 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4903000000000001e-05 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364099+0000", 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7316000000000002e-05 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.848 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364233+0000", 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013302600000000001 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364481+0000", 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024840499999999999 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364757+0000", 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027572700000000003 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.849 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.372096+0000", 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007339702 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383918+0000", 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01182211 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384024+0000", 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105251 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.850 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384147+0000", 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012310000000000001 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1726 3.3f 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.233954742000002, 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023921398, 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.851 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1726 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.852 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544657+0000", 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548394+0000", 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003737326 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548421+0000", 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6865000000000001e-05 2024-05-09T09:55:04.853 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548434+0000", 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2605e-05 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548514+0000", 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0352000000000006e-05 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548671+0000", 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156231 2024-05-09T09:55:04.854 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548814+0000", 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014296600000000001 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.559185+0000", 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010371949 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568269+0000", 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090838789999999996 2024-05-09T09:55:04.855 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568449+0000", 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179407 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568576+0000", 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012715400000000001 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.856 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1885 3.11 3:89f00d0a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.28:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.809456042000001, 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022582944000000001, 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1885 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.857 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969162+0000", 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.268e-06 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.858 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973026+0000", 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038637680000000001 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973055+0000", 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8858000000000001e-05 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973067+0000", 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2184999999999999e-05 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.859 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973141+0000", 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3747999999999999e-05 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973302+0000", 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016143099999999999 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973741+0000", 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043816299999999999 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.860 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991002+0000", 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017261155 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991603+0000", 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060141600000000002 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991671+0000", 2024-05-09T09:55:04.861 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7433000000000003e-05 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991736+0000", 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5518999999999994e-05 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1931 3.f 3:f2a153e3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:04.862 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.785227599999999, 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021453967000000001, 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1931 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:04.863 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993383+0000", 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.127e-06 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.864 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997421+0000", 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040380599999999996 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997440+0000", 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9477e-05 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997453+0000", 2024-05-09T09:55:04.865 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2498e-05 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997539+0000", 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6473999999999999e-05 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997702+0000", 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016321 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.866 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.998188+0000", 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048555899999999999 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.006182+0000", 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079940800000000006 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014666+0000", 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084836749999999995 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.867 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014767+0000", 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010093499999999999 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014836+0000", 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8872000000000001e-05 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2117 3.2d 3:b465dcda:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.GFV4vCspRy1zUXkFAuI6fs_j51KMCUd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:04.868 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.858381270000001, 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021398311, 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2117 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.869 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920230+0000", 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.503e-06 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924562+0000", 2024-05-09T09:55:04.870 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043315610000000003 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924591+0000", 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9077999999999998e-05 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924611+0000", 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0339999999999998e-05 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924703+0000", 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1440000000000005e-05 2024-05-09T09:55:04.871 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924855+0000", 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015229100000000001 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924978+0000", 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012243099999999999 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.931560+0000", 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065820380000000001 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.872 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941452+0000", 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098919860000000002 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941554+0000", 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010251000000000001 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941626+0000", 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2132999999999995e-05 2024-05-09T09:55:04.873 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2151 3.3f 3:fcdd6a3a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.e_T4R69E113FUtA8H-_HY1rmD7y3cXZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.284380102, 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021326852, 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.874 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2151 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.875 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494232+0000", 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9299999999999999e-06 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498235+0000", 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040031620000000002 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498266+0000", 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0391000000000001e-05 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.876 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498279+0000", 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3825000000000001e-05 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498387+0000", 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107236 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498604+0000", 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021725800000000001 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.877 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498826+0000", 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000221759 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.513219+0000", 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014393764 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515433+0000", 2024-05-09T09:55:04.878 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022133209999999999 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515502+0000", 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9191999999999998e-05 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515556+0000", 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4014000000000002e-05 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.879 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2160 3.15 3:aacab97a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.70:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 13.042533166, 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023051668000000001, 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2160 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.880 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736079+0000", 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.163e-06 2024-05-09T09:55:04.881 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740589+0000", 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045100990000000001 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740631+0000", 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1440000000000003e-05 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740655+0000", 2024-05-09T09:55:04.882 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4413000000000002e-05 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740841+0000", 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018621299999999999 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.741107+0000", 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026576600000000002 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.741966+0000", 2024-05-09T09:55:04.883 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085910000000000001 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.755114+0000", 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013147653 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.758937+0000", 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003822757 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.759053+0000", 2024-05-09T09:55:04.884 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116078 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.759128+0000", 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4986000000000003e-05 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2298 3.11 3:8808c42e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.93:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 10.194914036, 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021413894999999999, 2024-05-09T09:55:04.885 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2298 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.886 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583697+0000", 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2639999999999998e-06 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.587989+0000", 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042911590000000001 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.887 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588022+0000", 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3686000000000002e-05 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588039+0000", 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6762999999999999e-05 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588181+0000", 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014182499999999999 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.888 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588455+0000", 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027390500000000001 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.589403+0000", 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00094826800000000005 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.604719+0000", 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015316065 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.889 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.604920+0000", 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020117099999999999 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.605052+0000", 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013208499999999999 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.605109+0000", 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6703999999999998e-05 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.890 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2313 3.13 3:ca22356b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.AtuHcbB9TtgV74F70V_2UZQQNVaym6E_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 9.8297965250000008, 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023208837999999999, 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2313 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.891 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948816+0000", 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:55:04.892 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953841+0000", 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050255650000000001 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953882+0000", 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0176000000000003e-05 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953909+0000", 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7118999999999999e-05 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.893 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954013+0000", 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010416600000000001 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954153+0000", 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039200000000001 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954272+0000", 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011833299999999999 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.894 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.961157+0000", 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068856890000000004 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.971932+0000", 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010774522 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.971975+0000", 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3393000000000003e-05 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:04.895 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.972022+0000", 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6377e-05 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:04.896 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:04.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:55:04.898 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:04.899+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:04.998 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:04.999+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:05.029 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:05.029 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:05.029 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:55:05.029 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:05.042 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:55:05.131 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:05.131+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:05.200 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:05.199+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:05.201 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:05.201 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:05.202 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:55:05.202 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:55:05.202 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:05.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:55:05.302 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:05.303+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:05.389 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:05.389 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:55:05.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:55:05.389 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1174 3.3 3:c174dfac:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.714337743999998, 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016773575999999998, 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.390 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.391 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.391 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.391 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1174 2024-05-09T09:55:05.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.391 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672838+0000", 2024-05-09T09:55:05.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6469999999999998e-06 2024-05-09T09:55:05.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675089+0000", 2024-05-09T09:55:05.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022509029999999998 2024-05-09T09:55:05.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675122+0000", 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2679999999999999e-05 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675139+0000", 2024-05-09T09:55:05.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6663999999999998e-05 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675224+0000", 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4950999999999994e-05 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675371+0000", 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014695800000000001 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675490+0000", 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119598 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.681815+0000", 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063248219999999999 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689490+0000", 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076750589999999997 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689558+0000", 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8034999999999995e-05 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689609+0000", 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1258999999999998e-05 2024-05-09T09:55:05.397 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1214 3.39 e58/18 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head v 58'3, mlcod=57'1)", 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.547977996999997, 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019302639999999999, 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839197+0000", 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.074e-06 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845791+0000", 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065941660000000003 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845848+0000", 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7389999999999998e-05 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845872+0000", 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3405999999999999e-05 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.846103+0000", 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023154999999999999 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.846165+0000", 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1643000000000006e-05 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.858413+0000", 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012248235999999999 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.858498+0000", 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5174999999999997e-05 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1218 3.1f 3:fb5d7f81:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.490892269, 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024564916999999999, 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1218 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896285+0000", 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.236e-06 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901084+0000", 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047989970000000002 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901133+0000", 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9616000000000001e-05 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901155+0000", 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1642999999999999e-05 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901259+0000", 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010411700000000001 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901462+0000", 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020326799999999999 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901640+0000", 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017785699999999999 2024-05-09T09:55:05.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.907401+0000", 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057612549999999998 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920537+0000", 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013136079 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920706+0000", 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016847800000000001 2024-05-09T09:55:05.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920846+0000", 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140371 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1228 3.3d 3:bfece5e2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.289826970999997, 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017028782999999999, 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.408 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097350+0000", 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1329999999999999e-06 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101141+0000", 2024-05-09T09:55:05.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037913640000000002 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101195+0000", 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3458999999999998e-05 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101214+0000", 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9593e-05 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101365+0000", 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015049099999999999 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101652+0000", 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028707 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101904+0000", 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025211999999999999 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.109872+0000", 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079686459999999994 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114206+0000", 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043330290000000004 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114298+0000", 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2619000000000002e-05 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114375+0000", 2024-05-09T09:55:05.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7259e-05 2024-05-09T09:55:05.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.414 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.414 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1355 3.3 3:c1d2f764:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:05.414 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.165677401000003, 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016507589999999999, 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1355 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221499+0000", 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3139999999999999e-06 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222734+0000", 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012346849999999999 2024-05-09T09:55:05.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222768+0000", 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3729000000000002e-05 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222783+0000", 2024-05-09T09:55:05.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5503999999999999e-05 2024-05-09T09:55:05.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222879+0000", 2024-05-09T09:55:05.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5171000000000001e-05 2024-05-09T09:55:05.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.223093+0000", 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021460500000000001 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.223263+0000", 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000169748 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.228460+0000", 2024-05-09T09:55:05.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005197297 2024-05-09T09:55:05.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.237927+0000", 2024-05-09T09:55:05.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094671559999999991 2024-05-09T09:55:05.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.237971+0000", 2024-05-09T09:55:05.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3640000000000002e-05 2024-05-09T09:55:05.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.238004+0000", 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2740999999999997e-05 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1393 3.10 e59/18 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head v 59'2, mlcod=0'0)", 2024-05-09T09:55:05.423 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.459590466999998, 2024-05-09T09:55:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015849678999999998, 2024-05-09T09:55:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927598+0000", 2024-05-09T09:55:05.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.491e-05 2024-05-09T09:55:05.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932805+0000", 2024-05-09T09:55:05.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052067770000000001 2024-05-09T09:55:05.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932847+0000", 2024-05-09T09:55:05.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1943000000000001e-05 2024-05-09T09:55:05.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932881+0000", 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3787e-05 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.933020+0000", 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013958800000000001 2024-05-09T09:55:05.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.933065+0000", 2024-05-09T09:55:05.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5340000000000003e-05 2024-05-09T09:55:05.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.943391+0000", 2024-05-09T09:55:05.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010325235 2024-05-09T09:55:05.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.943433+0000", 2024-05-09T09:55:05.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2098999999999998e-05 2024-05-09T09:55:05.430 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.430 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.431 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.431 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1407 3.17 3:e9776743:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:05.431 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:05.431 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.155379533999998, 2024-05-09T09:55:05.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020564397000000002, 2024-05-09T09:55:05.431 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.432 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.432 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.432 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.432 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1407 2024-05-09T09:55:05.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.432 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:05.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231797+0000", 2024-05-09T09:55:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8779999999999998e-06 2024-05-09T09:55:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235222+0000", 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034247090000000002 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235265+0000", 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3575000000000002e-05 2024-05-09T09:55:05.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235285+0000", 2024-05-09T09:55:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0064e-05 2024-05-09T09:55:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235421+0000", 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013553299999999999 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235731+0000", 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031049300000000001 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:05.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.236042+0000", 2024-05-09T09:55:05.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031045999999999998 2024-05-09T09:55:05.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.243329+0000", 2024-05-09T09:55:05.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072875199999999996 2024-05-09T09:55:05.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252033+0000", 2024-05-09T09:55:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087035580000000001 2024-05-09T09:55:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252224+0000", 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000191158 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252358+0000", 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134449 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.441 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1409 3.3d 3:bc138a7e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:05.441 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:05.441 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.109001923999998, 2024-05-09T09:55:05.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016086515999999999, 2024-05-09T09:55:05.441 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.441 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1409 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:05.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:05.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278175+0000", 2024-05-09T09:55:05.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2669999999999998e-06 2024-05-09T09:55:05.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281654+0000", 2024-05-09T09:55:05.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034793100000000002 2024-05-09T09:55:05.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281709+0000", 2024-05-09T09:55:05.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4812999999999998e-05 2024-05-09T09:55:05.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281733+0000", 2024-05-09T09:55:05.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3533e-05 2024-05-09T09:55:05.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281947+0000", 2024-05-09T09:55:05.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021395100000000001 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.282243+0000", 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029696699999999998 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.282564+0000", 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032077700000000001 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.290765+0000", 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0082010369999999996 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294086+0000", 2024-05-09T09:55:05.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003321002 2024-05-09T09:55:05.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294183+0000", 2024-05-09T09:55:05.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6329000000000006e-05 2024-05-09T09:55:05.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294258+0000", 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5530000000000004e-05 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.451 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1861 3.3 3:c3f5cf77:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:05.451 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:05.451 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.066558639, 2024-05-09T09:55:05.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019402322, 2024-05-09T09:55:05.451 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.451 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.451 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.451 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1861 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:05.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320617+0000", 2024-05-09T09:55:05.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:55:05.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322500+0000", 2024-05-09T09:55:05.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018829210000000001 2024-05-09T09:55:05.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322541+0000", 2024-05-09T09:55:05.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0825999999999998e-05 2024-05-09T09:55:05.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322559+0000", 2024-05-09T09:55:05.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8236e-05 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322726+0000", 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016686899999999999 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.323138+0000", 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041232200000000001 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.324376+0000", 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012381479999999999 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.338841+0000", 2024-05-09T09:55:05.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014464785000000001 2024-05-09T09:55:05.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.339597+0000", 2024-05-09T09:55:05.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075604299999999997 2024-05-09T09:55:05.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.339813+0000", 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021524399999999999 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.340017+0000", 2024-05-09T09:55:05.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000204718 2024-05-09T09:55:05.460 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.460 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.460 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.460 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1870 3.3d 3:beb3bbbd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.5SozmI9BQiP9i-OyMXnspWlmbImSGhb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:05.460 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:05.460 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.785943903, 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019492232000000002, 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1870 2024-05-09T09:55:05.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.462 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:05.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601235+0000", 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8770000000000001e-06 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605482+0000", 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042470579999999997 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605530+0000", 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8748999999999997e-05 2024-05-09T09:55:05.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605554+0000", 2024-05-09T09:55:05.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3283000000000001e-05 2024-05-09T09:55:05.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605692+0000", 2024-05-09T09:55:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013870399999999999 2024-05-09T09:55:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605953+0000", 2024-05-09T09:55:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026017899999999998 2024-05-09T09:55:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.606181+0000", 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022812099999999999 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620300+0000", 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014119278000000001 2024-05-09T09:55:05.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620507+0000", 2024-05-09T09:55:05.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020707500000000001 2024-05-09T09:55:05.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620604+0000", 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6637000000000003e-05 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620722+0000", 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011827100000000001 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.469 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.470 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1907 3.1f 3:faa4677d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.30:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:05.470 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:05.470 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.073627590000001, 2024-05-09T09:55:05.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020838817999999999, 2024-05-09T09:55:05.470 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.470 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1907 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313549+0000", 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.79e-06 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316202+0000", 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026528200000000002 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316249+0000", 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6962999999999997e-05 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316270+0000", 2024-05-09T09:55:05.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1080000000000001e-05 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316444+0000", 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017407499999999999 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316731+0000", 2024-05-09T09:55:05.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028764699999999998 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.317692+0000", 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096093000000000003 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.331806+0000", 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014113888 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334125+0000", 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023192199999999999 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334287+0000", 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016131899999999999 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334385+0000", 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8085999999999996e-05 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.477 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.478 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.478 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1934 3.1 3:83810aba:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.bd0uPieH5yAMY0BuB5M_Z7ovAps42t5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:05.478 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:05.478 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.273292955999999, 2024-05-09T09:55:05.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025148000000001, 2024-05-09T09:55:05.478 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1934 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113884+0000", 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6090000000000001e-06 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115593+0000", 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017085030000000001 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115622+0000", 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9519999999999999e-05 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115640+0000", 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8125999999999999e-05 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115732+0000", 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1493e-05 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115930+0000", 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019849099999999999 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.116102+0000", 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206799999999999 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.124956+0000", 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088533650000000002 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139799+0000", 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014842912 2024-05-09T09:55:05.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139861+0000", 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2207999999999998e-05 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139906+0000", 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4852999999999999e-05 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.484 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2057 3.3 3:c12b3099:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.JYYATTjyOHhgDIi3Y4dyj0yvpuhPS5R_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.751927725, 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021504227000000001, 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2057 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635256+0000", 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8169999999999994e-06 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637639+0000", 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023837350000000001 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637677+0000", 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.735e-05 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637692+0000", 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4969e-05 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637772+0000", 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9870999999999995e-05 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637904+0000", 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000132213 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.638011+0000", 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107524 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.645866+0000", 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078543350000000005 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656620+0000", 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010754289 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656695+0000", 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4902999999999998e-05 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656750+0000", 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5220999999999999e-05 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:2105 3.10 e66/18 3:0bd3bb69:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.9DoRBdszHtn66r2rQmpiH3p-scscd-l_1:head v 66'6, mlcod=65'4)", 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.780266894, 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017903960999999999, 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606909+0000", 2024-05-09T09:55:05.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7860000000000001e-06 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612512+0000", 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056024880000000001 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612541+0000", 2024-05-09T09:55:05.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9422000000000001e-05 2024-05-09T09:55:05.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612556+0000", 2024-05-09T09:55:05.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5034e-05 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612675+0000", 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118428 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612714+0000", 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8818e-05 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.624726+0000", 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012012286 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.624811+0000", 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4698999999999997e-05 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2114 3.23 3:c524c8c3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.64:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.601120364, 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018633344, 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2114 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786055+0000", 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.629e-06 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788491+0000", 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024358190000000001 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788520+0000", 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.957e-05 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788532+0000", 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2119999999999999e-05 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788677+0000", 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144957 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788970+0000", 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029236699999999997 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.789866+0000", 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089592800000000005 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804391+0000", 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01452524 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804518+0000", 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012702699999999999 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804620+0000", 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010241100000000001 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804687+0000", 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6276e-05 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:2160 3.15 e67/62 3:aacab97a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.70:head v 67'6, mlcod=64'4)", 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.644691981999999, 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016279577, 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.503 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742484+0000", 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0930000000000001e-06 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747389+0000", 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049051049999999999 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747429+0000", 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0286e-05 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747477+0000", 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.829e-05 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747633+0000", 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015591100000000001 2024-05-09T09:55:05.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747676+0000", 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2330000000000003e-05 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.758581+0000", 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010905791 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.758761+0000", 2024-05-09T09:55:05.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017977100000000001 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2289 3.1f 3:f801594a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.2_o93ud7d60mlbWOIdPIOhVlkm1vVVF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.930853411999999, 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020838377000000002, 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.508 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2289 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456328+0000", 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7800000000000001e-06 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457637+0000", 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013087420000000001 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457663+0000", 2024-05-09T09:55:05.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6026000000000001e-05 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457674+0000", 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1206000000000001e-05 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457748+0000", 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4482999999999998e-05 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457870+0000", 2024-05-09T09:55:05.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121552 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457973+0000", 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102973 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.462180+0000", 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004207527 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477025+0000", 2024-05-09T09:55:05.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014844540999999999 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477099+0000", 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3545000000000001e-05 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477159+0000", 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0001999999999999e-05 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2295 3.12 3:4934888e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.3CtOBEEDgwQbb-KODTbQbrgDi18Uqdl_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.828195088999999, 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021320862999999999, 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.514 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2295 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558981+0000", 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2819999999999999e-06 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560672+0000", 2024-05-09T09:55:05.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001691524 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560696+0000", 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4159999999999999e-05 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560706+0000", 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9019999999999994e-06 2024-05-09T09:55:05.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560774+0000", 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7714999999999998e-05 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560897+0000", 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012249200000000001 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.561003+0000", 2024-05-09T09:55:05.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106869 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.565380+0000", 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004376685 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580177+0000", 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014797181 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580246+0000", 2024-05-09T09:55:05.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8530999999999998e-05 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580299+0000", 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3522e-05 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2304 3.1b 3:d87fe2be:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.94:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.687251488999999, 2024-05-09T09:55:05.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017499124000000001, 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2304 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699924+0000", 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7829999999999999e-06 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703863+0000", 2024-05-09T09:55:05.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039386309999999997 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703901+0000", 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8488999999999997e-05 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703919+0000", 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7706999999999998e-05 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704051+0000", 2024-05-09T09:55:05.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013233099999999999 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704199+0000", 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014797899999999999 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704577+0000", 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037753999999999999 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.711921+0000", 2024-05-09T09:55:05.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073440729999999996 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717344+0000", 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054230140000000003 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717389+0000", 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5117999999999997e-05 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717421+0000", 2024-05-09T09:55:05.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2459000000000002e-05 2024-05-09T09:55:05.526 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.526 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.526 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.526 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2331 3.6 3:63b64f75:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.-FNYp6iQCDWTpLwCXUKfus22HOFp4mR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:05.526 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:05.530 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.975838005, 2024-05-09T09:55:05.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019086397000000001, 2024-05-09T09:55:05.530 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:05.530 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:05.530 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:05.530 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2331 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:05.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411340+0000", 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9280000000000003e-06 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413842+0000", 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025022220000000001 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:05.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413882+0000", 2024-05-09T09:55:05.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9966000000000003e-05 2024-05-09T09:55:05.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:05.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413899+0000", 2024-05-09T09:55:05.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7666e-05 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414192+0000", 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029248700000000002 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414435+0000", 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:05.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414664+0000", 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022880399999999999 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.425867+0000", 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011202833000000001 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430324+0000", 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044573770000000002 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430380+0000", 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5652000000000002e-05 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430422+0000", 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2001e-05 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:05.536 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:05.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-09T09:55:05.538 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:05.533+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:05.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:55:05.638 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:55:05.639+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:55:05.697 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:05.697 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:05.697 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:55:05.697 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:05.711 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:55:05.740 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:05.737+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:05.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:55:05.841 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:05.841+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:05.866 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:05.866 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:55:05.867 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:55:05.867 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:05.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:55:05.966 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:05.967+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:05.973 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:55:05.974 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:55:05.990 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:55:05.990 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:55:06.006 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:55:06.006 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:55:06.023 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:55:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:55:06.035 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:06.035 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:06.043 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:06.041+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:06.043 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:55:06.043 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:55:06.048 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:55:06.065 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:55:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:55:06.087 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:55:06.087 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:55:06.108 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:55:06.108 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:55:06.170 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:06.171+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:06.177 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:06.177 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:06.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:55:06.245 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:06.241+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:06.347 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:06.347 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:06.348 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:06.345+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:06.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:55:06.434 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-05-09T09:55:06.448 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:06.445+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:06.488 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:06.488 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:06.502 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:55:06.590 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:06.591+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:06.651 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:06.649+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:06.659 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:06.659 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:06.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:55:06.762 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:06.763+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:06.833 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:06.834 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:06.847 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:55:06.890 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:06.891+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:06.954 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:06.953+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:07.009 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:07.009 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:07.023 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:55:07.055 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:07.055+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:07.157 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:07.153+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:07.157 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:07.157 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:07.171 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:55:07.258 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:07.259+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:07.338 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:07.338 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:07.352 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:55:07.399 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:07.397+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:07.460 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:07.457+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:07.476 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:07.476 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:07.491 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:55:07.561 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:07.559+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:07.657 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:07.657 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:07.662 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:07.663+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:07.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:55:07.762 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:07.761+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:07.792 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:07.792 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:07.806 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:55:07.863 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:07.863+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:07.964 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:07.961+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:07.972 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:07.972 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:07.986 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:55:08.066 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:08.067+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:08.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-09T09:55:08.156 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:08.156 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:08.166 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:08.165+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:08.169 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:55:08.267 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:08.265+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:08.273 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:55:08.274 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:55:08.290 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:55:08.290 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:55:08.307 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:55:08.307 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:55:08.323 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:55:08.323 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:55:08.332 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:08.332 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:08.343 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:55:08.344 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:55:08.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:55:08.363 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:55:08.363 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:55:08.384 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:55:08.384 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:55:08.395 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:08.393+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:08.403 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:55:08.403 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:55:08.459 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:55:08.468 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:08.465+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:08.499 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_04_9_09_54_42: 10Mb.100 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.1 from bucket to /tmp/downloadfile.1 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.2 from bucket to /tmp/downloadfile.2 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.3 from bucket to /tmp/downloadfile.3 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.4 from bucket to /tmp/downloadfile.4 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.5 from bucket to /tmp/downloadfile.5 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.6 from bucket to /tmp/downloadfile.6 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.7 from bucket to /tmp/downloadfile.7 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.8 from bucket to /tmp/downloadfile.8 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.9 from bucket to /tmp/downloadfile.9 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.10 from bucket to /tmp/downloadfile.10 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.11 from bucket to /tmp/downloadfile.11 2024-05-09T09:55:08.500 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.12 from bucket to /tmp/downloadfile.12 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.13 from bucket to /tmp/downloadfile.13 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.14 from bucket to /tmp/downloadfile.14 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.15 from bucket to /tmp/downloadfile.15 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.16 from bucket to /tmp/downloadfile.16 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.17 from bucket to /tmp/downloadfile.17 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.18 from bucket to /tmp/downloadfile.18 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.19 from bucket to /tmp/downloadfile.19 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.20 from bucket to /tmp/downloadfile.20 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.21 from bucket to /tmp/downloadfile.21 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.22 from bucket to /tmp/downloadfile.22 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.23 from bucket to /tmp/downloadfile.23 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.24 from bucket to /tmp/downloadfile.24 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.25 from bucket to /tmp/downloadfile.25 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.26 from bucket to /tmp/downloadfile.26 2024-05-09T09:55:08.501 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.27 from bucket to /tmp/downloadfile.27 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.28 from bucket to /tmp/downloadfile.28 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.29 from bucket to /tmp/downloadfile.29 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.30 from bucket to /tmp/downloadfile.30 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.31 from bucket to /tmp/downloadfile.31 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.32 from bucket to /tmp/downloadfile.32 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.33 from bucket to /tmp/downloadfile.33 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.34 from bucket to /tmp/downloadfile.34 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.35 from bucket to /tmp/downloadfile.35 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.36 from bucket to /tmp/downloadfile.36 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.37 from bucket to /tmp/downloadfile.37 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.38 from bucket to /tmp/downloadfile.38 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.39 from bucket to /tmp/downloadfile.39 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.40 from bucket to /tmp/downloadfile.40 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.41 from bucket to /tmp/downloadfile.41 2024-05-09T09:55:08.502 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.42 from bucket to /tmp/downloadfile.42 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.43 from bucket to /tmp/downloadfile.43 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.44 from bucket to /tmp/downloadfile.44 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.45 from bucket to /tmp/downloadfile.45 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.46 from bucket to /tmp/downloadfile.46 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.47 from bucket to /tmp/downloadfile.47 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.48 from bucket to /tmp/downloadfile.48 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.49 from bucket to /tmp/downloadfile.49 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.50 from bucket to /tmp/downloadfile.50 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.51 from bucket to /tmp/downloadfile.51 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.52 from bucket to /tmp/downloadfile.52 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.53 from bucket to /tmp/downloadfile.53 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.54 from bucket to /tmp/downloadfile.54 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.55 from bucket to /tmp/downloadfile.55 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.56 from bucket to /tmp/downloadfile.56 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.57 from bucket to /tmp/downloadfile.57 2024-05-09T09:55:08.503 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.58 from bucket to /tmp/downloadfile.58 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.59 from bucket to /tmp/downloadfile.59 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.60 from bucket to /tmp/downloadfile.60 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.61 from bucket to /tmp/downloadfile.61 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.62 from bucket to /tmp/downloadfile.62 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.63 from bucket to /tmp/downloadfile.63 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.64 from bucket to /tmp/downloadfile.64 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.65 from bucket to /tmp/downloadfile.65 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.66 from bucket to /tmp/downloadfile.66 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.67 from bucket to /tmp/downloadfile.67 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.68 from bucket to /tmp/downloadfile.68 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.69 from bucket to /tmp/downloadfile.69 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.70 from bucket to /tmp/downloadfile.70 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.71 from bucket to /tmp/downloadfile.71 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.72 from bucket to /tmp/downloadfile.72 2024-05-09T09:55:08.504 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.73 from bucket to /tmp/downloadfile.73 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.74 from bucket to /tmp/downloadfile.74 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.75 from bucket to /tmp/downloadfile.75 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.76 from bucket to /tmp/downloadfile.76 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.77 from bucket to /tmp/downloadfile.77 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.78 from bucket to /tmp/downloadfile.78 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.79 from bucket to /tmp/downloadfile.79 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.80 from bucket to /tmp/downloadfile.80 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.81 from bucket to /tmp/downloadfile.81 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.82 from bucket to /tmp/downloadfile.82 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.83 from bucket to /tmp/downloadfile.83 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.84 from bucket to /tmp/downloadfile.84 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.85 from bucket to /tmp/downloadfile.85 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.86 from bucket to /tmp/downloadfile.86 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.87 from bucket to /tmp/downloadfile.87 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.88 from bucket to /tmp/downloadfile.88 2024-05-09T09:55:08.505 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.89 from bucket to /tmp/downloadfile.89 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.90 from bucket to /tmp/downloadfile.90 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.91 from bucket to /tmp/downloadfile.91 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.92 from bucket to /tmp/downloadfile.92 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.93 from bucket to /tmp/downloadfile.93 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.94 from bucket to /tmp/downloadfile.94 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.95 from bucket to /tmp/downloadfile.95 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.96 from bucket to /tmp/downloadfile.96 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.97 from bucket to /tmp/downloadfile.97 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.98 from bucket to /tmp/downloadfile.98 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.99 from bucket to /tmp/downloadfile.99 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.100 from bucket to /tmp/downloadfile.100 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-05-09T09:55:08.506 INFO:tasks.workunit.client.0.smithi032.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 113.371702961, 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.033679274000000002, 2024-05-09T09:55:08.522 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 46 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.523 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148151+0000", 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148154+0000", 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.853e-06 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148168+0000", 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.367e-05 2024-05-09T09:55:08.524 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148198+0000", 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9972999999999999e-05 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148215+0000", 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7711999999999999e-05 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148385+0000", 2024-05-09T09:55:08.525 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169264 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.148403+0000", 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8226000000000001e-05 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152325+0000", 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039221120000000002 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for peered", 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.152345+0000", 2024-05-09T09:55:08.526 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9930000000000001e-05 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174646+0000", 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022301130999999998 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.174969+0000", 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00032309599999999998 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 4", 2024-05-09T09:55:08.527 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.175315+0000", 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00034621599999999999 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.179259+0000", 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039433860000000001 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181654+0000", 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023949090000000002 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.528 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181740+0000", 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6186000000000005e-05 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:15.181830+0000", 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.0610000000000002e-05 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1158 3.2c 3:367a58d5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.038637018999999, 2024-05-09T09:55:08.529 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021363626, 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1158 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.530 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481217+0000", 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.481220+0000", 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.027e-06 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486955+0000", 2024-05-09T09:55:08.531 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057345460000000001 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.486994+0000", 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.8982e-05 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487016+0000", 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2103000000000002e-05 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.532 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487145+0000", 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012962499999999999 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487392+0000", 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024650300000000002 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.487614+0000", 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022186999999999999 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.500091+0000", 2024-05-09T09:55:08.533 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012477054 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502399+0000", 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0023086449999999998 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502492+0000", 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2662000000000002e-05 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.534 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.502581+0000", 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.8609000000000005e-05 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1167 3.26 3:65d9db40:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.923982373000001, 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021114266, 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.535 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1167 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595872+0000", 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.536 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.595875+0000", 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.1499999999999999e-06 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599908+0000", 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040330510000000002 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599945+0000", 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.7366000000000001e-05 2024-05-09T09:55:08.537 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.599964+0000", 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8199e-05 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600143+0000", 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017947500000000001 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600531+0000", 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000387914 2024-05-09T09:55:08.538 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.600968+0000", 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043724399999999999 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.615593+0000", 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014624727000000001 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616799+0000", 2024-05-09T09:55:08.539 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0012065159999999999 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616910+0000", 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110555 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.616986+0000", 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6069000000000006e-05 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.540 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1208 3.a 3:5055ce64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.054404028, 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018795551000000001, 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1208 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.541 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465450+0000", 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.465453+0000", 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8609999999999998e-06 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.542 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469227+0000", 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003774281 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469250+0000", 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3156e-05 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469262+0000", 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1531e-05 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.543 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469334+0000", 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2290000000000001e-05 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op must wait for map", 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.469342+0000", 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.1659999999999994e-06 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473383+0000", 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040406940000000001 2024-05-09T09:55:08.544 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473477+0000", 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3929000000000001e-05 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.473588+0000", 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000110938 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.479810+0000", 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0062221070000000002 2024-05-09T09:55:08.545 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484173+0000", 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00436265 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484212+0000", 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9322000000000001e-05 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.484246+0000", 2024-05-09T09:55:08.546 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3626e-05 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1229 3.2c 3:34904b64:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 40.404318426000003, 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020735874000000001, 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.547 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1229 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115536+0000", 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.548 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.115539+0000", 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.6200000000000001e-06 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119644+0000", 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041042090000000002 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119669+0000", 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5754000000000001e-05 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.549 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119684+0000", 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4209000000000001e-05 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119768+0000", 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.4524999999999995e-05 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.119922+0000", 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015423600000000001 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.550 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.120056+0000", 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013380999999999999 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.129703+0000", 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.009646422 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136158+0000", 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0064555810000000002 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.551 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136223+0000", 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.4523999999999994e-05 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.136272+0000", 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.8983999999999997e-05 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1356 3.35 3:af70797a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:08.552 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.287343911000001, 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018963760999999999, 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1356 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:55:08.553 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232510+0000", 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.232514+0000", 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1470000000000003e-06 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.237973+0000", 2024-05-09T09:55:08.554 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054590610000000003 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238009+0000", 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5188999999999998e-05 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238033+0000", 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4769999999999998e-05 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238179+0000", 2024-05-09T09:55:08.555 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014558299999999999 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238427+0000", 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000247827 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.238654+0000", 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022734200000000001 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.247463+0000", 2024-05-09T09:55:08.556 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.008808471 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251130+0000", 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0036668830000000001 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251327+0000", 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000197441 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.251474+0000", 2024-05-09T09:55:08.557 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000147047 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1393 3.10 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 36.596704457000001, 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.02062228, 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.558 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1393 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923150+0000", 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.559 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.923152+0000", 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0190000000000001e-06 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926928+0000", 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0037758520000000001 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926954+0000", 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6152e-05 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.560 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.926967+0000", 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2925000000000001e-05 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927050+0000", 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.3015000000000004e-05 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927188+0000", 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013808000000000001 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.561 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.927320+0000", 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000132311 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.936936+0000", 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0096158560000000008 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943673+0000", 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0067373729999999996 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.562 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943728+0000", 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.5053000000000003e-05 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.943772+0000", 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3643999999999998e-05 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1656 3.35 3:ad423f51:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-05-09T09:55:08.563 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 30.786691112, 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021084454999999998, 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "started", 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1656 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.564 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733163+0000", 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733164+0000", 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2300000000000001e-06 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733175+0000", 2024-05-09T09:55:08.565 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0526999999999999e-05 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733201+0000", 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5952000000000002e-05 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.733210+0000", 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.5629999999999998e-06 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744680+0000", 2024-05-09T09:55:08.566 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011469795 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.744936+0000", 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000255691 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:37.754248+0000", 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0093116970000000007 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.567 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_repop(client.4385.0:1726 3.3f e63/18 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head v 63'7, mlcod=59'5)", 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 25.970863296000001, 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018934763, 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.568 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548991+0000", 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548993+0000", 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8139999999999999e-06 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551287+0000", 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022947499999999999 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.569 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551311+0000", 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3252999999999999e-05 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551323+0000", 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1926999999999999e-05 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551470+0000", 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014753100000000001 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.570 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.551538+0000", 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7618000000000002e-05 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567876+0000", 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.016337872 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.567926+0000", 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.9997999999999998e-05 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.571 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1876 3.a 3:52ea8d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.QD71QSIjnzYUJvkbUpu9yZ6kMZGI2uX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.750884999, 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024394813000000001, 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1876 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.572 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768969+0000", 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.768972+0000", 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.616e-06 2024-05-09T09:55:08.573 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773360+0000", 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043882620000000004 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773389+0000", 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8731999999999999e-05 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773401+0000", 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2094e-05 2024-05-09T09:55:08.574 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773506+0000", 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105173 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773713+0000", 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020665399999999999 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.773888+0000", 2024-05-09T09:55:08.575 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017540899999999999 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.785628+0000", 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011740301999999999 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793268+0000", 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076399040000000003 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793319+0000", 2024-05-09T09:55:08.576 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.0841999999999999e-05 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.793364+0000", 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4824999999999999e-05 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1888 3.26 3:66cc2661:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.RVUWhTPr75VRTCdvqYW6zhcKOb-0e_t_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.405254609, 2024-05-09T09:55:08.577 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021044698000000001, 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1888 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.578 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114600+0000", 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.114602+0000", 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2589999999999999e-06 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118409+0000", 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038070840000000001 2024-05-09T09:55:08.579 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118430+0000", 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1407e-05 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118441+0000", 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0438999999999999e-05 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118594+0000", 2024-05-09T09:55:08.580 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015285299999999999 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.118989+0000", 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00039577600000000003 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.119396+0000", 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00040618000000000002 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.132480+0000", 2024-05-09T09:55:08.581 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013084760000000001 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135459+0000", 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0029782390000000001 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135557+0000", 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8554999999999994e-05 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.582 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.135644+0000", 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.7145999999999995e-05 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1916 3.36 3:6eedf4b4:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.VPNU2_fk3V70lu7RybtX1vlXVee9jX__1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 21.898763203000001, 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024095032999999998, 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.583 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1916 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621091+0000", 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.584 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.621094+0000", 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.36e-06 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626192+0000", 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050974690000000003 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626234+0000", 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.2406e-05 2024-05-09T09:55:08.585 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626253+0000", 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8776000000000001e-05 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626355+0000", 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000101538 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626533+0000", 2024-05-09T09:55:08.586 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017836699999999999 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.626684+0000", 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000151414 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.636642+0000", 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0099573470000000001 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.644981+0000", 2024-05-09T09:55:08.587 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0083395520000000001 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645074+0000", 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.3295999999999996e-05 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.645186+0000", 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000111508 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.588 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2075 3.a 3:53469b12:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.6RHkQ-W_EKbk_OF2lFq2sr_HPaXtnXH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.542126330999999, 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020026097999999999, 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2075 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.589 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977728+0000", 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.977731+0000", 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4300000000000002e-06 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.590 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981866+0000", 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041346309999999997 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981892+0000", 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6545000000000001e-05 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.981907+0000", 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.4489e-05 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.591 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982017+0000", 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109706 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982270+0000", 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025379899999999997 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.982518+0000", 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024785900000000001 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.592 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.996151+0000", 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013632513000000001 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997589+0000", 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0014381960000000001 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997687+0000", 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7575e-05 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.593 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:49.997754+0000", 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7354999999999995e-05 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2081 3.36 3:6cf6c747:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.n_zpFFFU2OZoJK0JchjxtEuV5CgxBIK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.389516898, 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.019931259999999999, 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.594 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.595 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.595 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2081 2024-05-09T09:55:08.595 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.595 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130337+0000", 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.130340+0000", 2024-05-09T09:55:08.598 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8399999999999999e-06 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134268+0000", 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0039274799999999997 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134304+0000", 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.5929000000000001e-05 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134322+0000", 2024-05-09T09:55:08.599 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.8260000000000001e-05 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134453+0000", 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013139799999999999 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134700+0000", 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000246815 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.134954+0000", 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025361900000000001 2024-05-09T09:55:08.600 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.144764+0000", 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098099399999999996 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150087+0000", 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0053232160000000004 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150179+0000", 2024-05-09T09:55:08.601 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.2244000000000007e-05 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.150269+0000", 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.9518999999999995e-05 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2099 3.1e 3:789e79c5:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.gqxJ-lp-L0uUFrshZonEkrXrhQkW2Gi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.054597686000001, 2024-05-09T09:55:08.602 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021689172, 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2099 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.603 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465256+0000", 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.465260+0000", 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2100000000000002e-06 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471028+0000", 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0057687509999999999 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.604 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471069+0000", 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0955999999999999e-05 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471095+0000", 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5375999999999999e-05 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471261+0000", 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165747 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.605 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471520+0000", 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025964199999999998 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.471893+0000", 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00037329000000000003 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.484923+0000", 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013029618 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.606 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486774+0000", 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0018512190000000001 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486872+0000", 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7934000000000001e-05 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.486946+0000", 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3429000000000005e-05 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.607 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2105 3.10 3:0bd3bb69:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.9DoRBdszHtn66r2rQmpiH3p-scscd-l_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.918277836000001, 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023605516999999999, 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2105 2024-05-09T09:55:08.608 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601576+0000", 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.601596+0000", 2024-05-09T09:55:08.609 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9896000000000001e-05 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605653+0000", 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040566650000000001 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605687+0000", 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4421000000000001e-05 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605708+0000", 2024-05-09T09:55:08.610 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0750999999999998e-05 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.605899+0000", 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019071499999999999 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606144+0000", 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024554600000000002 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.606373+0000", 2024-05-09T09:55:08.611 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022909199999999999 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.616518+0000", 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010144497000000001 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625017+0000", 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084995699999999997 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625112+0000", 2024-05-09T09:55:08.612 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.4628000000000003e-05 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.625182+0000", 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9735999999999998e-05 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2120 3.a 3:50dc6130:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.572396922999999, 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022303443999999999, 2024-05-09T09:55:08.613 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2120 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.614 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947457+0000", 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.947461+0000", 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.924e-06 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951651+0000", 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004190208 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.615 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951695+0000", 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3782999999999997e-05 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951714+0000", 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9279e-05 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951813+0000", 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.8303999999999999e-05 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.616 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.951972+0000", 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015941499999999999 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.952494+0000", 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00052197500000000004 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.965422+0000", 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012927467 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.617 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969426+0000", 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004004479 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969628+0000", 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020216599999999999 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.969761+0000", 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013244400000000001 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.618 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2157 3.3b 3:dd466707:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.kmq4W5FDvTJuiVHTRZOzwfAwhKijRHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.861054965000001, 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.069844506000000001, 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2157 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.619 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658799+0000", 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.658802+0000", 2024-05-09T09:55:08.620 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7810000000000001e-06 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662839+0000", 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040367909999999996 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662873+0000", 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4075999999999997e-05 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.662896+0000", 2024-05-09T09:55:08.621 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2821000000000001e-05 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663002+0000", 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105882 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663159+0000", 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015773 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.663293+0000", 2024-05-09T09:55:08.622 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013406599999999999 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.670298+0000", 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007004845 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728516+0000", 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.058218029999999997 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728590+0000", 2024-05-09T09:55:08.623 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3422000000000003e-05 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.728644+0000", 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4061999999999998e-05 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2172 3.26 3:64119a6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.72:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 16.507147169, 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022271427, 2024-05-09T09:55:08.624 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2172 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012707+0000", 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.012709+0000", 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1339999999999998e-06 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016768+0000", 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004058412 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.626 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016801+0000", 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3831999999999997e-05 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016817+0000", 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.5843000000000001e-05 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.016972+0000", 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015504399999999999 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.627 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.017233+0000", 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026038899999999998 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.018157+0000", 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00092440100000000004 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034009+0000", 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015851714999999999 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.628 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034761+0000", 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00075227699999999998 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034898+0000", 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000136558 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:52.034978+0000", 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0822000000000006e-05 2024-05-09T09:55:08.629 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2337 3.36 3:6f80a6d6:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.k49qI6xclWLMT4HOZ_xJfp3Cztqtf4E_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 12.952173962, 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020721887000000001, 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:08.630 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2337 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567680+0000", 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.631 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.567682+0000", 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.841e-06 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572398+0000", 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047164319999999996 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572420+0000", 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1923999999999999e-05 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.632 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572431+0000", 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.0481e-05 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572558+0000", 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000127625 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572712+0000", 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000153079 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.633 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.572853+0000", 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000141524 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588287+0000", 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015433952000000001 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588315+0000", 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7804999999999999e-05 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.634 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588355+0000", 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0630000000000002e-05 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:55.588402+0000", 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6594000000000001e-05 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:08.635 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:08.636 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6, 7] out_osds: [4, 3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-09T09:55:08.636 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-09T09:55:08.636 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-05-09T09:55:08.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-05-09T09:55:08.638 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:55:08.639 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:08.639+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:08.738 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:08.737+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:08.826 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:08.826 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:55:08.826 INFO:teuthology.orchestra.run.smithi080.stdout: "num_ops": 0 2024-05-09T09:55:08.826 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:08.839 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:08.839+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:08.841 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:55:08.940 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:08.939+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:08.969 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-05-09T09:55:08.967+0000 7fcc70e52640 -1 mon.a@0(leader).osd e73 definitely_dead 0 2024-05-09T09:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [], 2024-05-09T09:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: "complaint_time": 30, 2024-05-09T09:55:09.015 INFO:teuthology.orchestra.run.smithi080.stdout: "num_blocked_ops": 0 2024-05-09T09:55:09.016 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:09.031 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:55:09.041 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:09.039+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:09.142 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:09.137+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:09.162 INFO:teuthology.orchestra.run.smithi080.stdout:{ 2024-05-09T09:55:09.162 INFO:teuthology.orchestra.run.smithi080.stdout: "size": 20, 2024-05-09T09:55:09.162 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 600, 2024-05-09T09:55:09.162 INFO:teuthology.orchestra.run.smithi080.stdout: "ops": [ 2024-05-09T09:55:09.162 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 127.86505062400001, 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022453465999999998, 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:09.163 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 114 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296528+0000", 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.164 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296529+0000", 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.1699999999999998e-07 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296534+0000", 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.853e-06 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296544+0000", 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7699999999999996e-06 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.165 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296551+0000", 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.5000000000000002e-06 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314302+0000", 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017750788999999999 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314435+0000", 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133246 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.314637+0000", 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000202124 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318689+0000", 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040519099999999997 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318732+0000", 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3087999999999998e-05 2024-05-09T09:55:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318866+0000", 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013329600000000001 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.318982+0000", 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116273 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.168 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 127.865016471, 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022979632999999999, 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 115 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.169 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296563+0000", 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.170 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296649+0000", 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.5416999999999999e-05 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296661+0000", 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.218e-05 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296669+0000", 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9689999999999994e-06 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.171 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315273+0000", 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.018604356999999998 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315526+0000", 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025285699999999999 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.315936+0000", 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00041030400000000001 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.172 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319101+0000", 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0031645190000000002 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319295+0000", 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019416100000000001 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319429+0000", 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013395599999999999 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.173 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319542+0000", 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000113303 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 127.864895948, 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023111389999999999, 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.174 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 116 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296683+0000", 2024-05-09T09:55:09.175 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296684+0000", 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7299999999999995e-07 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296690+0000", 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.9139999999999996e-06 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.176 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296699+0000", 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7119999999999995e-06 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296707+0000", 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3629999999999996e-06 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317573+0000", 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.020866147000000002 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.177 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317711+0000", 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013813900000000001 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.317976+0000", 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026497599999999999 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319255+0000", 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.001279058 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.178 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319566+0000", 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031107500000000001 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319692+0000", 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012626900000000001 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319794+0000", 2024-05-09T09:55:09.179 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000102064 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4200.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 127.86486042200001, 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.024797089000000001, 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4200", 2024-05-09T09:55:09.180 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/1590405473", 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 117 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.181 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296719+0000", 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.0999999999999998e-07 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296745+0000", 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5641999999999999e-05 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296757+0000", 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.19e-05 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.182 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.296764+0000", 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.7559999999999999e-06 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319843+0000", 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023078344000000001 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.319977+0000", 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013426599999999999 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.183 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.320180+0000", 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020323100000000001 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321173+0000", 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00099307400000000004 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321271+0000", 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7347000000000002e-05 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.184 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321408+0000", 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000137279 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:53:01.321516+0000", 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010764000000000001 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1157 3.13 3:cb26828e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:09.185 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.698479628000001, 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021985248999999998, 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1157 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:09.186 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463099+0000", 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.463102+0000", 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.3630000000000001e-06 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470773+0000", 2024-05-09T09:55:09.187 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076712769999999998 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470806+0000", 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2802999999999997e-05 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.470827+0000", 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.1175999999999999e-05 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471017+0000", 2024-05-09T09:55:09.188 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018967499999999999 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471279+0000", 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026242300000000002 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.471498+0000", 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021940300000000001 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.482134+0000", 2024-05-09T09:55:09.189 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010635446999999999 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.484865+0000", 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0027312460000000001 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485006+0000", 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039099999999999 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.190 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.485085+0000", 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.9045e-05 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1178 3.37 3:efe37060:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.444148454999997, 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.030832948999999998, 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.191 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1178 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717431+0000", 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.192 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.717434+0000", 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0060000000000001e-06 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721611+0000", 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0041770929999999998 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721645+0000", 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4561999999999999e-05 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.193 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721678+0000", 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.2700000000000002e-05 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.721844+0000", 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000165914 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722121+0000", 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027709300000000001 2024-05-09T09:55:09.194 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.722352+0000", 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023117600000000001 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.733566+0000", 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011213989000000001 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748089+0000", 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014523036 2024-05-09T09:55:09.195 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748187+0000", 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.7974999999999996e-05 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748263+0000", 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6404999999999998e-05 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.196 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1179 3.15 3:a9d36b27:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 42.433468695000002, 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021009254000000002, 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1179 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.197 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728110+0000", 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.728138+0000", 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7906e-05 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.198 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734782+0000", 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0066435950000000004 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734827+0000", 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.5269000000000003e-05 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.734858+0000", 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0654000000000002e-05 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.199 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735020+0000", 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016203699999999999 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735274+0000", 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025399299999999999 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.735518+0000", 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024406300000000001 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.200 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.747370+0000", 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.011852339 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.748991+0000", 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0016208259999999999 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749065+0000", 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4018999999999997e-05 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.201 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:26.749120+0000", 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4552999999999998e-05 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1214 3.39 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.331151466000001, 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.028754392, 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.202 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1214 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830428+0000", 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.830433+0000", 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.237e-06 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838120+0000", 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0076874200000000004 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.204 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838164+0000", 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.4002999999999999e-05 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838186+0000", 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.198e-05 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838356+0000", 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000169421 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.205 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838666+0000", 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00031002599999999998 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.838898+0000", 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023215000000000001 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.849862+0000", 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010964649 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.206 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.858862+0000", 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0089996999999999994 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859048+0000", 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000186128 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.859182+0000", 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000133678 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.207 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1216 3.e 3:734f2773:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.289425956000002, 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.027271179999999999, 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.208 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.209 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1216 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872153+0000", 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.210 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.872156+0000", 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.304e-06 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876935+0000", 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0047782440000000001 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876974+0000", 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.9520000000000001e-05 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.211 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.876999+0000", 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5286000000000002e-05 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877108+0000", 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000109063 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877300+0000", 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00019180299999999999 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:09.212 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.877468+0000", 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016759199999999999 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.886506+0000", 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090379599999999994 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899047+0000", 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.012540936000000001 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.213 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899286+0000", 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00023885700000000001 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.899424+0000", 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000138615 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1217 3.11 3:8a7f3d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:09.214 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.275834662000001, 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021949672, 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1217 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.215 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885744+0000", 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.885747+0000", 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0429999999999999e-06 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893119+0000", 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0073719229999999998 2024-05-09T09:55:09.216 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893163+0000", 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3476000000000002e-05 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893188+0000", 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.5443e-05 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893364+0000", 2024-05-09T09:55:09.217 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00017547400000000001 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893619+0000", 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00025488300000000002 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.893842+0000", 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00022347099999999999 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.218 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907393+0000", 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013550804 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907498+0000", 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010539099999999999 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907590+0000", 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1419e-05 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.219 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:27.907694+0000", 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000104345 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1223 3.15 3:aacb7828:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 41.158647268000003, 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021427795999999999, 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.220 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1223 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002932+0000", 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.221 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.002934+0000", 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2050000000000001e-06 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007103+0000", 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.004168878 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007133+0000", 2024-05-09T09:55:09.222 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0577999999999998e-05 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007145+0000", 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.1844e-05 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007222+0000", 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.6569000000000005e-05 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007366+0000", 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000144053 2024-05-09T09:55:09.223 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 3", 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.007494+0000", 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012810799999999999 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.015333+0000", 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0078388439999999993 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024121+0000", 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0087886230000000006 2024-05-09T09:55:09.224 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024253+0000", 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013161800000000001 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:28.024360+0000", 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000106476 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.225 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1374 3.14 3:2968be86:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 37.803026703, 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.025594499999999999, 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1374 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.226 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358552+0000", 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.358555+0000", 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0000000000000001e-06 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.227 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364047+0000", 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0054919599999999997 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364082+0000", 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.4903000000000001e-05 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364099+0000", 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.7316000000000002e-05 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.228 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364233+0000", 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013302600000000001 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364481+0000", 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00024840499999999999 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.364757+0000", 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027572700000000003 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.229 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.372096+0000", 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.007339702 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.383918+0000", 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.01182211 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384024+0000", 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000105251 2024-05-09T09:55:09.230 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:31.384147+0000", 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012310000000000001 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1726 3.3f 3:fd692287:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.Jg3rcJL60pImaG7QXgUdfSAP2gjUzLm_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 26.616924503, 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023921398, 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.231 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1726 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.232 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544654+0000", 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.544657+0000", 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6639999999999998e-06 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548394+0000", 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003737326 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.233 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548421+0000", 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.6865000000000001e-05 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548434+0000", 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2605e-05 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548514+0000", 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.0352000000000006e-05 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.234 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548671+0000", 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000156231 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.548814+0000", 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014296600000000001 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.559185+0000", 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010371949 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.235 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568269+0000", 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0090838789999999996 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568449+0000", 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000179407 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:42.568576+0000", 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012715400000000001 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.236 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1885 3.11 3:89f00d0a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.28:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 23.192425802999999, 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.022582944000000001, 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1885 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.237 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969153+0000", 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.969162+0000", 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.268e-06 2024-05-09T09:55:09.238 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973026+0000", 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0038637680000000001 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973055+0000", 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.8858000000000001e-05 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973067+0000", 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2184999999999999e-05 2024-05-09T09:55:09.239 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973141+0000", 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.3747999999999999e-05 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973302+0000", 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016143099999999999 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.973741+0000", 2024-05-09T09:55:09.240 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00043816299999999999 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991002+0000", 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.017261155 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991603+0000", 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00060141600000000002 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991671+0000", 2024-05-09T09:55:09.241 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.7433000000000003e-05 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:45.991736+0000", 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.5518999999999994e-05 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:1931 3.f 3:f2a153e3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 22.168197361000001, 2024-05-09T09:55:09.242 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021453967000000001, 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 1931 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.243 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993382+0000", 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.993383+0000", 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.127e-06 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997421+0000", 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040380599999999996 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.244 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997440+0000", 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.9477e-05 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997453+0000", 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.2498e-05 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997539+0000", 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 8.6473999999999999e-05 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.245 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.997702+0000", 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00016321 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:46.998188+0000", 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00048555899999999999 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.006182+0000", 2024-05-09T09:55:09.246 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0079940800000000006 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014666+0000", 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0084836749999999995 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014767+0000", 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010093499999999999 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:47.014836+0000", 2024-05-09T09:55:09.247 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.8872000000000001e-05 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2117 3.2d 3:b465dcda:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.GFV4vCspRy1zUXkFAuI6fs_j51KMCUd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 18.241351031000001, 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021398311, 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.248 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2117 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920228+0000", 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.249 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.920230+0000", 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.503e-06 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924562+0000", 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0043315610000000003 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924591+0000", 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9077999999999998e-05 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.250 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924611+0000", 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.0339999999999998e-05 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924703+0000", 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 9.1440000000000005e-05 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924855+0000", 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00015229100000000001 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.251 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.924978+0000", 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00012243099999999999 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.931560+0000", 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0065820380000000001 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941452+0000", 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0098919860000000002 2024-05-09T09:55:09.252 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941554+0000", 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010251000000000001 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:50.941626+0000", 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.2132999999999995e-05 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.253 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2151 3.3f 3:fcdd6a3a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.e_T4R69E113FUtA8H-_HY1rmD7y3cXZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.667349862999998, 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021326852, 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.254 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2151 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494229+0000", 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.255 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.494232+0000", 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.9299999999999999e-06 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498235+0000", 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0040031620000000002 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498266+0000", 2024-05-09T09:55:09.256 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.0391000000000001e-05 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498279+0000", 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.3825000000000001e-05 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498387+0000", 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000107236 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498604+0000", 2024-05-09T09:55:09.257 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00021725800000000001 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.498826+0000", 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000221759 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.513219+0000", 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.014393764 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515433+0000", 2024-05-09T09:55:09.258 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0022133209999999999 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515502+0000", 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 6.9191999999999998e-05 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.515556+0000", 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.4014000000000002e-05 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.259 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2160 3.15 3:aacab97a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.70:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 17.425502927, 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023051668000000001, 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2160 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.260 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736076+0000", 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.736079+0000", 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.163e-06 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.261 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740589+0000", 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0045100990000000001 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740631+0000", 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.1440000000000003e-05 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740655+0000", 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.4413000000000002e-05 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.262 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.740841+0000", 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00018621299999999999 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.741107+0000", 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00026576600000000002 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.741966+0000", 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00085910000000000001 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.263 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.755114+0000", 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.013147653 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.758937+0000", 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.003822757 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.759053+0000", 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.000116078 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.264 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:51.759128+0000", 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 7.4986000000000003e-05 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2298 3.11 3:8808c42e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.93:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.577883797, 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.021413894999999999, 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.265 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2298 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.266 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583695+0000", 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.583697+0000", 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.2639999999999998e-06 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.587989+0000", 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0042911590000000001 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.267 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588022+0000", 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.3686000000000002e-05 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588039+0000", 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 1.6762999999999999e-05 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588181+0000", 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014182499999999999 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.268 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.588455+0000", 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00027390500000000001 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.589403+0000", 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00094826800000000005 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.604719+0000", 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.015316065 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.269 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.604920+0000", 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00020117099999999999 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.605052+0000", 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00013208499999999999 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.605109+0000", 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 5.6703999999999998e-05 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.270 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "description": "osd_op(client.4385.0:2313 3.13 3:ca22356b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.AtuHcbB9TtgV74F70V_2UZQQNVaym6E_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "initiated_at": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "age": 14.212766286000001, 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.023208837999999999, 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "continuous": false, 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "type_data": { 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "client_info": { 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "client": "client.4385", 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: "tid": 2313 2024-05-09T09:55:09.271 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "events": [ 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "initiated", 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "header_read", 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948813+0000", 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "throttled", 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.948816+0000", 2024-05-09T09:55:09.272 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 3.106e-06 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "all_read", 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953841+0000", 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0050255650000000001 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "dispatched", 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953882+0000", 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.0176000000000003e-05 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.953909+0000", 2024-05-09T09:55:09.273 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 2.7118999999999999e-05 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "reached_pg", 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954013+0000", 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00010416600000000001 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "started", 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954153+0000", 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00014039200000000001 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:09.274 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.954272+0000", 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.00011833299999999999 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "op_commit", 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.961157+0000", 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.0068856890000000004 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.971932+0000", 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 0.010774522 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "commit_sent", 2024-05-09T09:55:09.275 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.971975+0000", 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.3393000000000003e-05 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: }, 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: { 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: "event": "done", 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: "time": "2024-05-09T09:54:54.972022+0000", 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: "duration": 4.6377e-05 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: } 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout: ] 2024-05-09T09:55:09.276 INFO:teuthology.orchestra.run.smithi080.stdout:} 2024-05-09T09:55:09.278 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-09T09:55:09.278 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:09.279+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:09.379 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:09.377+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4964.0:540 3.3d 3:bed5b22b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.52:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:55:09.424293+0000", 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.001400519, 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014494110000000001, 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4964", 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/524310277", 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 540 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424293+0000", 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424293+0000", 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424295+0000", 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5719999999999999e-06 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424303+0000", 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5990000000000002e-06 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424328+0000", 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4423e-05 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424341+0000", 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2751e-05 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424420+0000", 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9423000000000002e-05 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424519+0000", 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9253999999999995e-05 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.424713+0000", 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019415099999999999 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 1 2024-05-09T09:55:09.428 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:09.439 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-09T09:55:09.455 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:55:09.462 INFO:teuthology.orchestra.run.smithi032.stderr:marked in osd.3. 2024-05-09T09:55:09.483 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:09.479+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:09.519 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-05-09T09:55:09.581 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-05-09T09:55:09.579+0000 7f3eba5ea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25108) UID: 0 2024-05-09T09:55:09.592 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:55:09.592 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:55:09.592 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:09.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-09T09:55:09.694 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:09.695+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:09.779 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1174 3.3 3:c174dfac:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.gIdXQ50_d4Eib4dQFizuWgdYd2C01zK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.104282042999998, 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016773575999999998, 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1174 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672836+0000", 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.672838+0000", 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6469999999999998e-06 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675089+0000", 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022509029999999998 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675122+0000", 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2679999999999999e-05 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675139+0000", 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6663999999999998e-05 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675224+0000", 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4950999999999994e-05 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675371+0000", 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014695800000000001 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.675490+0000", 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000119598 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.681815+0000", 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063248219999999999 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689490+0000", 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0076750589999999997 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689558+0000", 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8034999999999995e-05 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:26.689609+0000", 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1258999999999998e-05 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1214 3.39 e58/18 3:9eee43cd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_2:head v 58'3, mlcod=57'1)", 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:09.785 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.937922295999996, 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019302639999999999, 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839196+0000", 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.839197+0000", 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.074e-06 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845791+0000", 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065941660000000003 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845848+0000", 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7389999999999998e-05 2024-05-09T09:55:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.845872+0000", 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3405999999999999e-05 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.846103+0000", 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023154999999999999 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.846165+0000", 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1643000000000006e-05 2024-05-09T09:55:09.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.858413+0000", 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012248235999999999 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.858498+0000", 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5174999999999997e-05 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.789 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1218 3.1f 3:fb5d7f81:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.880836567999999, 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024564916999999999, 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1218 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896281+0000", 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.896285+0000", 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.236e-06 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901084+0000", 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047989970000000002 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901133+0000", 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9616000000000001e-05 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901155+0000", 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1642999999999999e-05 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901259+0000", 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010411700000000001 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901462+0000", 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020326799999999999 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.901640+0000", 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017785699999999999 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.907401+0000", 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057612549999999998 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920537+0000", 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013136079 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920706+0000", 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016847800000000001 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.920846+0000", 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140371 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1228 3.3d 3:bfece5e2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.679771270000003, 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017028782999999999, 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.796 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.796 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.796 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-05-09T09:55:09.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.796 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097347+0000", 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.097350+0000", 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1329999999999999e-06 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101141+0000", 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037913640000000002 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101195+0000", 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3458999999999998e-05 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101214+0000", 2024-05-09T09:55:09.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9593e-05 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101365+0000", 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015049099999999999 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101652+0000", 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028707 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.101904+0000", 2024-05-09T09:55:09.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025211999999999999 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.109872+0000", 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079686459999999994 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114206+0000", 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043330290000000004 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114298+0000", 2024-05-09T09:55:09.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2619000000000002e-05 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.114375+0000", 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7259e-05 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1355 3.3 3:c1d2f764:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.6i6WY9ZFsRi3J8LxOmK62biftX3gugu_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.555621700000003, 2024-05-09T09:55:09.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016507589999999999, 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1355 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221496+0000", 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.221499+0000", 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3139999999999999e-06 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222734+0000", 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012346849999999999 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222768+0000", 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3729000000000002e-05 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222783+0000", 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5503999999999999e-05 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.222879+0000", 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5171000000000001e-05 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.223093+0000", 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021460500000000001 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.223263+0000", 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000169748 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.228460+0000", 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005197297 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.237927+0000", 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094671559999999991 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.237971+0000", 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3640000000000002e-05 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.238004+0000", 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2740999999999997e-05 2024-05-09T09:55:09.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1393 3.10 e59/18 3:0b84c048:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_3:head v 59'2, mlcod=0'0)", 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.849534765999998, 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015849678999999998, 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927583+0000", 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.927598+0000", 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.491e-05 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932805+0000", 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052067770000000001 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932847+0000", 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1943000000000001e-05 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.932881+0000", 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3787e-05 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.933020+0000", 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013958800000000001 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.933065+0000", 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5340000000000003e-05 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.943391+0000", 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010325235 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.943433+0000", 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2098999999999998e-05 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1407 3.17 3:e9776743:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.545323832999998, 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020564397000000002, 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.812 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1407 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231794+0000", 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231797+0000", 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8779999999999998e-06 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235222+0000", 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034247090000000002 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235265+0000", 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3575000000000002e-05 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235285+0000", 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0064e-05 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235421+0000", 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013553299999999999 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.235731+0000", 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031049300000000001 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.236042+0000", 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031045999999999998 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.243329+0000", 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072875199999999996 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252033+0000", 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087035580000000001 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252224+0000", 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000191158 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.252358+0000", 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134449 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1409 3.3d 3:bc138a7e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:09.817 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.498946222999997, 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016086515999999999, 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1409 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278172+0000", 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.278175+0000", 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2669999999999998e-06 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281654+0000", 2024-05-09T09:55:09.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034793100000000002 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281709+0000", 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4812999999999998e-05 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281733+0000", 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3533e-05 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.281947+0000", 2024-05-09T09:55:09.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021395100000000001 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.282243+0000", 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029696699999999998 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.282564+0000", 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032077700000000001 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.290765+0000", 2024-05-09T09:55:09.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0082010369999999996 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294086+0000", 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003321002 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294183+0000", 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6329000000000006e-05 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.294258+0000", 2024-05-09T09:55:09.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5530000000000004e-05 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1861 3.3 3:c3f5cf77:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.456502938, 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019402322, 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1861 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320615+0000", 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.320617+0000", 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.21e-06 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322500+0000", 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0018829210000000001 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322541+0000", 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0825999999999998e-05 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322559+0000", 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8236e-05 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.322726+0000", 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016686899999999999 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.323138+0000", 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041232200000000001 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.324376+0000", 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012381479999999999 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.338841+0000", 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014464785000000001 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.339597+0000", 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075604299999999997 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.339813+0000", 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021524399999999999 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.340017+0000", 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000204718 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1870 3.3d 3:beb3bbbd:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.5SozmI9BQiP9i-OyMXnspWlmbImSGhb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:09.828 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.175888201999999, 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019492232000000002, 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1870 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601230+0000", 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.601235+0000", 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8770000000000001e-06 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605482+0000", 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042470579999999997 2024-05-09T09:55:09.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605530+0000", 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8748999999999997e-05 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605554+0000", 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3283000000000001e-05 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605692+0000", 2024-05-09T09:55:09.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013870399999999999 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.605953+0000", 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026017899999999998 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.606181+0000", 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022812099999999999 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620300+0000", 2024-05-09T09:55:09.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014119278000000001 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620507+0000", 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020707500000000001 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620604+0000", 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6637000000000003e-05 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.620722+0000", 2024-05-09T09:55:09.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011827100000000001 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1907 3.1f 3:faa4677d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.30:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.463571889000001, 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020838817999999999, 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.834 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1907 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313546+0000", 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.313549+0000", 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.79e-06 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316202+0000", 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026528200000000002 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316249+0000", 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6962999999999997e-05 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316270+0000", 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1080000000000001e-05 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316444+0000", 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017407499999999999 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.316731+0000", 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028764699999999998 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.317692+0000", 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096093000000000003 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.331806+0000", 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014113888 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334125+0000", 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023192199999999999 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334287+0000", 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016131899999999999 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.334385+0000", 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8085999999999996e-05 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1934 3.1 3:83810aba:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.bd0uPieH5yAMY0BuB5M_Z7ovAps42t5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.663237254999999, 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.026025148000000001, 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1934 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113881+0000", 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.113884+0000", 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6090000000000001e-06 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115593+0000", 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017085030000000001 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115622+0000", 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9519999999999999e-05 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115640+0000", 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8125999999999999e-05 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115732+0000", 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1493e-05 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.115930+0000", 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019849099999999999 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.116102+0000", 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017206799999999999 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.124956+0000", 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088533650000000002 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139799+0000", 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014842912 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139861+0000", 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2207999999999998e-05 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:47.139906+0000", 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4852999999999999e-05 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2057 3.3 3:c12b3099:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.JYYATTjyOHhgDIi3Y4dyj0yvpuhPS5R_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 20.141872024000001, 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021504227000000001, 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2057 2024-05-09T09:55:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635246+0000", 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.635256+0000", 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8169999999999994e-06 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637639+0000", 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023837350000000001 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637677+0000", 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.735e-05 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637692+0000", 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4969e-05 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637772+0000", 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9870999999999995e-05 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.637904+0000", 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000132213 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.638011+0000", 2024-05-09T09:55:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107524 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.645866+0000", 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078543350000000005 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656620+0000", 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010754289 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656695+0000", 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4902999999999998e-05 2024-05-09T09:55:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:49.656750+0000", 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5220999999999999e-05 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:2105 3.10 e66/18 3:0bd3bb69:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.9DoRBdszHtn66r2rQmpiH3p-scscd-l_1:head v 66'6, mlcod=65'4)", 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.170211193, 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017903960999999999, 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606907+0000", 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.606909+0000", 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7860000000000001e-06 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612512+0000", 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056024880000000001 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612541+0000", 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9422000000000001e-05 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612556+0000", 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5034e-05 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612675+0000", 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118428 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.612714+0000", 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8818e-05 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.624726+0000", 2024-05-09T09:55:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012012286 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.624811+0000", 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4698999999999997e-05 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2114 3.23 3:c524c8c3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.64:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.991064663, 2024-05-09T09:55:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018633344, 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2114 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786053+0000", 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.786055+0000", 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.629e-06 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788491+0000", 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024358190000000001 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788520+0000", 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.957e-05 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788532+0000", 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2119999999999999e-05 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788677+0000", 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000144957 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.788970+0000", 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029236699999999997 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.789866+0000", 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089592800000000005 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804391+0000", 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01452524 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804518+0000", 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012702699999999999 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804620+0000", 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010241100000000001 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.804687+0000", 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6276e-05 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:2160 3.15 e67/62 3:aacab97a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.70:head v 67'6, mlcod=64'4)", 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.034636281000001, 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016279577, 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742482+0000", 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.742484+0000", 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0930000000000001e-06 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747389+0000", 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049051049999999999 2024-05-09T09:55:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747429+0000", 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0286e-05 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747477+0000", 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.829e-05 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747633+0000", 2024-05-09T09:55:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015591100000000001 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.747676+0000", 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2330000000000003e-05 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.758581+0000", 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010905791 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.758761+0000", 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017977100000000001 2024-05-09T09:55:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2289 3.1f 3:f801594a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.2_o93ud7d60mlbWOIdPIOhVlkm1vVVF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.320797711000001, 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020838377000000002, 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2289 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456320+0000", 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.456328+0000", 2024-05-09T09:55:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7800000000000001e-06 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457637+0000", 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013087420000000001 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457663+0000", 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6026000000000001e-05 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457674+0000", 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1206000000000001e-05 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457748+0000", 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4482999999999998e-05 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457870+0000", 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121552 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.457973+0000", 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102973 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.462180+0000", 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004207527 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477025+0000", 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014844540999999999 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477099+0000", 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3545000000000001e-05 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.477159+0000", 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0001999999999999e-05 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2295 3.12 3:4934888e:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.3CtOBEEDgwQbb-KODTbQbrgDi18Uqdl_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.218139388000001, 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.021320862999999999, 2024-05-09T09:55:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2295 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558978+0000", 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.558981+0000", 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2819999999999999e-06 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560672+0000", 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001691524 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560696+0000", 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4159999999999999e-05 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560706+0000", 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9019999999999994e-06 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560774+0000", 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7714999999999998e-05 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.560897+0000", 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012249200000000001 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.561003+0000", 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106869 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.565380+0000", 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004376685 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580177+0000", 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014797181 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580246+0000", 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8530999999999998e-05 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.580299+0000", 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3522e-05 2024-05-09T09:55:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2304 3.1b 3:d87fe2be:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.94:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.077195787999999, 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017499124000000001, 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2304 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699922+0000", 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.699924+0000", 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7829999999999999e-06 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703863+0000", 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039386309999999997 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703901+0000", 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8488999999999997e-05 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.703919+0000", 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7706999999999998e-05 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704051+0000", 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013233099999999999 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704199+0000", 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014797899999999999 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.704577+0000", 2024-05-09T09:55:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037753999999999999 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.711921+0000", 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073440729999999996 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717344+0000", 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054230140000000003 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717389+0000", 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5117999999999997e-05 2024-05-09T09:55:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:54.717421+0000", 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2459000000000002e-05 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2331 3.6 3:63b64f75:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.-FNYp6iQCDWTpLwCXUKfus22HOFp4mR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.365782304, 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019086397000000001, 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2331 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411336+0000", 2024-05-09T09:55:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.411340+0000", 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9280000000000003e-06 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413842+0000", 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025022220000000001 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413882+0000", 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9966000000000003e-05 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.413899+0000", 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7666e-05 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414192+0000", 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029248700000000002 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414435+0000", 2024-05-09T09:55:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024346099999999999 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.414664+0000", 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022880399999999999 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.425867+0000", 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011202833000000001 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430324+0000", 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044573770000000002 2024-05-09T09:55:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430380+0000", 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5652000000000002e-05 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.430422+0000", 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2001e-05 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:09.885 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:09.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-09T09:55:09.887 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:09.885+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:09.988 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:09.985+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:10.067 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:10.067 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:55:10.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.067 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4964.0:556 4.f 4:f1540dea:::.dir.846af652-2d61-464d-9ca3-942a33f04ae8.4385.2.9:head [stat out=16b,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=280b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-05-09T09:55:10.067 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:55:09.459283+0000", 2024-05-09T09:55:10.067 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.60970467800000006, 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.60978352400000002, 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4964", 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/524310277", 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 556 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.459283+0000", 2024-05-09T09:55:10.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.459283+0000", 2024-05-09T09:55:10.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.459285+0000", 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9479999999999998e-06 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.459296+0000", 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543999999999999e-05 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.459317+0000", 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1784999999999999e-05 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.459330+0000", 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2177e-05 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.459408+0000", 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7980999999999998e-05 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.459513+0000", 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105183 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.460268+0000", 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075504800000000003 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.461001+0000", 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073270699999999998 2024-05-09T09:55:10.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.506402+0000", 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.045401417999999999 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.506419+0000", 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6719999999999999e-05 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4964.0:559 4.f 4.57b02a8f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:55:09.472440+0000", 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.59654778100000005, 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.59679129200000003, 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for peered", 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4964", 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/524310277", 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 559 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.472440+0000", 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.472440+0000", 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.472442+0000", 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.854e-06 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.472448+0000", 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1720000000000004e-06 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.472462+0000", 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3619e-05 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.472473+0000", 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0900999999999999e-05 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.512650+0000", 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.040177491000000003 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.512660+0000", 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6970000000000005e-06 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 2 2024-05-09T09:55:10.077 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:10.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-09T09:55:10.126 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:55:10.127+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:55:10.190 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:10.191+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:10.210 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:10.210 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:10.210 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-05-09T09:55:10.210 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-05-09T09:55:10.211 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:10.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-09T09:55:10.314 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:10.315+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:10.392 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-05-09T09:55:10.391+0000 7f855a771640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25113) UID: 0 2024-05-09T09:55:10.396 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:10.396 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-05-09T09:55:10.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-05-09T09:55:10.396 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-05-09T09:55:10.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4473.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e23)", 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 119.287319216, 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019814269999999998, 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4473", 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/489554711", 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.108998+0000", 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109001+0000", 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.446e-06 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109012+0000", 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1226000000000001e-05 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109041+0000", 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9025000000000001e-05 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109060+0000", 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9154e-05 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109210+0000", 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015013900000000001 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.109223+0000", 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110934+0000", 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001710729 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.110949+0000", 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5452e-05 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128623+0000", 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017673802999999998 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:53:11.128812+0000", 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018954599999999999 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1206 3.25 3:a4e08847:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.dt6xdVjkxDArItDHv5Ho7XUqc2v1oSV_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.427577+0000", 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 42.968740576999998, 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016404327999999999, 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.402 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.427577+0000", 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.427577+0000", 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.427580+0000", 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.58e-06 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.429441+0000", 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001860504 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.429479+0000", 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8537000000000001e-05 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.429505+0000", 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5593999999999999e-05 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.429599+0000", 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4421999999999998e-05 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.429770+0000", 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171041 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.429905+0000", 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134342 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.439376+0000", 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094715019999999997 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.443884+0000", 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045078729999999999 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.443943+0000", 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8594000000000002e-05 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.443981+0000", 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8339e-05 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1216 3.e e58/31 3:734f2773:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_4:head v 58'2, mlcod=0'0)", 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.877768+0000", 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 42.518549241000002, 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020782008000000001, 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.407 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.877768+0000", 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.877768+0000", 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.877769+0000", 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1699999999999998e-07 2024-05-09T09:55:10.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.886733+0000", 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0089639730000000001 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.886781+0000", 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8792000000000003e-05 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.886809+0000", 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7287000000000001e-05 2024-05-09T09:55:10.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.886961+0000", 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015269099999999999 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.886999+0000", 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8186000000000003e-05 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.898471+0000", 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011471541 2024-05-09T09:55:10.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.898550+0000", 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9021000000000001e-05 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1220 3.31 3:8df6b82b:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:27.935465+0000", 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 42.460852696000003, 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017827922999999999, 2024-05-09T09:55:10.411 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1220 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.935465+0000", 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.935465+0000", 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.935468+0000", 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.005e-06 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.939352+0000", 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038845730000000001 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.939389+0000", 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7209999999999998e-05 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.939413+0000", 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3184e-05 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.939521+0000", 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108559 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.939732+0000", 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021065100000000001 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.939910+0000", 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017858300000000001 2024-05-09T09:55:10.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.946649+0000", 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067387560000000003 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.953185+0000", 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006535824 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.953223+0000", 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8115999999999999e-05 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:27.953293+0000", 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9461999999999993e-05 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1226 3.1a 3:584b8777:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:10.417 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.052627+0000", 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 42.343690250999998, 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018814984, 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1226 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.052627+0000", 2024-05-09T09:55:10.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.052627+0000", 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.052630+0000", 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.36e-06 2024-05-09T09:55:10.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.055434+0000", 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028034800000000001 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.055479+0000", 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5469999999999997e-05 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.055502+0000", 2024-05-09T09:55:10.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2982000000000001e-05 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.055649+0000", 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014665199999999999 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.055897+0000", 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024820300000000001 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.056203+0000", 2024-05-09T09:55:10.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000305359 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.063253+0000", 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007050738 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.071316+0000", 2024-05-09T09:55:10.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080625750000000006 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.071385+0000", 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8818000000000004e-05 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.071442+0000", 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7346999999999998e-05 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1233 3.19 3:9ae028cb:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AWtmb_JrpdQZtrLNnNpam7GgJbT_f-y_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:28.209503+0000", 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 42.186814581, 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016529833000000001, 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1233 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.209503+0000", 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.209503+0000", 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.209507+0000", 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.617e-06 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.212229+0000", 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027220439999999999 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.212292+0000", 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2365000000000003e-05 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.212313+0000", 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.173e-05 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.212453+0000", 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013975500000000001 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.212705+0000", 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025141399999999999 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.212932+0000", 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022690699999999999 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.222408+0000", 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094760820000000003 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.225728+0000", 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003320056 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.225898+0000", 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170388 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:28.226033+0000", 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000134475 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1395 3.1a 3:5a4731a0:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.969476+0000", 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.426841541000002, 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.02668181, 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1395 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.969476+0000", 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.969476+0000", 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.969479+0000", 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9069999999999999e-06 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.973908+0000", 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044289179999999996 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.973954+0000", 2024-05-09T09:55:10.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5992000000000003e-05 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.973974+0000", 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0027e-05 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.974118+0000", 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014395900000000001 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.974376+0000", 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025802699999999997 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.974612+0000", 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000236114 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.988611+0000", 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013999487999999999 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.996028+0000", 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0074164419999999997 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.996096+0000", 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7881999999999998e-05 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.996158+0000", 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2053999999999999e-05 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1396 3.3e 3:7fe59ee2:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:31.981453+0000", 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.414864280000003, 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018337480999999999, 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1396 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.981453+0000", 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.981453+0000", 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.981458+0000", 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6099999999999999e-06 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.985195+0000", 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037371520000000001 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.985248+0000", 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2989999999999999e-05 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.985274+0000", 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.601e-05 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.985426+0000", 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015194300000000001 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.985641+0000", 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000215217 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.985854+0000", 2024-05-09T09:55:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021348600000000001 2024-05-09T09:55:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.996134+0000", 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010279318000000001 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.999713+0000", 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035791080000000001 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.999748+0000", 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5608999999999997e-05 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:31.999790+0000", 2024-05-09T09:55:10.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2038e-05 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1406 3.3e 3:7e283a4c:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.214266+0000", 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.182051117999997, 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017282182, 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.444 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1406 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.214266+0000", 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.214266+0000", 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.214269+0000", 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9399999999999998e-06 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.217782+0000", 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035130169999999998 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.217824+0000", 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2129999999999998e-05 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.217846+0000", 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1489999999999999e-05 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.218067+0000", 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022134699999999999 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.218359+0000", 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029238700000000002 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.218644+0000", 2024-05-09T09:55:10.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028471399999999998 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.227486+0000", 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0088419280000000006 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231294+0000", 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038078410000000002 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231426+0000", 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201900000000001 2024-05-09T09:55:10.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.231548+0000", 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012236899999999999 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1413 3.4 3:22607d0d:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.1__shadow_.AXwrFBvQbeVFiTlKtFAXhkT1DukHiZ3_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:32.364708+0000", 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.031609172000003, 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018406559999999999, 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.449 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1413 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.364708+0000", 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.364708+0000", 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.364711+0000", 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.377e-06 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.367392+0000", 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0026808130000000002 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.367447+0000", 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4221999999999997e-05 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.367468+0000", 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1273000000000001e-05 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.367610+0000", 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141719 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.367870+0000", 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000260714 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.368147+0000", 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027630999999999999 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.378279+0000", 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010132491 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.382919+0000", 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046394699999999997 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.383017+0000", 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8632e-05 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:32.383115+0000", 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7539000000000002e-05 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.454 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:1876 3.a e65/31 3:52ea8d6a:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.QD71QSIjnzYUJvkbUpu9yZ6kMZGI2uX_1:head v 65'7, mlcod=65'5)", 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:45.774366+0000", 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 24.621950943000002, 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018785941, 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.774366+0000", 2024-05-09T09:55:10.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.774366+0000", 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.774370+0000", 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7330000000000001e-06 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.781805+0000", 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0074352250000000002 2024-05-09T09:55:10.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.781873+0000", 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7662000000000004e-05 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.781892+0000", 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9364e-05 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.782079+0000", 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018678799999999999 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.782123+0000", 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4339999999999999e-05 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.793054+0000", 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010930782999999999 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:45.793152+0000", 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8046000000000003e-05 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.458 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1910 3.25 3:a46fbbef:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.0N7dbs8x0yiFs4IMdFcnu0fXlAOB0BO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:46.447214+0000", 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.949103443999999, 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019406953000000001, 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1910 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.459 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.447214+0000", 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.447214+0000", 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.447218+0000", 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8060000000000001e-06 2024-05-09T09:55:10.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.450549+0000", 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033317080000000001 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.450590+0000", 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0166999999999997e-05 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.450605+0000", 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5444e-05 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.450699+0000", 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4037999999999996e-05 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.450847+0000", 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014760700000000001 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.450975+0000", 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012884100000000001 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.458342+0000", 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0073666649999999997 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.466520+0000", 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0081782590000000002 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.466578+0000", 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7652000000000003e-05 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.466621+0000", 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2765999999999997e-05 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.464 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1919 3.4 3:203fbf52:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:46.650385+0000", 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.745932066000002, 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.025174575000000001, 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1919 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.650385+0000", 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.650385+0000", 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.650389+0000", 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3400000000000002e-06 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.653089+0000", 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027003370000000001 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.653129+0000", 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9842999999999998e-05 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.653148+0000", 2024-05-09T09:55:10.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9389999999999999e-05 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.653329+0000", 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018129800000000001 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.653770+0000", 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044096499999999998 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.654980+0000", 2024-05-09T09:55:10.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012091249999999999 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.671291+0000", 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016311786000000002 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.675367+0000", 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040756760000000003 2024-05-09T09:55:10.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.675484+0000", 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011749200000000001 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.675560+0000", 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5322999999999997e-05 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:1925 3.4 3:233f46cf:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.33:head [create,setxattr user.rgw.idtag (61) in=14b,setxattr user.rgw.tail_tag (61) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:46.827872+0000", 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.568444931999998, 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.025205519999999999, 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1925 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.827872+0000", 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.827872+0000", 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.827875+0000", 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.832036+0000", 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041615310000000004 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.832109+0000", 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2352000000000001e-05 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.832130+0000", 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1797000000000002e-05 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.832284+0000", 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015407499999999999 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.832558+0000", 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000273198 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.833433+0000", 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087508400000000004 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.851780+0000", 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018347288999999999 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.852707+0000", 2024-05-09T09:55:10.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092650100000000004 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.852936+0000", 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022937700000000001 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:46.853078+0000", 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141996 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2108 3.31 3:8e3683f3:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.63:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:50.629333+0000", 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.766984349000001, 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017312879999999999, 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2108 2024-05-09T09:55:10.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.629333+0000", 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.629333+0000", 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.629335+0000", 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8300000000000001e-06 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.631908+0000", 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025733240000000001 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.631949+0000", 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0837000000000002e-05 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.631968+0000", 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8570999999999999e-05 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.632136+0000", 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016849700000000001 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.632426+0000", 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028977000000000001 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.633317+0000", 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089141800000000005 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.642928+0000", 2024-05-09T09:55:10.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0096107710000000006 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.646451+0000", 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035235169999999999 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.646572+0000", 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120086 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.646646+0000", 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4258999999999995e-05 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4385.0:2120 3.a e66/31 3:50dc6130:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.65:head v 66'9, mlcod=65'7)", 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:50.952929+0000", 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.443388419000001, 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016319179999999999, 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.483 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.952929+0000", 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.952929+0000", 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.952931+0000", 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4669999999999998e-06 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.958079+0000", 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051477409999999999 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.958124+0000", 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-05-09T09:55:10.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.958143+0000", 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9179999999999999e-05 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.958297+0000", 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000154458 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.958342+0000", 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4589999999999998e-05 2024-05-09T09:55:10.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.969144+0000", 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010801671000000001 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:50.969248+0000", 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104516 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.487 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2148 3.4 3:208adda8:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.68:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:51.358900+0000", 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.037417307999998, 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017569134, 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2148 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.358900+0000", 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.358900+0000", 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.358903+0000", 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.79e-06 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.361736+0000", 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028334219999999999 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.361781+0000", 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5201999999999999e-05 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.361801+0000", 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9724e-05 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.361915+0000", 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011352499999999999 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.362146+0000", 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023117499999999999 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.362885+0000", 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00073873799999999996 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.375513+0000", 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012628077999999999 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.376254+0000", 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074157900000000002 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.376370+0000", 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115519 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.376469+0000", 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9382000000000005e-05 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2158 3.25 3:a769f7ad:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2__shadow_.kmq4W5FDvTJuiVHTRZOzwfAwhKijRHW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:51.672171+0000", 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.724145999000001, 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.059174688000000003, 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.493 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2158 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.672171+0000", 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.672171+0000", 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.672175+0000", 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9299999999999996e-06 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.674488+0000", 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002312766 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.674528+0000", 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0077000000000003e-05 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.674547+0000", 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9236e-05 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.674739+0000", 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019177199999999999 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.675119+0000", 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037981199999999999 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.675509+0000", 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00039031 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.682323+0000", 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068142419999999999 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.731097+0000", 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.048773845000000003 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.731262+0000", 2024-05-09T09:55:10.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016451899999999999 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:51.731346+0000", 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4178999999999995e-05 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4385.0:2322 3.0 3:02b648cf:::846af652-2d61-464d-9ca3-942a33f04ae8.4385.2_10Mb.97:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:54:55.120532+0000", 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 15.275785552, 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024490556, 2024-05-09T09:55:10.498 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4385", 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/2286006190", 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2322 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.120532+0000", 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.120532+0000", 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.120535+0000", 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4000000000000001e-06 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.124822+0000", 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042873269999999996 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.124857+0000", 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4943000000000001e-05 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.124875+0000", 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.738e-05 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.125006+0000", 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013133200000000001 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.125323+0000", 2024-05-09T09:55:10.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031638700000000001 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.126191+0000", 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086836499999999996 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.143709+0000", 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017518288999999999 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.144601+0000", 2024-05-09T09:55:10.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00089189399999999996 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.144893+0000", 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029227099999999998 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:54:55.145022+0000", 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128968 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.503 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4964.0:556 4.f e73/62)", 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-05-09T09:55:09.465255+0000", 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.93106224900000001, 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.041211853999999999, 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.465255+0000", 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-05-09T09:55:10.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.465255+0000", 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.465255+0000", 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.03e-07 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.465259+0000", 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.377e-06 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.468187+0000", 2024-05-09T09:55:10.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029283809999999999 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.468205+0000", 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8405000000000001e-05 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.506451+0000", 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.038246005999999999 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-05-09T09:55:09.506467+0000", 2024-05-09T09:55:10.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5481999999999998e-05 2024-05-09T09:55:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-05-09T09:55:10.507 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-05-09T09:55:10.507 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:10.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-09T09:55:10.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-09T09:55:10.509 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:10.507+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:10.610 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:10.611+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:10.674 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:55:10.675 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-05-09T09:55:10.675 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-05-09T09:55:10.675 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:55:10.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-09T09:55:10.705 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-05-09T09:55:10.705 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-09T09:55:10.711 INFO:tasks.ceph.osd.5.smithi080.stderr:2024-05-09T09:55:10.709+0000 7f0df4e0f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25267) UID: 0 2024-05-09T09:55:10.731 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-05-09T09:55:10.732 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-09T09:55:10.766 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-05-09T09:55:10.766 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-09T09:55:10.799 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-05-09T09:55:10.799 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-09T09:55:10.812 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:10.811+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:10.828 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-05-09T09:55:10.829 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-09T09:55:10.855 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-05-09T09:55:10.855 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-09T09:55:10.871 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:10.871 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:10.880 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-05-09T09:55:10.880 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-09T09:55:10.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-09T09:55:10.907 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-05-09T09:55:10.907 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-09T09:55:10.913 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:10.909+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:11.015 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:11.013+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:11.054 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:11.054 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:11.074 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-09T09:55:11.115 INFO:tasks.ceph.osd.7.smithi080.stderr:2024-05-09T09:55:11.113+0000 7f3a634ae640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25271) UID: 0 2024-05-09T09:55:11.217 INFO:tasks.ceph.osd.4.smithi080.stderr:2024-05-09T09:55:11.213+0000 7fbbbab6a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25264) UID: 0 2024-05-09T09:55:11.219 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:11.219 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:11.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-09T09:55:11.318 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:11.319+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:11.374 INFO:tasks.workunit.client.0.smithi032.stdout:user 0.091500889367552 deleted 2024-05-09T09:55:11.379 INFO:tasks.workunit.client.0.smithi032.stdout:OK 2024-05-09T09:55:11.379 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T09:55:11.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T09:55:11.401 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:11.401 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:11.412 INFO:tasks.workunit:Stopping ['rgw/s3_multipart_upload.pl'] on client.0... 2024-05-09T09:55:11.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T09:55:11.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-09T09:55:11.424 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:11.423+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:11.520 INFO:tasks.ceph.osd.6.smithi080.stderr:2024-05-09T09:55:11.517+0000 7f4c1920c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25269) UID: 0 2024-05-09T09:55:11.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:55:11.621 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:11.619+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:11.621 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:11.621 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:11.642 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-09T09:55:11.721 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:11.723+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:11.781 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:11.782 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:11.796 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-09T09:55:11.822 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-05-09T09:55:11.823+0000 7fbaaa532640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25111) UID: 0 2024-05-09T09:55:11.828 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:11.828 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T09:55:11.892 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T09:55:11.892 DEBUG:teuthology.orchestra.run.smithi032:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-09T09:55:11.916 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:11.916 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:11.930 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-09T09:55:11.934 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-05-09T09:55:11.935+0000 7fcbda1c1640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25115) UID: 0 2024-05-09T09:55:11.946 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T09:55:11.946 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-05-09T09:55:11.957 INFO:tasks.thrashosds:joining thrashosds 2024-05-09T09:55:12.046 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:12.046 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:12.060 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-09T09:55:12.179 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:12.179 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:12.193 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-09T09:55:12.318 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:12.318 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:12.332 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-09T09:55:12.455 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:12.455 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:12.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-09T09:55:12.486 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:55:12.593 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:12.593 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:12.607 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-09T09:55:12.728 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:12.728 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:12.742 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-09T09:55:12.864 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:12.864 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:12.878 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-09T09:55:13.004 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:13.005 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:13.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-09T09:55:13.142 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:13.142 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:13.157 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-09T09:55:13.278 INFO:teuthology.orchestra.run.smithi080.stdout:ERROR: (22) Invalid argument 2024-05-09T09:55:13.278 INFO:teuthology.orchestra.run.smithi080.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-09T09:55:14.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-09T09:55:15.489 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-05-09T09:55:15.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-09T09:55:16.499 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-05-09T09:55:39.520 INFO:tasks.thrashosds.thrasher:inning osd 2024-05-09T09:55:39.520 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-05-09T09:55:39.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-05-09T09:55:39.841 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-05-09T09:55:39.842+0000 7fcc70e52640 -1 mon.a@0(leader).osd e78 definitely_dead 0 2024-05-09T09:55:40.424 INFO:teuthology.orchestra.run.smithi032.stderr:marked in osd.4. 2024-05-09T09:55:40.475 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-05-09T09:55:40.475 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-05-09T09:55:40.612 INFO:teuthology.orchestra.run.smithi032.stdout:mon.a: {} 2024-05-09T09:55:40.612 INFO:teuthology.orchestra.run.smithi032.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-09T09:55:40.625 INFO:teuthology.orchestra.run.smithi032.stdout:mon.b: {} 2024-05-09T09:55:40.625 INFO:teuthology.orchestra.run.smithi032.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-09T09:55:40.635 INFO:teuthology.orchestra.run.smithi032.stdout:mon.c: {} 2024-05-09T09:55:40.635 INFO:teuthology.orchestra.run.smithi032.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-09T09:55:40.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-09T09:55:41.434 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.0 to 1 (10000) 2024-05-09T09:55:41.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-05-09T09:55:42.505 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-05-09T09:55:42.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-09T09:55:43.526 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.1 to 1 (10000) 2024-05-09T09:55:43.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-05-09T09:55:44.527 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-05-09T09:55:44.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-09T09:55:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.2 to 1 (10000) 2024-05-09T09:55:45.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-05-09T09:55:46.548 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-05-09T09:55:46.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-09T09:55:47.564 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.3 to 1 (10000) 2024-05-09T09:55:47.591 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-05-09T09:55:48.586 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-05-09T09:55:48.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-09T09:55:49.594 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.4 to 1 (10000) 2024-05-09T09:55:49.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-05-09T09:55:50.607 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-05-09T09:55:50.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-09T09:55:51.628 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.5 to 1 (10000) 2024-05-09T09:55:51.654 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-05-09T09:55:52.642 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-05-09T09:55:52.672 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-09T09:55:53.652 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.6 to 1 (10000) 2024-05-09T09:55:53.680 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-05-09T09:55:54.660 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-05-09T09:55:54.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-09T09:55:55.662 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.7 to 1 (10000) 2024-05-09T09:55:55.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-05-09T09:55:56.693 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-05-09T09:55:56.721 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-05-09T09:55:56.721 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-05-09T09:55:56.721 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-05-09T09:55:56.722 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-05-09T09:55:56.722 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T09:55:56.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:55:57.035 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:55:57.036 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"ab394f08-fac0-4b9b-8c5e-bce336e83e29","created":"2024-05-09T09:52:48.405333+0000","modified":"2024-05-09T09:55:56.687899+0000","last_up_change":"2024-05-09T09:52:59.026796+0000","last_in_change":"2024-05-09T09:55:40.422563+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:52:59.315438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-09T09:52:59.577014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-09T09:53:05.894004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-09T09:53:07.438032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-09T09:53:09.330585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-09T09:53:11.250677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-09T09:53:13.151617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-09T09:53:15.304851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b6d1a399-da26-41fd-8eed-493a7286aa6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6801","nonce":396091358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6803","nonce":396091358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6807","nonce":396091358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6805","nonce":396091358}]},"public_addr":"172.21.15.32:6801/396091358","cluster_addr":"172.21.15.32:6803/396091358","heartbeat_back_addr":"172.21.15.32:6807/396091358","heartbeat_front_addr":"172.21.15.32:6805/396091358","state":["exists","up"]},{"osd":1,"uuid":"6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6825","nonce":3047693294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6827","nonce":3047693294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6831","nonce":3047693294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6829","nonce":3047693294}]},"public_addr":"172.21.15.32:6825/3047693294","cluster_addr":"172.21.15.32:6827/3047693294","heartbeat_back_addr":"172.21.15.32:6831/3047693294","heartbeat_front_addr":"172.21.15.32:6829/3047693294","state":["exists","up"]},{"osd":2,"uuid":"097e00bf-5d58-4fe5-8909-8d453783b9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6809","nonce":2852540861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6811","nonce":2852540861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6815","nonce":2852540861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6813","nonce":2852540861}]},"public_addr":"172.21.15.32:6809/2852540861","cluster_addr":"172.21.15.32:6811/2852540861","heartbeat_back_addr":"172.21.15.32:6815/2852540861","heartbeat_front_addr":"172.21.15.32:6813/2852540861","state":["exists","up"]},{"osd":3,"uuid":"ef14f326-2a6d-4bbb-9cce-e984a09db334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6817","nonce":1396699085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6819","nonce":1396699085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6823","nonce":1396699085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6821","nonce":1396699085}]},"public_addr":"172.21.15.32:6817/1396699085","cluster_addr":"172.21.15.32:6819/1396699085","heartbeat_back_addr":"172.21.15.32:6823/1396699085","heartbeat_front_addr":"172.21.15.32:6821/1396699085","state":["exists","up"]},{"osd":4,"uuid":"b609b2b6-6fec-4d82-8126-4c109f53093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6801","nonce":2270167873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6803","nonce":2270167873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6807","nonce":2270167873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6805","nonce":2270167873}]},"public_addr":"172.21.15.80:6801/2270167873","cluster_addr":"172.21.15.80:6803/2270167873","heartbeat_back_addr":"172.21.15.80:6807/2270167873","heartbeat_front_addr":"172.21.15.80:6805/2270167873","state":["exists","up"]},{"osd":5,"uuid":"a8f7aea9-0c6f-4c2e-9541-b8780d58ec01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6809","nonce":1502875008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6811","nonce":1502875008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6815","nonce":1502875008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6813","nonce":1502875008}]},"public_addr":"172.21.15.80:6809/1502875008","cluster_addr":"172.21.15.80:6811/1502875008","heartbeat_back_addr":"172.21.15.80:6815/1502875008","heartbeat_front_addr":"172.21.15.80:6813/1502875008","state":["exists","up"]},{"osd":6,"uuid":"ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6817","nonce":2011375001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6819","nonce":2011375001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6823","nonce":2011375001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6821","nonce":2011375001}]},"public_addr":"172.21.15.80:6817/2011375001","cluster_addr":"172.21.15.80:6819/2011375001","heartbeat_back_addr":"172.21.15.80:6823/2011375001","heartbeat_front_addr":"172.21.15.80:6821/2011375001","state":["exists","up"]},{"osd":7,"uuid":"777809d6-0cf6-4020-8efb-9f9df7bcea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6825","nonce":4069183898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6827","nonce":4069183898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6831","nonce":4069183898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6829","nonce":4069183898}]},"public_addr":"172.21.15.80:6825/4069183898","cluster_addr":"172.21.15.80:6827/4069183898","heartbeat_back_addr":"172.21.15.80:6831/4069183898","heartbeat_front_addr":"172.21.15.80:6829/4069183898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.252744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.355061+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.322435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.394680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.304104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.434142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.028140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.015696+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.3a","mappings":[{"from":0,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.6","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":7}]},{"pgid":"4.2b","mappings":[{"from":3,"to":5}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:55:57.055 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T09:55:57.056 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:55:57.370 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:55:57.370 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"ab394f08-fac0-4b9b-8c5e-bce336e83e29","created":"2024-05-09T09:52:48.405333+0000","modified":"2024-05-09T09:55:56.687899+0000","last_up_change":"2024-05-09T09:52:59.026796+0000","last_in_change":"2024-05-09T09:55:40.422563+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:52:59.315438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-09T09:52:59.577014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-09T09:53:05.894004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-09T09:53:07.438032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-09T09:53:09.330585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-09T09:53:11.250677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-09T09:53:13.151617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-09T09:53:15.304851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b6d1a399-da26-41fd-8eed-493a7286aa6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6801","nonce":396091358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6803","nonce":396091358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6807","nonce":396091358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6805","nonce":396091358}]},"public_addr":"172.21.15.32:6801/396091358","cluster_addr":"172.21.15.32:6803/396091358","heartbeat_back_addr":"172.21.15.32:6807/396091358","heartbeat_front_addr":"172.21.15.32:6805/396091358","state":["exists","up"]},{"osd":1,"uuid":"6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6825","nonce":3047693294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6827","nonce":3047693294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6831","nonce":3047693294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6829","nonce":3047693294}]},"public_addr":"172.21.15.32:6825/3047693294","cluster_addr":"172.21.15.32:6827/3047693294","heartbeat_back_addr":"172.21.15.32:6831/3047693294","heartbeat_front_addr":"172.21.15.32:6829/3047693294","state":["exists","up"]},{"osd":2,"uuid":"097e00bf-5d58-4fe5-8909-8d453783b9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6809","nonce":2852540861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6811","nonce":2852540861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6815","nonce":2852540861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6813","nonce":2852540861}]},"public_addr":"172.21.15.32:6809/2852540861","cluster_addr":"172.21.15.32:6811/2852540861","heartbeat_back_addr":"172.21.15.32:6815/2852540861","heartbeat_front_addr":"172.21.15.32:6813/2852540861","state":["exists","up"]},{"osd":3,"uuid":"ef14f326-2a6d-4bbb-9cce-e984a09db334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6817","nonce":1396699085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6819","nonce":1396699085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6823","nonce":1396699085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6821","nonce":1396699085}]},"public_addr":"172.21.15.32:6817/1396699085","cluster_addr":"172.21.15.32:6819/1396699085","heartbeat_back_addr":"172.21.15.32:6823/1396699085","heartbeat_front_addr":"172.21.15.32:6821/1396699085","state":["exists","up"]},{"osd":4,"uuid":"b609b2b6-6fec-4d82-8126-4c109f53093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6801","nonce":2270167873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6803","nonce":2270167873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6807","nonce":2270167873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6805","nonce":2270167873}]},"public_addr":"172.21.15.80:6801/2270167873","cluster_addr":"172.21.15.80:6803/2270167873","heartbeat_back_addr":"172.21.15.80:6807/2270167873","heartbeat_front_addr":"172.21.15.80:6805/2270167873","state":["exists","up"]},{"osd":5,"uuid":"a8f7aea9-0c6f-4c2e-9541-b8780d58ec01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6809","nonce":1502875008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6811","nonce":1502875008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6815","nonce":1502875008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6813","nonce":1502875008}]},"public_addr":"172.21.15.80:6809/1502875008","cluster_addr":"172.21.15.80:6811/1502875008","heartbeat_back_addr":"172.21.15.80:6815/1502875008","heartbeat_front_addr":"172.21.15.80:6813/1502875008","state":["exists","up"]},{"osd":6,"uuid":"ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6817","nonce":2011375001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6819","nonce":2011375001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6823","nonce":2011375001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6821","nonce":2011375001}]},"public_addr":"172.21.15.80:6817/2011375001","cluster_addr":"172.21.15.80:6819/2011375001","heartbeat_back_addr":"172.21.15.80:6823/2011375001","heartbeat_front_addr":"172.21.15.80:6821/2011375001","state":["exists","up"]},{"osd":7,"uuid":"777809d6-0cf6-4020-8efb-9f9df7bcea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6825","nonce":4069183898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6827","nonce":4069183898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6831","nonce":4069183898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6829","nonce":4069183898}]},"public_addr":"172.21.15.80:6825/4069183898","cluster_addr":"172.21.15.80:6827/4069183898","heartbeat_back_addr":"172.21.15.80:6831/4069183898","heartbeat_front_addr":"172.21.15.80:6829/4069183898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.252744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.355061+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.322435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.394680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.304104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.434142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.028140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.015696+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.3a","mappings":[{"from":0,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.6","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":7}]},{"pgid":"4.2b","mappings":[{"from":3,"to":5}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:55:57.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T09:55:57.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T09:55:57.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T09:55:57.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T09:55:57.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-09T09:55:57.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-09T09:55:57.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-09T09:55:57.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-09T09:55:57.672 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:57.673 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T09:55:57.684 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:57.684 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T09:55:57.685 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:57.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T09:55:57.686 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:57.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T09:55:57.689 INFO:teuthology.orchestra.run.smithi032.stdout:60129542184 2024-05-09T09:55:57.689 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T09:55:57.690 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:57.691 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T09:55:57.692 INFO:teuthology.orchestra.run.smithi032.stdout:60129542184 2024-05-09T09:55:57.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T09:55:57.698 INFO:teuthology.orchestra.run.smithi032.stdout:60129542184 2024-05-09T09:55:57.699 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T09:55:58.181 INFO:teuthology.orchestra.run.smithi032.stdout:60129542182 2024-05-09T09:55:58.198 INFO:teuthology.orchestra.run.smithi032.stdout:60129542182 2024-05-09T09:55:58.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.6 2024-05-09T09:55:58.217 INFO:teuthology.orchestra.run.smithi032.stdout:60129542182 2024-05-09T09:55:58.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.3 2024-05-09T09:55:58.224 INFO:teuthology.orchestra.run.smithi032.stdout:60129542182 2024-05-09T09:55:58.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.0 2024-05-09T09:55:58.247 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:58.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.7 2024-05-09T09:55:58.253 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:58.257 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:58.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542183 for osd.4 2024-05-09T09:55:58.270 INFO:teuthology.orchestra.run.smithi032.stdout:60129542182 2024-05-09T09:55:58.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542183 for osd.1 2024-05-09T09:55:58.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542183 for osd.5 2024-05-09T09:55:58.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542182 for osd.2 2024-05-09T09:55:59.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T09:55:59.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T09:55:59.247 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T09:55:59.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T09:55:59.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T09:55:59.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T09:55:59.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T09:55:59.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T09:55:59.720 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:59.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.6 2024-05-09T09:55:59.748 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:59.774 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:59.785 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:59.786 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:59.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.0 2024-05-09T09:55:59.796 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:59.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.7 2024-05-09T09:55:59.810 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:59.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.3 2024-05-09T09:55:59.817 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:59.830 INFO:teuthology.orchestra.run.smithi032.stdout:60129542184 2024-05-09T09:55:59.834 INFO:teuthology.orchestra.run.smithi032.stdout:60129542183 2024-05-09T09:55:59.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542184 for osd.4 2024-05-09T09:55:59.851 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:59.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542183 got 60129542183 for osd.2 2024-05-09T09:55:59.853 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:59.861 INFO:teuthology.orchestra.run.smithi032.stdout:60129542184 2024-05-09T09:55:59.864 INFO:teuthology.orchestra.run.smithi032.stdout:60129542184 2024-05-09T09:55:59.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542184 for osd.1 2024-05-09T09:55:59.881 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:59.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542184 for osd.5 2024-05-09T09:55:59.883 DEBUG:teuthology.parallel:result is None 2024-05-09T09:55:59.884 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-09T09:55:59.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:56:00.227 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:00.233 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:56:00.241 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-05-09T09:55:59.344532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636605482,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3772,"num_read_kb":1807243,"num_write":3328,"num_write_kb":2051082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":598,"num_bytes_recovered":1302381373,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2053,"ondisk_log_size":2053,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":531,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3471536,"kb_used_data":3205432,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":751503184,"statfs":{"total":773094113280,"available":769539260416,"internally_reserved":0,"allocated":3282362368,"data_stored":3278272936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":272354867},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.696257"},"pg_stats":[{"pgid":"3.3f","version":"73'14","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681695+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:55:55.681695+0000","last_peered":"2024-05-09T09:55:55.681695+0000","last_clean":"2024-05-09T09:55:55.681695+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:55:55.681695+0000","last_undegraded":"2024-05-09T09:55:55.681695+0000","last_fullsized":"2024-05-09T09:55:55.681695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":47116,"num_write":34,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400553+0000","last_change":"2024-05-09T09:55:41.485053+0000","last_active":"2024-05-09T09:55:57.400553+0000","last_peered":"2024-05-09T09:55:57.400553+0000","last_clean":"2024-05-09T09:55:57.400553+0000","last_became_active":"2024-05-09T09:55:41.484367+0000","last_became_peered":"2024-05-09T09:55:41.484367+0000","last_unstale":"2024-05-09T09:55:57.400553+0000","last_undegraded":"2024-05-09T09:55:57.400553+0000","last_fullsized":"2024-05-09T09:55:57.400553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:39.155356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"73'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703942+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:55:56.703942+0000","last_peered":"2024-05-09T09:55:56.703942+0000","last_clean":"2024-05-09T09:55:56.703942+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:55:56.703942+0000","last_undegraded":"2024-05-09T09:55:56.703942+0000","last_fullsized":"2024-05-09T09:55:56.703942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'40","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678333+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:55:55.678333+0000","last_peered":"2024-05-09T09:55:55.678333+0000","last_clean":"2024-05-09T09:55:55.678333+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:55:55.678333+0000","last_undegraded":"2024-05-09T09:55:55.678333+0000","last_fullsized":"2024-05-09T09:55:55.678333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"73'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705841+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:55:56.705841+0000","last_peered":"2024-05-09T09:55:56.705841+0000","last_clean":"2024-05-09T09:55:56.705841+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:55:56.705841+0000","last_undegraded":"2024-05-09T09:55:56.705841+0000","last_fullsized":"2024-05-09T09:55:56.705841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":38918,"num_write":22,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705052+0000","last_change":"2024-05-09T09:55:41.476462+0000","last_active":"2024-05-09T09:55:56.705052+0000","last_peered":"2024-05-09T09:55:56.705052+0000","last_clean":"2024-05-09T09:55:56.705052+0000","last_became_active":"2024-05-09T09:55:41.474847+0000","last_became_peered":"2024-05-09T09:55:41.474847+0000","last_unstale":"2024-05-09T09:55:56.705052+0000","last_undegraded":"2024-05-09T09:55:56.705052+0000","last_fullsized":"2024-05-09T09:55:56.705052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'10","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401959+0000","last_change":"2024-05-09T09:55:11.074408+0000","last_active":"2024-05-09T09:55:57.401959+0000","last_peered":"2024-05-09T09:55:57.401959+0000","last_clean":"2024-05-09T09:55:57.401959+0000","last_became_active":"2024-05-09T09:55:10.495355+0000","last_became_peered":"2024-05-09T09:55:10.495355+0000","last_unstale":"2024-05-09T09:55:57.401959+0000","last_undegraded":"2024-05-09T09:55:57.401959+0000","last_fullsized":"2024-05-09T09:55:57.401959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:16:55.087662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704348+0000","last_change":"2024-05-09T09:55:10.508149+0000","last_active":"2024-05-09T09:55:56.704348+0000","last_peered":"2024-05-09T09:55:56.704348+0000","last_clean":"2024-05-09T09:55:56.704348+0000","last_became_active":"2024-05-09T09:55:10.506740+0000","last_became_peered":"2024-05-09T09:55:10.506740+0000","last_unstale":"2024-05-09T09:55:56.704348+0000","last_undegraded":"2024-05-09T09:55:56.704348+0000","last_fullsized":"2024-05-09T09:55:56.704348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:15.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"67'10","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297604+0000","last_change":"2024-05-09T09:53:54.477992+0000","last_active":"2024-05-09T09:55:57.297604+0000","last_peered":"2024-05-09T09:55:57.297604+0000","last_clean":"2024-05-09T09:55:57.297604+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:55:57.297604+0000","last_undegraded":"2024-05-09T09:55:57.297604+0000","last_fullsized":"2024-05-09T09:55:57.297604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:38.501294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'14","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400463+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:55:57.400463+0000","last_peered":"2024-05-09T09:55:57.400463+0000","last_clean":"2024-05-09T09:55:57.400463+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:55:57.400463+0000","last_undegraded":"2024-05-09T09:55:57.400463+0000","last_fullsized":"2024-05-09T09:55:57.400463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:45:31.509591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":34840,"num_write":54,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'38","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706070+0000","last_change":"2024-05-09T09:55:41.723376+0000","last_active":"2024-05-09T09:55:56.706070+0000","last_peered":"2024-05-09T09:55:56.706070+0000","last_clean":"2024-05-09T09:55:56.706070+0000","last_became_active":"2024-05-09T09:55:41.470370+0000","last_became_peered":"2024-05-09T09:55:41.470370+0000","last_unstale":"2024-05-09T09:55:56.706070+0000","last_undegraded":"2024-05-09T09:55:56.706070+0000","last_fullsized":"2024-05-09T09:55:56.706070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:01.442445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"64'9","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678625+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:55:55.678625+0000","last_peered":"2024-05-09T09:55:55.678625+0000","last_clean":"2024-05-09T09:55:55.678625+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:55:55.678625+0000","last_undegraded":"2024-05-09T09:55:55.678625+0000","last_fullsized":"2024-05-09T09:55:55.678625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":34816,"num_write":9,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399784+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:55:57.399784+0000","last_peered":"2024-05-09T09:55:57.399784+0000","last_clean":"2024-05-09T09:55:57.399784+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:55:57.399784+0000","last_undegraded":"2024-05-09T09:55:57.399784+0000","last_fullsized":"2024-05-09T09:55:57.399784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'15","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677573+0000","last_change":"2024-05-09T09:55:11.513082+0000","last_active":"2024-05-09T09:55:55.677573+0000","last_peered":"2024-05-09T09:55:55.677573+0000","last_clean":"2024-05-09T09:55:55.677573+0000","last_became_active":"2024-05-09T09:55:10.517657+0000","last_became_peered":"2024-05-09T09:55:10.517657+0000","last_unstale":"2024-05-09T09:55:55.677573+0000","last_undegraded":"2024-05-09T09:55:55.677573+0000","last_fullsized":"2024-05-09T09:55:55.677573+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:28.563341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":22558,"num_write":65,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513158+0000","last_change":"2024-05-09T09:55:10.525459+0000","last_active":"2024-05-09T09:55:57.513158+0000","last_peered":"2024-05-09T09:55:57.513158+0000","last_clean":"2024-05-09T09:55:57.513158+0000","last_became_active":"2024-05-09T09:55:10.525051+0000","last_became_peered":"2024-05-09T09:55:10.525051+0000","last_unstale":"2024-05-09T09:55:57.513158+0000","last_undegraded":"2024-05-09T09:55:57.513158+0000","last_fullsized":"2024-05-09T09:55:57.513158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:08.309277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704076+0000","last_change":"2024-05-09T09:55:41.727656+0000","last_active":"2024-05-09T09:55:56.704076+0000","last_peered":"2024-05-09T09:55:56.704076+0000","last_clean":"2024-05-09T09:55:56.704076+0000","last_became_active":"2024-05-09T09:55:41.468227+0000","last_became_peered":"2024-05-09T09:55:41.468227+0000","last_unstale":"2024-05-09T09:55:56.704076+0000","last_undegraded":"2024-05-09T09:55:56.704076+0000","last_fullsized":"2024-05-09T09:55:56.704076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681714+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:55:55.681714+0000","last_peered":"2024-05-09T09:55:55.681714+0000","last_clean":"2024-05-09T09:55:55.681714+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:55:55.681714+0000","last_undegraded":"2024-05-09T09:55:55.681714+0000","last_fullsized":"2024-05-09T09:55:55.681714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678528+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:55:55.678528+0000","last_peered":"2024-05-09T09:55:55.678528+0000","last_clean":"2024-05-09T09:55:55.678528+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:55:55.678528+0000","last_undegraded":"2024-05-09T09:55:55.678528+0000","last_fullsized":"2024-05-09T09:55:55.678528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299075+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.299075+0000","last_peered":"2024-05-09T09:55:57.299075+0000","last_clean":"2024-05-09T09:55:57.299075+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:55:57.299075+0000","last_undegraded":"2024-05-09T09:55:57.299075+0000","last_fullsized":"2024-05-09T09:55:57.299075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400770+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:55:57.400770+0000","last_peered":"2024-05-09T09:55:57.400770+0000","last_clean":"2024-05-09T09:55:57.400770+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:55:57.400770+0000","last_undegraded":"2024-05-09T09:55:57.400770+0000","last_fullsized":"2024-05-09T09:55:57.400770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299149+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:55:57.299149+0000","last_peered":"2024-05-09T09:55:57.299149+0000","last_clean":"2024-05-09T09:55:57.299149+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:55:57.299149+0000","last_undegraded":"2024-05-09T09:55:57.299149+0000","last_fullsized":"2024-05-09T09:55:57.299149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512589+0000","last_change":"2024-05-09T09:55:10.502036+0000","last_active":"2024-05-09T09:55:57.512589+0000","last_peered":"2024-05-09T09:55:57.512589+0000","last_clean":"2024-05-09T09:55:57.512589+0000","last_became_active":"2024-05-09T09:55:10.501517+0000","last_became_peered":"2024-05-09T09:55:10.501517+0000","last_unstale":"2024-05-09T09:55:57.512589+0000","last_undegraded":"2024-05-09T09:55:57.512589+0000","last_fullsized":"2024-05-09T09:55:57.512589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:30.945254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"66'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705752+0000","last_change":"2024-05-09T09:55:42.549939+0000","last_active":"2024-05-09T09:55:56.705752+0000","last_peered":"2024-05-09T09:55:56.705752+0000","last_clean":"2024-05-09T09:55:56.705752+0000","last_became_active":"2024-05-09T09:55:41.517108+0000","last_became_peered":"2024-05-09T09:55:41.517108+0000","last_unstale":"2024-05-09T09:55:56.705752+0000","last_undegraded":"2024-05-09T09:55:56.705752+0000","last_fullsized":"2024-05-09T09:55:56.705752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:39.522749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511344+0000","last_change":"2024-05-09T09:55:41.495787+0000","last_active":"2024-05-09T09:55:57.511344+0000","last_peered":"2024-05-09T09:55:57.511344+0000","last_clean":"2024-05-09T09:55:57.511344+0000","last_became_active":"2024-05-09T09:55:41.495217+0000","last_became_peered":"2024-05-09T09:55:41.495217+0000","last_unstale":"2024-05-09T09:55:57.511344+0000","last_undegraded":"2024-05-09T09:55:57.511344+0000","last_fullsized":"2024-05-09T09:55:57.511344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:19.303237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"67'12","reported_seq":71,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678814+0000","last_change":"2024-05-09T09:55:11.744028+0000","last_active":"2024-05-09T09:55:55.678814+0000","last_peered":"2024-05-09T09:55:55.678814+0000","last_clean":"2024-05-09T09:55:55.678814+0000","last_became_active":"2024-05-09T09:55:10.515515+0000","last_became_peered":"2024-05-09T09:55:10.515515+0000","last_unstale":"2024-05-09T09:55:55.678814+0000","last_undegraded":"2024-05-09T09:55:55.678814+0000","last_fullsized":"2024-05-09T09:55:55.678814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:26:21.134168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":77594624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706053+0000","last_change":"2024-05-09T09:55:41.471993+0000","last_active":"2024-05-09T09:55:56.706053+0000","last_peered":"2024-05-09T09:55:56.706053+0000","last_clean":"2024-05-09T09:55:56.706053+0000","last_became_active":"2024-05-09T09:55:41.469463+0000","last_became_peered":"2024-05-09T09:55:41.469463+0000","last_unstale":"2024-05-09T09:55:56.706053+0000","last_undegraded":"2024-05-09T09:55:56.706053+0000","last_fullsized":"2024-05-09T09:55:56.706053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:09.428329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702672+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:55:56.702672+0000","last_peered":"2024-05-09T09:55:56.702672+0000","last_clean":"2024-05-09T09:55:56.702672+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:55:56.702672+0000","last_undegraded":"2024-05-09T09:55:56.702672+0000","last_fullsized":"2024-05-09T09:55:56.702672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703760+0000","last_change":"2024-05-09T09:55:41.489025+0000","last_active":"2024-05-09T09:55:56.703760+0000","last_peered":"2024-05-09T09:55:56.703760+0000","last_clean":"2024-05-09T09:55:56.703760+0000","last_became_active":"2024-05-09T09:55:41.479825+0000","last_became_peered":"2024-05-09T09:55:41.479825+0000","last_unstale":"2024-05-09T09:55:56.703760+0000","last_undegraded":"2024-05-09T09:55:56.703760+0000","last_fullsized":"2024-05-09T09:55:56.703760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677835+0000","last_change":"2024-05-09T09:55:10.499813+0000","last_active":"2024-05-09T09:55:55.677835+0000","last_peered":"2024-05-09T09:55:55.677835+0000","last_clean":"2024-05-09T09:55:55.677835+0000","last_became_active":"2024-05-09T09:55:10.499014+0000","last_became_peered":"2024-05-09T09:55:10.499014+0000","last_unstale":"2024-05-09T09:55:55.677835+0000","last_undegraded":"2024-05-09T09:55:55.677835+0000","last_fullsized":"2024-05-09T09:55:55.677835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:12.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"68'9","reported_seq":208,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680527+0000","last_change":"2024-05-09T09:55:43.099041+0000","last_active":"2024-05-09T09:55:55.680527+0000","last_peered":"2024-05-09T09:55:55.680527+0000","last_clean":"2024-05-09T09:55:55.680527+0000","last_became_active":"2024-05-09T09:55:41.507252+0000","last_became_peered":"2024-05-09T09:55:41.507252+0000","last_unstale":"2024-05-09T09:55:55.680527+0000","last_undegraded":"2024-05-09T09:55:55.680527+0000","last_fullsized":"2024-05-09T09:55:55.680527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401721+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:55:57.401721+0000","last_peered":"2024-05-09T09:55:57.401721+0000","last_clean":"2024-05-09T09:55:57.401721+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:55:57.401721+0000","last_undegraded":"2024-05-09T09:55:57.401721+0000","last_fullsized":"2024-05-09T09:55:57.401721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"73'16","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706715+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:55:56.706715+0000","last_peered":"2024-05-09T09:55:56.706715+0000","last_clean":"2024-05-09T09:55:56.706715+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:55:56.706715+0000","last_undegraded":"2024-05-09T09:55:56.706715+0000","last_fullsized":"2024-05-09T09:55:56.706715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680623+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:55:55.680623+0000","last_peered":"2024-05-09T09:55:55.680623+0000","last_clean":"2024-05-09T09:55:55.680623+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:55:55.680623+0000","last_undegraded":"2024-05-09T09:55:55.680623+0000","last_fullsized":"2024-05-09T09:55:55.680623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400280+0000","last_change":"2024-05-09T09:55:41.487851+0000","last_active":"2024-05-09T09:55:57.400280+0000","last_peered":"2024-05-09T09:55:57.400280+0000","last_clean":"2024-05-09T09:55:57.400280+0000","last_became_active":"2024-05-09T09:55:41.487060+0000","last_became_peered":"2024-05-09T09:55:41.487060+0000","last_unstale":"2024-05-09T09:55:57.400280+0000","last_undegraded":"2024-05-09T09:55:57.400280+0000","last_fullsized":"2024-05-09T09:55:57.400280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:54:51.000892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402309+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:55:57.402309+0000","last_peered":"2024-05-09T09:55:57.402309+0000","last_clean":"2024-05-09T09:55:57.402309+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:55:57.402309+0000","last_undegraded":"2024-05-09T09:55:57.402309+0000","last_fullsized":"2024-05-09T09:55:57.402309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'4","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702911+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:55:56.702911+0000","last_peered":"2024-05-09T09:55:56.702911+0000","last_clean":"2024-05-09T09:55:56.702911+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:55:56.702911+0000","last_undegraded":"2024-05-09T09:55:56.702911+0000","last_fullsized":"2024-05-09T09:55:56.702911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12294,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679625+0000","last_change":"2024-05-09T09:55:10.509010+0000","last_active":"2024-05-09T09:55:55.679625+0000","last_peered":"2024-05-09T09:55:55.679625+0000","last_clean":"2024-05-09T09:55:55.679625+0000","last_became_active":"2024-05-09T09:55:10.506778+0000","last_became_peered":"2024-05-09T09:55:10.506778+0000","last_unstale":"2024-05-09T09:55:55.679625+0000","last_undegraded":"2024-05-09T09:55:55.679625+0000","last_fullsized":"2024-05-09T09:55:55.679625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706557+0000","last_change":"2024-05-09T09:55:41.534680+0000","last_active":"2024-05-09T09:55:56.706557+0000","last_peered":"2024-05-09T09:55:56.706557+0000","last_clean":"2024-05-09T09:55:56.706557+0000","last_became_active":"2024-05-09T09:55:41.467079+0000","last_became_peered":"2024-05-09T09:55:41.467079+0000","last_unstale":"2024-05-09T09:55:56.706557+0000","last_undegraded":"2024-05-09T09:55:56.706557+0000","last_fullsized":"2024-05-09T09:55:56.706557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:22.934731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706204+0000","last_change":"2024-05-09T09:55:41.468769+0000","last_active":"2024-05-09T09:55:56.706204+0000","last_peered":"2024-05-09T09:55:56.706204+0000","last_clean":"2024-05-09T09:55:56.706204+0000","last_became_active":"2024-05-09T09:55:41.467929+0000","last_became_peered":"2024-05-09T09:55:41.467929+0000","last_unstale":"2024-05-09T09:55:56.706204+0000","last_undegraded":"2024-05-09T09:55:56.706204+0000","last_fullsized":"2024-05-09T09:55:56.706204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:02.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702279+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:55:56.702279+0000","last_peered":"2024-05-09T09:55:56.702279+0000","last_clean":"2024-05-09T09:55:56.702279+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:55:56.702279+0000","last_undegraded":"2024-05-09T09:55:56.702279+0000","last_fullsized":"2024-05-09T09:55:56.702279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705924+0000","last_change":"2024-05-09T09:55:10.483103+0000","last_active":"2024-05-09T09:55:56.705924+0000","last_peered":"2024-05-09T09:55:56.705924+0000","last_clean":"2024-05-09T09:55:56.705924+0000","last_became_active":"2024-05-09T09:55:10.482649+0000","last_became_peered":"2024-05-09T09:55:10.482649+0000","last_unstale":"2024-05-09T09:55:56.705924+0000","last_undegraded":"2024-05-09T09:55:56.705924+0000","last_fullsized":"2024-05-09T09:55:56.705924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'14","reported_seq":220,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678798+0000","last_change":"2024-05-09T09:55:45.036128+0000","last_active":"2024-05-09T09:55:55.678798+0000","last_peered":"2024-05-09T09:55:55.678798+0000","last_clean":"2024-05-09T09:55:55.678798+0000","last_became_active":"2024-05-09T09:55:41.508695+0000","last_became_peered":"2024-05-09T09:55:41.508695+0000","last_unstale":"2024-05-09T09:55:55.678798+0000","last_undegraded":"2024-05-09T09:55:55.678798+0000","last_fullsized":"2024-05-09T09:55:55.678798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":38936,"num_write":54,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680195+0000","last_change":"2024-05-09T09:55:10.510105+0000","last_active":"2024-05-09T09:55:55.680195+0000","last_peered":"2024-05-09T09:55:55.680195+0000","last_clean":"2024-05-09T09:55:55.680195+0000","last_became_active":"2024-05-09T09:55:10.508122+0000","last_became_peered":"2024-05-09T09:55:10.508122+0000","last_unstale":"2024-05-09T09:55:55.680195+0000","last_undegraded":"2024-05-09T09:55:55.680195+0000","last_fullsized":"2024-05-09T09:55:55.680195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"63'11","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511453+0000","last_change":"2024-05-09T09:55:43.116362+0000","last_active":"2024-05-09T09:55:57.511453+0000","last_peered":"2024-05-09T09:55:57.511453+0000","last_clean":"2024-05-09T09:55:57.511453+0000","last_became_active":"2024-05-09T09:55:41.506785+0000","last_became_peered":"2024-05-09T09:55:41.506785+0000","last_unstale":"2024-05-09T09:55:57.511453+0000","last_undegraded":"2024-05-09T09:55:57.511453+0000","last_fullsized":"2024-05-09T09:55:57.511453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:30.446781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"75'14","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681231+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:55:55.681231+0000","last_peered":"2024-05-09T09:55:55.681231+0000","last_clean":"2024-05-09T09:55:55.681231+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:55:55.681231+0000","last_undegraded":"2024-05-09T09:55:55.681231+0000","last_fullsized":"2024-05-09T09:55:55.681231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705111+0000","last_change":"2024-05-09T09:55:42.211684+0000","last_active":"2024-05-09T09:55:56.705111+0000","last_peered":"2024-05-09T09:55:56.705111+0000","last_clean":"2024-05-09T09:55:56.705111+0000","last_became_active":"2024-05-09T09:55:41.492528+0000","last_became_peered":"2024-05-09T09:55:41.492528+0000","last_unstale":"2024-05-09T09:55:56.705111+0000","last_undegraded":"2024-05-09T09:55:56.705111+0000","last_fullsized":"2024-05-09T09:55:56.705111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:23.272525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680947+0000","last_change":"2024-05-09T09:55:10.510510+0000","last_active":"2024-05-09T09:55:55.680947+0000","last_peered":"2024-05-09T09:55:55.680947+0000","last_clean":"2024-05-09T09:55:55.680947+0000","last_became_active":"2024-05-09T09:55:10.508721+0000","last_became_peered":"2024-05-09T09:55:10.508721+0000","last_unstale":"2024-05-09T09:55:55.680947+0000","last_undegraded":"2024-05-09T09:55:55.680947+0000","last_fullsized":"2024-05-09T09:55:55.680947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'7","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298120+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:55:57.298120+0000","last_peered":"2024-05-09T09:55:57.298120+0000","last_clean":"2024-05-09T09:55:57.298120+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:55:57.298120+0000","last_undegraded":"2024-05-09T09:55:57.298120+0000","last_fullsized":"2024-05-09T09:55:57.298120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401894+0000","last_change":"2024-05-09T09:55:10.508180+0000","last_active":"2024-05-09T09:55:57.401894+0000","last_peered":"2024-05-09T09:55:57.401894+0000","last_clean":"2024-05-09T09:55:57.401894+0000","last_became_active":"2024-05-09T09:55:10.507504+0000","last_became_peered":"2024-05-09T09:55:10.507504+0000","last_unstale":"2024-05-09T09:55:57.401894+0000","last_undegraded":"2024-05-09T09:55:57.401894+0000","last_fullsized":"2024-05-09T09:55:57.401894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:26.131778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"73'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681026+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:55:55.681026+0000","last_peered":"2024-05-09T09:55:55.681026+0000","last_clean":"2024-05-09T09:55:55.681026+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:55:55.681026+0000","last_undegraded":"2024-05-09T09:55:55.681026+0000","last_fullsized":"2024-05-09T09:55:55.681026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"75'17","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679404+0000","last_change":"2024-05-09T09:55:10.785031+0000","last_active":"2024-05-09T09:55:55.679404+0000","last_peered":"2024-05-09T09:55:55.679404+0000","last_clean":"2024-05-09T09:55:55.679404+0000","last_became_active":"2024-05-09T09:55:10.502644+0000","last_became_peered":"2024-05-09T09:55:10.502644+0000","last_unstale":"2024-05-09T09:55:55.679404+0000","last_undegraded":"2024-05-09T09:55:55.679404+0000","last_fullsized":"2024-05-09T09:55:55.679404+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:14.036784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400855+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:55:57.400855+0000","last_peered":"2024-05-09T09:55:57.400855+0000","last_clean":"2024-05-09T09:55:57.400855+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:55:57.400855+0000","last_undegraded":"2024-05-09T09:55:57.400855+0000","last_fullsized":"2024-05-09T09:55:57.400855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"75'12","reported_seq":216,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681855+0000","last_change":"2024-05-09T09:55:44.175359+0000","last_active":"2024-05-09T09:55:55.681855+0000","last_peered":"2024-05-09T09:55:55.681855+0000","last_clean":"2024-05-09T09:55:55.681855+0000","last_became_active":"2024-05-09T09:55:41.507201+0000","last_became_peered":"2024-05-09T09:55:41.507201+0000","last_unstale":"2024-05-09T09:55:55.681855+0000","last_undegraded":"2024-05-09T09:55:55.681855+0000","last_fullsized":"2024-05-09T09:55:55.681855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:07.511876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677971+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:55:55.677971+0000","last_peered":"2024-05-09T09:55:55.677971+0000","last_clean":"2024-05-09T09:55:55.677971+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:55:55.677971+0000","last_undegraded":"2024-05-09T09:55:55.677971+0000","last_fullsized":"2024-05-09T09:55:55.677971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'27","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401423+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:55:57.401423+0000","last_peered":"2024-05-09T09:55:57.401423+0000","last_clean":"2024-05-09T09:55:57.401423+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:55:57.401423+0000","last_undegraded":"2024-05-09T09:55:57.401423+0000","last_fullsized":"2024-05-09T09:55:57.401423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704309+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:55:56.704309+0000","last_peered":"2024-05-09T09:55:56.704309+0000","last_clean":"2024-05-09T09:55:56.704309+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:55:56.704309+0000","last_undegraded":"2024-05-09T09:55:56.704309+0000","last_fullsized":"2024-05-09T09:55:56.704309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401424+0000","last_change":"2024-05-09T09:55:41.485193+0000","last_active":"2024-05-09T09:55:57.401424+0000","last_peered":"2024-05-09T09:55:57.401424+0000","last_clean":"2024-05-09T09:55:57.401424+0000","last_became_active":"2024-05-09T09:55:41.484312+0000","last_became_peered":"2024-05-09T09:55:41.484312+0000","last_unstale":"2024-05-09T09:55:57.401424+0000","last_undegraded":"2024-05-09T09:55:57.401424+0000","last_fullsized":"2024-05-09T09:55:57.401424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:59.737104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704125+0000","last_change":"2024-05-09T09:55:41.479720+0000","last_active":"2024-05-09T09:55:56.704125+0000","last_peered":"2024-05-09T09:55:56.704125+0000","last_clean":"2024-05-09T09:55:56.704125+0000","last_became_active":"2024-05-09T09:55:41.472133+0000","last_became_peered":"2024-05-09T09:55:41.472133+0000","last_unstale":"2024-05-09T09:55:56.704125+0000","last_undegraded":"2024-05-09T09:55:56.704125+0000","last_fullsized":"2024-05-09T09:55:56.704125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:55.564231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"64'4","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681445+0000","last_change":"2024-05-09T09:55:44.852684+0000","last_active":"2024-05-09T09:55:55.681445+0000","last_peered":"2024-05-09T09:55:55.681445+0000","last_clean":"2024-05-09T09:55:55.681445+0000","last_became_active":"2024-05-09T09:55:41.507751+0000","last_became_peered":"2024-05-09T09:55:41.507751+0000","last_unstale":"2024-05-09T09:55:55.681445+0000","last_undegraded":"2024-05-09T09:55:55.681445+0000","last_fullsized":"2024-05-09T09:55:55.681445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:13.201219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511904+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:55:57.511904+0000","last_peered":"2024-05-09T09:55:57.511904+0000","last_clean":"2024-05-09T09:55:57.511904+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:55:57.511904+0000","last_undegraded":"2024-05-09T09:55:57.511904+0000","last_fullsized":"2024-05-09T09:55:57.511904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"73'13","reported_seq":55,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677844+0000","last_change":"2024-05-09T09:55:11.749967+0000","last_active":"2024-05-09T09:55:55.677844+0000","last_peered":"2024-05-09T09:55:55.677844+0000","last_clean":"2024-05-09T09:55:55.677844+0000","last_became_active":"2024-05-09T09:55:10.522763+0000","last_became_peered":"2024-05-09T09:55:10.522763+0000","last_unstale":"2024-05-09T09:55:55.677844+0000","last_undegraded":"2024-05-09T09:55:55.677844+0000","last_fullsized":"2024-05-09T09:55:55.677844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:03.450608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677898+0000","last_change":"2024-05-09T09:55:10.505759+0000","last_active":"2024-05-09T09:55:55.677898+0000","last_peered":"2024-05-09T09:55:55.677898+0000","last_clean":"2024-05-09T09:55:55.677898+0000","last_became_active":"2024-05-09T09:55:10.504789+0000","last_became_peered":"2024-05-09T09:55:10.504789+0000","last_unstale":"2024-05-09T09:55:55.677898+0000","last_undegraded":"2024-05-09T09:55:55.677898+0000","last_fullsized":"2024-05-09T09:55:55.677898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:53.805557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298207+0000","last_change":"2024-05-09T09:55:41.506430+0000","last_active":"2024-05-09T09:55:57.298207+0000","last_peered":"2024-05-09T09:55:57.298207+0000","last_clean":"2024-05-09T09:55:57.298207+0000","last_became_active":"2024-05-09T09:55:41.505745+0000","last_became_peered":"2024-05-09T09:55:41.505745+0000","last_unstale":"2024-05-09T09:55:57.298207+0000","last_undegraded":"2024-05-09T09:55:57.298207+0000","last_fullsized":"2024-05-09T09:55:57.298207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:18.090362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'12","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680190+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:55:55.680190+0000","last_peered":"2024-05-09T09:55:55.680190+0000","last_clean":"2024-05-09T09:55:55.680190+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:55:55.680190+0000","last_undegraded":"2024-05-09T09:55:55.680190+0000","last_fullsized":"2024-05-09T09:55:55.680190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512208+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:55:57.512208+0000","last_peered":"2024-05-09T09:55:57.512208+0000","last_clean":"2024-05-09T09:55:57.512208+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:55:57.512208+0000","last_undegraded":"2024-05-09T09:55:57.512208+0000","last_fullsized":"2024-05-09T09:55:57.512208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"73'21","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678181+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:55:55.678181+0000","last_peered":"2024-05-09T09:55:55.678181+0000","last_clean":"2024-05-09T09:55:55.678181+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:55:55.678181+0000","last_undegraded":"2024-05-09T09:55:55.678181+0000","last_fullsized":"2024-05-09T09:55:55.678181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"75'14","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700958+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:55:56.700958+0000","last_peered":"2024-05-09T09:55:56.700958+0000","last_clean":"2024-05-09T09:55:56.700958+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:55:56.700958+0000","last_undegraded":"2024-05-09T09:55:56.700958+0000","last_fullsized":"2024-05-09T09:55:56.700958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706729+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:55:56.706729+0000","last_peered":"2024-05-09T09:55:56.706729+0000","last_clean":"2024-05-09T09:55:56.706729+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:55:56.706729+0000","last_undegraded":"2024-05-09T09:55:56.706729+0000","last_fullsized":"2024-05-09T09:55:56.706729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705393+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:55:56.705393+0000","last_peered":"2024-05-09T09:55:56.705393+0000","last_clean":"2024-05-09T09:55:56.705393+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:55:56.705393+0000","last_undegraded":"2024-05-09T09:55:56.705393+0000","last_fullsized":"2024-05-09T09:55:56.705393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'12","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402227+0000","last_change":"2024-05-09T09:55:11.694165+0000","last_active":"2024-05-09T09:55:57.402227+0000","last_peered":"2024-05-09T09:55:57.402227+0000","last_clean":"2024-05-09T09:55:57.402227+0000","last_became_active":"2024-05-09T09:55:10.521894+0000","last_became_peered":"2024-05-09T09:55:10.521894+0000","last_unstale":"2024-05-09T09:55:57.402227+0000","last_undegraded":"2024-05-09T09:55:57.402227+0000","last_fullsized":"2024-05-09T09:55:57.402227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:04.661085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38924,"num_write":32,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511206+0000","last_change":"2024-05-09T09:55:41.484220+0000","last_active":"2024-05-09T09:55:57.511206+0000","last_peered":"2024-05-09T09:55:57.511206+0000","last_clean":"2024-05-09T09:55:57.511206+0000","last_became_active":"2024-05-09T09:55:41.483828+0000","last_became_peered":"2024-05-09T09:55:41.483828+0000","last_unstale":"2024-05-09T09:55:57.511206+0000","last_undegraded":"2024-05-09T09:55:57.511206+0000","last_fullsized":"2024-05-09T09:55:57.511206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:12.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701503+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:55:56.701503+0000","last_peered":"2024-05-09T09:55:56.701503+0000","last_clean":"2024-05-09T09:55:56.701503+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:55:56.701503+0000","last_undegraded":"2024-05-09T09:55:56.701503+0000","last_fullsized":"2024-05-09T09:55:56.701503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13754,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":60,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511648+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:55:57.511648+0000","last_peered":"2024-05-09T09:55:57.511648+0000","last_clean":"2024-05-09T09:55:57.511648+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:55:57.511648+0000","last_undegraded":"2024-05-09T09:55:57.511648+0000","last_fullsized":"2024-05-09T09:55:57.511648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703562+0000","last_change":"2024-05-09T09:55:10.518479+0000","last_active":"2024-05-09T09:55:56.703562+0000","last_peered":"2024-05-09T09:55:56.703562+0000","last_clean":"2024-05-09T09:55:56.703562+0000","last_became_active":"2024-05-09T09:55:10.518109+0000","last_became_peered":"2024-05-09T09:55:10.518109+0000","last_unstale":"2024-05-09T09:55:56.703562+0000","last_undegraded":"2024-05-09T09:55:56.703562+0000","last_fullsized":"2024-05-09T09:55:56.703562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705558+0000","last_change":"2024-05-09T09:55:41.491823+0000","last_active":"2024-05-09T09:55:56.705558+0000","last_peered":"2024-05-09T09:55:56.705558+0000","last_clean":"2024-05-09T09:55:56.705558+0000","last_became_active":"2024-05-09T09:55:41.488846+0000","last_became_peered":"2024-05-09T09:55:41.488846+0000","last_unstale":"2024-05-09T09:55:56.705558+0000","last_undegraded":"2024-05-09T09:55:56.705558+0000","last_fullsized":"2024-05-09T09:55:56.705558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:00.130607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"73'11","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678718+0000","last_change":"2024-05-09T09:55:10.972117+0000","last_active":"2024-05-09T09:55:55.678718+0000","last_peered":"2024-05-09T09:55:55.678718+0000","last_clean":"2024-05-09T09:55:55.678718+0000","last_became_active":"2024-05-09T09:55:10.507132+0000","last_became_peered":"2024-05-09T09:55:10.507132+0000","last_unstale":"2024-05-09T09:55:55.678718+0000","last_undegraded":"2024-05-09T09:55:55.678718+0000","last_fullsized":"2024-05-09T09:55:55.678718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:59.211608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":22550,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512533+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:55:57.512533+0000","last_peered":"2024-05-09T09:55:57.512533+0000","last_clean":"2024-05-09T09:55:57.512533+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:55:57.512533+0000","last_undegraded":"2024-05-09T09:55:57.512533+0000","last_fullsized":"2024-05-09T09:55:57.512533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"78'20","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706140+0000","last_change":"2024-05-09T09:55:42.405072+0000","last_active":"2024-05-09T09:55:56.706140+0000","last_peered":"2024-05-09T09:55:56.706140+0000","last_clean":"2024-05-09T09:55:56.706140+0000","last_became_active":"2024-05-09T09:55:41.509467+0000","last_became_peered":"2024-05-09T09:55:41.509467+0000","last_unstale":"2024-05-09T09:55:56.706140+0000","last_undegraded":"2024-05-09T09:55:56.706140+0000","last_fullsized":"2024-05-09T09:55:56.706140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:31.891322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":28,"num_write":26,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":6936,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706227+0000","last_change":"2024-05-09T09:55:10.506676+0000","last_active":"2024-05-09T09:55:56.706227+0000","last_peered":"2024-05-09T09:55:56.706227+0000","last_clean":"2024-05-09T09:55:56.706227+0000","last_became_active":"2024-05-09T09:55:10.506376+0000","last_became_peered":"2024-05-09T09:55:10.506376+0000","last_unstale":"2024-05-09T09:55:56.706227+0000","last_undegraded":"2024-05-09T09:55:56.706227+0000","last_fullsized":"2024-05-09T09:55:56.706227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:18.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"63'2","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678205+0000","last_change":"2024-05-09T09:55:11.409285+0000","last_active":"2024-05-09T09:55:55.678205+0000","last_peered":"2024-05-09T09:55:55.678205+0000","last_clean":"2024-05-09T09:55:55.678205+0000","last_became_active":"2024-05-09T09:55:10.512509+0000","last_became_peered":"2024-05-09T09:55:10.512509+0000","last_unstale":"2024-05-09T09:55:55.678205+0000","last_undegraded":"2024-05-09T09:55:55.678205+0000","last_fullsized":"2024-05-09T09:55:55.678205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:08.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706333+0000","last_change":"2024-05-09T09:55:41.477052+0000","last_active":"2024-05-09T09:55:56.706333+0000","last_peered":"2024-05-09T09:55:56.706333+0000","last_clean":"2024-05-09T09:55:56.706333+0000","last_became_active":"2024-05-09T09:55:41.471497+0000","last_became_peered":"2024-05-09T09:55:41.471497+0000","last_unstale":"2024-05-09T09:55:56.706333+0000","last_undegraded":"2024-05-09T09:55:56.706333+0000","last_fullsized":"2024-05-09T09:55:56.706333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:59:59.078912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'10","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298753+0000","last_change":"2024-05-09T09:55:42.508840+0000","last_active":"2024-05-09T09:55:57.298753+0000","last_peered":"2024-05-09T09:55:57.298753+0000","last_clean":"2024-05-09T09:55:57.298753+0000","last_became_active":"2024-05-09T09:55:41.513259+0000","last_became_peered":"2024-05-09T09:55:41.513259+0000","last_unstale":"2024-05-09T09:55:57.298753+0000","last_undegraded":"2024-05-09T09:55:57.298753+0000","last_fullsized":"2024-05-09T09:55:57.298753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703127+0000","last_change":"2024-05-09T09:55:41.505012+0000","last_active":"2024-05-09T09:55:56.703127+0000","last_peered":"2024-05-09T09:55:56.703127+0000","last_clean":"2024-05-09T09:55:56.703127+0000","last_became_active":"2024-05-09T09:55:41.504609+0000","last_became_peered":"2024-05-09T09:55:41.504609+0000","last_unstale":"2024-05-09T09:55:56.703127+0000","last_undegraded":"2024-05-09T09:55:56.703127+0000","last_fullsized":"2024-05-09T09:55:56.703127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"73'24","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512979+0000","last_change":"2024-05-09T09:55:10.818400+0000","last_active":"2024-05-09T09:55:57.512979+0000","last_peered":"2024-05-09T09:55:57.512979+0000","last_clean":"2024-05-09T09:55:57.512979+0000","last_became_active":"2024-05-09T09:55:10.520615+0000","last_became_peered":"2024-05-09T09:55:10.520615+0000","last_unstale":"2024-05-09T09:55:57.512979+0000","last_undegraded":"2024-05-09T09:55:57.512979+0000","last_fullsized":"2024-05-09T09:55:57.512979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:32.213479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":3002,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"75'14","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512957+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:55:57.512957+0000","last_peered":"2024-05-09T09:55:57.512957+0000","last_clean":"2024-05-09T09:55:57.512957+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:55:57.512957+0000","last_undegraded":"2024-05-09T09:55:57.512957+0000","last_fullsized":"2024-05-09T09:55:57.512957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702414+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:55:56.702414+0000","last_peered":"2024-05-09T09:55:56.702414+0000","last_clean":"2024-05-09T09:55:56.702414+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:55:56.702414+0000","last_undegraded":"2024-05-09T09:55:56.702414+0000","last_fullsized":"2024-05-09T09:55:56.702414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706758+0000","last_change":"2024-05-09T09:55:42.572344+0000","last_active":"2024-05-09T09:55:56.706758+0000","last_peered":"2024-05-09T09:55:56.706758+0000","last_clean":"2024-05-09T09:55:56.706758+0000","last_became_active":"2024-05-09T09:55:41.517278+0000","last_became_peered":"2024-05-09T09:55:41.517278+0000","last_unstale":"2024-05-09T09:55:56.706758+0000","last_undegraded":"2024-05-09T09:55:56.706758+0000","last_fullsized":"2024-05-09T09:55:56.706758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'12","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704482+0000","last_change":"2024-05-09T09:55:42.204305+0000","last_active":"2024-05-09T09:55:56.704482+0000","last_peered":"2024-05-09T09:55:56.704482+0000","last_clean":"2024-05-09T09:55:56.704482+0000","last_became_active":"2024-05-09T09:55:41.481490+0000","last_became_peered":"2024-05-09T09:55:41.481490+0000","last_unstale":"2024-05-09T09:55:56.704482+0000","last_undegraded":"2024-05-09T09:55:56.704482+0000","last_fullsized":"2024-05-09T09:55:56.704482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402933+0000","last_change":"2024-05-09T09:55:41.651487+0000","last_active":"2024-05-09T09:55:57.402933+0000","last_peered":"2024-05-09T09:55:57.402933+0000","last_clean":"2024-05-09T09:55:57.402933+0000","last_became_active":"2024-05-09T09:55:41.495448+0000","last_became_peered":"2024-05-09T09:55:41.495448+0000","last_unstale":"2024-05-09T09:55:57.402933+0000","last_undegraded":"2024-05-09T09:55:57.402933+0000","last_fullsized":"2024-05-09T09:55:57.402933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:09.689288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":57,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679462+0000","last_change":"2024-05-09T09:55:11.115278+0000","last_active":"2024-05-09T09:55:55.679462+0000","last_peered":"2024-05-09T09:55:55.679462+0000","last_clean":"2024-05-09T09:55:55.679462+0000","last_became_active":"2024-05-09T09:55:10.512273+0000","last_became_peered":"2024-05-09T09:55:10.512273+0000","last_unstale":"2024-05-09T09:55:55.679462+0000","last_undegraded":"2024-05-09T09:55:55.679462+0000","last_fullsized":"2024-05-09T09:55:55.679462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:23:44.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"75'14","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298672+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:55:57.298672+0000","last_peered":"2024-05-09T09:55:57.298672+0000","last_clean":"2024-05-09T09:55:57.298672+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:55:57.298672+0000","last_undegraded":"2024-05-09T09:55:57.298672+0000","last_fullsized":"2024-05-09T09:55:57.298672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705087+0000","last_change":"2024-05-09T09:55:41.475763+0000","last_active":"2024-05-09T09:55:56.705087+0000","last_peered":"2024-05-09T09:55:56.705087+0000","last_clean":"2024-05-09T09:55:56.705087+0000","last_became_active":"2024-05-09T09:55:41.474020+0000","last_became_peered":"2024-05-09T09:55:41.474020+0000","last_unstale":"2024-05-09T09:55:56.705087+0000","last_undegraded":"2024-05-09T09:55:56.705087+0000","last_fullsized":"2024-05-09T09:55:56.705087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:59.415817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"75'42","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703965+0000","last_change":"2024-05-09T09:55:11.077756+0000","last_active":"2024-05-09T09:55:56.703965+0000","last_peered":"2024-05-09T09:55:56.703965+0000","last_clean":"2024-05-09T09:55:56.703965+0000","last_became_active":"2024-05-09T09:55:10.516407+0000","last_became_peered":"2024-05-09T09:55:10.516407+0000","last_unstale":"2024-05-09T09:55:56.703965+0000","last_undegraded":"2024-05-09T09:55:56.703965+0000","last_fullsized":"2024-05-09T09:55:56.703965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:29.572431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'7","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677715+0000","last_change":"2024-05-09T09:55:11.190571+0000","last_active":"2024-05-09T09:55:55.677715+0000","last_peered":"2024-05-09T09:55:55.677715+0000","last_clean":"2024-05-09T09:55:55.677715+0000","last_became_active":"2024-05-09T09:55:10.516633+0000","last_became_peered":"2024-05-09T09:55:10.516633+0000","last_unstale":"2024-05-09T09:55:55.677715+0000","last_undegraded":"2024-05-09T09:55:55.677715+0000","last_fullsized":"2024-05-09T09:55:55.677715+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:56.816319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706539+0000","last_change":"2024-05-09T09:55:41.480580+0000","last_active":"2024-05-09T09:55:56.706539+0000","last_peered":"2024-05-09T09:55:56.706539+0000","last_clean":"2024-05-09T09:55:56.706539+0000","last_became_active":"2024-05-09T09:55:41.479634+0000","last_became_peered":"2024-05-09T09:55:41.479634+0000","last_unstale":"2024-05-09T09:55:56.706539+0000","last_undegraded":"2024-05-09T09:55:56.706539+0000","last_fullsized":"2024-05-09T09:55:56.706539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:12.037871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401416+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:55:57.401416+0000","last_peered":"2024-05-09T09:55:57.401416+0000","last_clean":"2024-05-09T09:55:57.401416+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:55:57.401416+0000","last_undegraded":"2024-05-09T09:55:57.401416+0000","last_fullsized":"2024-05-09T09:55:57.401416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298448+0000","last_change":"2024-05-09T09:55:10.503163+0000","last_active":"2024-05-09T09:55:57.298448+0000","last_peered":"2024-05-09T09:55:57.298448+0000","last_clean":"2024-05-09T09:55:57.298448+0000","last_became_active":"2024-05-09T09:55:10.501658+0000","last_became_peered":"2024-05-09T09:55:10.501658+0000","last_unstale":"2024-05-09T09:55:57.298448+0000","last_undegraded":"2024-05-09T09:55:57.298448+0000","last_fullsized":"2024-05-09T09:55:57.298448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:16.963610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704206+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:55:56.704206+0000","last_peered":"2024-05-09T09:55:56.704206+0000","last_clean":"2024-05-09T09:55:56.704206+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:55:56.704206+0000","last_undegraded":"2024-05-09T09:55:56.704206+0000","last_fullsized":"2024-05-09T09:55:56.704206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299020+0000","last_change":"2024-05-09T09:55:41.514105+0000","last_active":"2024-05-09T09:55:57.299020+0000","last_peered":"2024-05-09T09:55:57.299020+0000","last_clean":"2024-05-09T09:55:57.299020+0000","last_became_active":"2024-05-09T09:55:41.513454+0000","last_became_peered":"2024-05-09T09:55:41.513454+0000","last_unstale":"2024-05-09T09:55:57.299020+0000","last_undegraded":"2024-05-09T09:55:57.299020+0000","last_fullsized":"2024-05-09T09:55:57.299020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:12.201246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":316,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678368+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:55:55.678368+0000","last_peered":"2024-05-09T09:55:55.678368+0000","last_clean":"2024-05-09T09:55:55.678368+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:55:55.678368+0000","last_undegraded":"2024-05-09T09:55:55.678368+0000","last_fullsized":"2024-05-09T09:55:55.678368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401371+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:55:57.401371+0000","last_peered":"2024-05-09T09:55:57.401371+0000","last_clean":"2024-05-09T09:55:57.401371+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:55:57.401371+0000","last_undegraded":"2024-05-09T09:55:57.401371+0000","last_fullsized":"2024-05-09T09:55:57.401371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'10","reported_seq":65,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677799+0000","last_change":"2024-05-09T09:55:10.921973+0000","last_active":"2024-05-09T09:55:55.677799+0000","last_peered":"2024-05-09T09:55:55.677799+0000","last_clean":"2024-05-09T09:55:55.677799+0000","last_became_active":"2024-05-09T09:55:10.505428+0000","last_became_peered":"2024-05-09T09:55:10.505428+0000","last_unstale":"2024-05-09T09:55:55.677799+0000","last_undegraded":"2024-05-09T09:55:55.677799+0000","last_fullsized":"2024-05-09T09:55:55.677799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:11.081894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679490+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:55:55.679490+0000","last_peered":"2024-05-09T09:55:55.679490+0000","last_clean":"2024-05-09T09:55:55.679490+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:55:55.679490+0000","last_undegraded":"2024-05-09T09:55:55.679490+0000","last_fullsized":"2024-05-09T09:55:55.679490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'36","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402785+0000","last_change":"2024-05-09T09:55:11.706091+0000","last_active":"2024-05-09T09:55:57.402785+0000","last_peered":"2024-05-09T09:55:57.402785+0000","last_clean":"2024-05-09T09:55:57.402785+0000","last_became_active":"2024-05-09T09:55:10.522989+0000","last_became_peered":"2024-05-09T09:55:10.522989+0000","last_unstale":"2024-05-09T09:55:57.402785+0000","last_undegraded":"2024-05-09T09:55:57.402785+0000","last_fullsized":"2024-05-09T09:55:57.402785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:21.617588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":11272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706558+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:55:56.706558+0000","last_peered":"2024-05-09T09:55:56.706558+0000","last_clean":"2024-05-09T09:55:56.706558+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:55:56.706558+0000","last_undegraded":"2024-05-09T09:55:56.706558+0000","last_fullsized":"2024-05-09T09:55:56.706558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297460+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:55:57.297460+0000","last_peered":"2024-05-09T09:55:57.297460+0000","last_clean":"2024-05-09T09:55:57.297460+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:55:57.297460+0000","last_undegraded":"2024-05-09T09:55:57.297460+0000","last_fullsized":"2024-05-09T09:55:57.297460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706199+0000","last_change":"2024-05-09T09:53:54.476843+0000","last_active":"2024-05-09T09:55:56.706199+0000","last_peered":"2024-05-09T09:55:56.706199+0000","last_clean":"2024-05-09T09:55:56.706199+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:55:56.706199+0000","last_undegraded":"2024-05-09T09:55:56.706199+0000","last_fullsized":"2024-05-09T09:55:56.706199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:48.486905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678114+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:55:55.678114+0000","last_peered":"2024-05-09T09:55:55.678114+0000","last_clean":"2024-05-09T09:55:55.678114+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:55:55.678114+0000","last_undegraded":"2024-05-09T09:55:55.678114+0000","last_fullsized":"2024-05-09T09:55:55.678114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701698+0000","last_change":"2024-05-09T09:55:42.599407+0000","last_active":"2024-05-09T09:55:56.701698+0000","last_peered":"2024-05-09T09:55:56.701698+0000","last_clean":"2024-05-09T09:55:56.701698+0000","last_became_active":"2024-05-09T09:55:41.489210+0000","last_became_peered":"2024-05-09T09:55:41.489210+0000","last_unstale":"2024-05-09T09:55:56.701698+0000","last_undegraded":"2024-05-09T09:55:56.701698+0000","last_fullsized":"2024-05-09T09:55:56.701698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:36:38.674440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":7,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402446+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:55:57.402446+0000","last_peered":"2024-05-09T09:55:57.402446+0000","last_clean":"2024-05-09T09:55:57.402446+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:55:57.402446+0000","last_undegraded":"2024-05-09T09:55:57.402446+0000","last_fullsized":"2024-05-09T09:55:57.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'59","reported_seq":265,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703222+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:55:56.703222+0000","last_peered":"2024-05-09T09:55:56.703222+0000","last_clean":"2024-05-09T09:55:56.703222+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:55:56.703222+0000","last_undegraded":"2024-05-09T09:55:56.703222+0000","last_fullsized":"2024-05-09T09:55:56.703222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26264,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":86,"num_read_kb":110,"num_write":58,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681115+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:55:55.681115+0000","last_peered":"2024-05-09T09:55:55.681115+0000","last_clean":"2024-05-09T09:55:55.681115+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:55:55.681115+0000","last_undegraded":"2024-05-09T09:55:55.681115+0000","last_fullsized":"2024-05-09T09:55:55.681115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704712+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:55:56.704712+0000","last_peered":"2024-05-09T09:55:56.704712+0000","last_clean":"2024-05-09T09:55:56.704712+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:55:56.704712+0000","last_undegraded":"2024-05-09T09:55:56.704712+0000","last_fullsized":"2024-05-09T09:55:56.704712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'46","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704619+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:55:56.704619+0000","last_peered":"2024-05-09T09:55:56.704619+0000","last_clean":"2024-05-09T09:55:56.704619+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:55:56.704619+0000","last_undegraded":"2024-05-09T09:55:56.704619+0000","last_fullsized":"2024-05-09T09:55:56.704619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512113+0000","last_change":"2024-05-09T09:55:10.500785+0000","last_active":"2024-05-09T09:55:57.512113+0000","last_peered":"2024-05-09T09:55:57.512113+0000","last_clean":"2024-05-09T09:55:57.512113+0000","last_became_active":"2024-05-09T09:55:10.500197+0000","last_became_peered":"2024-05-09T09:55:10.500197+0000","last_unstale":"2024-05-09T09:55:57.512113+0000","last_undegraded":"2024-05-09T09:55:57.512113+0000","last_fullsized":"2024-05-09T09:55:57.512113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:17.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700597+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:55:56.700597+0000","last_peered":"2024-05-09T09:55:56.700597+0000","last_clean":"2024-05-09T09:55:56.700597+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:55:56.700597+0000","last_undegraded":"2024-05-09T09:55:56.700597+0000","last_fullsized":"2024-05-09T09:55:56.700597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513015+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:55:57.513015+0000","last_peered":"2024-05-09T09:55:57.513015+0000","last_clean":"2024-05-09T09:55:57.513015+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:55:57.513015+0000","last_undegraded":"2024-05-09T09:55:57.513015+0000","last_fullsized":"2024-05-09T09:55:57.513015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680934+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:55:55.680934+0000","last_peered":"2024-05-09T09:55:55.680934+0000","last_clean":"2024-05-09T09:55:55.680934+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:55:55.680934+0000","last_undegraded":"2024-05-09T09:55:55.680934+0000","last_fullsized":"2024-05-09T09:55:55.680934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704334+0000","last_change":"2024-05-09T09:55:41.486659+0000","last_active":"2024-05-09T09:55:56.704334+0000","last_peered":"2024-05-09T09:55:56.704334+0000","last_clean":"2024-05-09T09:55:56.704334+0000","last_became_active":"2024-05-09T09:55:41.486383+0000","last_became_peered":"2024-05-09T09:55:41.486383+0000","last_unstale":"2024-05-09T09:55:56.704334+0000","last_undegraded":"2024-05-09T09:55:56.704334+0000","last_fullsized":"2024-05-09T09:55:56.704334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:13.922715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"75'2","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678949+0000","last_change":"2024-05-09T09:55:44.856823+0000","last_active":"2024-05-09T09:55:55.678949+0000","last_peered":"2024-05-09T09:55:55.678949+0000","last_clean":"2024-05-09T09:55:55.678949+0000","last_became_active":"2024-05-09T09:55:41.512553+0000","last_became_peered":"2024-05-09T09:55:41.512553+0000","last_unstale":"2024-05-09T09:55:55.678949+0000","last_undegraded":"2024-05-09T09:55:55.678949+0000","last_fullsized":"2024-05-09T09:55:55.678949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401767+0000","last_change":"2024-05-09T09:54:55.401865+0000","last_active":"2024-05-09T09:55:57.401767+0000","last_peered":"2024-05-09T09:55:57.401767+0000","last_clean":"2024-05-09T09:55:57.401767+0000","last_became_active":"2024-05-09T09:54:55.401038+0000","last_became_peered":"2024-05-09T09:54:55.401038+0000","last_unstale":"2024-05-09T09:55:57.401767+0000","last_undegraded":"2024-05-09T09:55:57.401767+0000","last_fullsized":"2024-05-09T09:55:57.401767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:01.972187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399656+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:55:57.399656+0000","last_peered":"2024-05-09T09:55:57.399656+0000","last_clean":"2024-05-09T09:55:57.399656+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:55:57.399656+0000","last_undegraded":"2024-05-09T09:55:57.399656+0000","last_fullsized":"2024-05-09T09:55:57.399656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705226+0000","last_change":"2024-05-09T09:55:41.719143+0000","last_active":"2024-05-09T09:55:56.705226+0000","last_peered":"2024-05-09T09:55:56.705226+0000","last_clean":"2024-05-09T09:55:56.705226+0000","last_became_active":"2024-05-09T09:55:41.469663+0000","last_became_peered":"2024-05-09T09:55:41.469663+0000","last_unstale":"2024-05-09T09:55:56.705226+0000","last_undegraded":"2024-05-09T09:55:56.705226+0000","last_fullsized":"2024-05-09T09:55:56.705226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:45.753913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705749+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:55:56.705749+0000","last_peered":"2024-05-09T09:55:56.705749+0000","last_clean":"2024-05-09T09:55:56.705749+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:55:56.705749+0000","last_undegraded":"2024-05-09T09:55:56.705749+0000","last_fullsized":"2024-05-09T09:55:56.705749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":78,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678610+0000","last_change":"2024-05-09T09:55:42.823551+0000","last_active":"2024-05-09T09:55:55.678610+0000","last_peered":"2024-05-09T09:55:55.678610+0000","last_clean":"2024-05-09T09:55:55.678610+0000","last_became_active":"2024-05-09T09:55:41.504368+0000","last_became_peered":"2024-05-09T09:55:41.504368+0000","last_unstale":"2024-05-09T09:55:55.678610+0000","last_undegraded":"2024-05-09T09:55:55.678610+0000","last_fullsized":"2024-05-09T09:55:55.678610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:38.841317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299096+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:55:57.299096+0000","last_peered":"2024-05-09T09:55:57.299096+0000","last_clean":"2024-05-09T09:55:57.299096+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:55:57.299096+0000","last_undegraded":"2024-05-09T09:55:57.299096+0000","last_fullsized":"2024-05-09T09:55:57.299096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400161+0000","last_change":"2024-05-09T09:55:10.495545+0000","last_active":"2024-05-09T09:55:57.400161+0000","last_peered":"2024-05-09T09:55:57.400161+0000","last_clean":"2024-05-09T09:55:57.400161+0000","last_became_active":"2024-05-09T09:55:10.494741+0000","last_became_peered":"2024-05-09T09:55:10.494741+0000","last_unstale":"2024-05-09T09:55:57.400161+0000","last_undegraded":"2024-05-09T09:55:57.400161+0000","last_fullsized":"2024-05-09T09:55:57.400161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:36.220917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703539+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:55:56.703539+0000","last_peered":"2024-05-09T09:55:56.703539+0000","last_clean":"2024-05-09T09:55:56.703539+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:55:56.703539+0000","last_undegraded":"2024-05-09T09:55:56.703539+0000","last_fullsized":"2024-05-09T09:55:56.703539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'13","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402554+0000","last_change":"2024-05-09T09:55:10.791937+0000","last_active":"2024-05-09T09:55:57.402554+0000","last_peered":"2024-05-09T09:55:57.402554+0000","last_clean":"2024-05-09T09:55:57.402554+0000","last_became_active":"2024-05-09T09:55:10.494626+0000","last_became_peered":"2024-05-09T09:55:10.494626+0000","last_unstale":"2024-05-09T09:55:57.402554+0000","last_undegraded":"2024-05-09T09:55:57.402554+0000","last_fullsized":"2024-05-09T09:55:57.402554+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:06:49.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702746+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:55:56.702746+0000","last_peered":"2024-05-09T09:55:56.702746+0000","last_clean":"2024-05-09T09:55:56.702746+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:55:56.702746+0000","last_undegraded":"2024-05-09T09:55:56.702746+0000","last_fullsized":"2024-05-09T09:55:56.702746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704736+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:55:56.704736+0000","last_peered":"2024-05-09T09:55:56.704736+0000","last_clean":"2024-05-09T09:55:56.704736+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:55:56.704736+0000","last_undegraded":"2024-05-09T09:55:56.704736+0000","last_fullsized":"2024-05-09T09:55:56.704736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'32","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700571+0000","last_change":"2024-05-09T09:55:10.807327+0000","last_active":"2024-05-09T09:55:56.700571+0000","last_peered":"2024-05-09T09:55:56.700571+0000","last_clean":"2024-05-09T09:55:56.700571+0000","last_became_active":"2024-05-09T09:55:10.495540+0000","last_became_peered":"2024-05-09T09:55:10.495540+0000","last_unstale":"2024-05-09T09:55:56.700571+0000","last_undegraded":"2024-05-09T09:55:56.700571+0000","last_fullsized":"2024-05-09T09:55:56.700571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:01.735473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":3221,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704004+0000","last_change":"2024-05-09T09:55:41.499842+0000","last_active":"2024-05-09T09:55:56.704004+0000","last_peered":"2024-05-09T09:55:56.704004+0000","last_clean":"2024-05-09T09:55:56.704004+0000","last_became_active":"2024-05-09T09:55:41.496466+0000","last_became_peered":"2024-05-09T09:55:41.496466+0000","last_unstale":"2024-05-09T09:55:56.704004+0000","last_undegraded":"2024-05-09T09:55:56.704004+0000","last_fullsized":"2024-05-09T09:55:56.704004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:35.612226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706873+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:55:56.706873+0000","last_peered":"2024-05-09T09:55:56.706873+0000","last_clean":"2024-05-09T09:55:56.706873+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:55:56.706873+0000","last_undegraded":"2024-05-09T09:55:56.706873+0000","last_fullsized":"2024-05-09T09:55:56.706873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705288+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:55:56.705288+0000","last_peered":"2024-05-09T09:55:56.705288+0000","last_clean":"2024-05-09T09:55:56.705288+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:55:56.705288+0000","last_undegraded":"2024-05-09T09:55:56.705288+0000","last_fullsized":"2024-05-09T09:55:56.705288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702837+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:55:56.702837+0000","last_peered":"2024-05-09T09:55:56.702837+0000","last_clean":"2024-05-09T09:55:56.702837+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:55:56.702837+0000","last_undegraded":"2024-05-09T09:55:56.702837+0000","last_fullsized":"2024-05-09T09:55:56.702837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":22546,"num_write":39,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678937+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:55:55.678937+0000","last_peered":"2024-05-09T09:55:55.678937+0000","last_clean":"2024-05-09T09:55:55.678937+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:55:55.678937+0000","last_undegraded":"2024-05-09T09:55:55.678937+0000","last_fullsized":"2024-05-09T09:55:55.678937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298282+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:55:57.298282+0000","last_peered":"2024-05-09T09:55:57.298282+0000","last_clean":"2024-05-09T09:55:57.298282+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:55:57.298282+0000","last_undegraded":"2024-05-09T09:55:57.298282+0000","last_fullsized":"2024-05-09T09:55:57.298282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702821+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:55:56.702821+0000","last_peered":"2024-05-09T09:55:56.702821+0000","last_clean":"2024-05-09T09:55:56.702821+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:55:56.702821+0000","last_undegraded":"2024-05-09T09:55:56.702821+0000","last_fullsized":"2024-05-09T09:55:56.702821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"75'14","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400579+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:55:57.400579+0000","last_peered":"2024-05-09T09:55:57.400579+0000","last_clean":"2024-05-09T09:55:57.400579+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:55:57.400579+0000","last_undegraded":"2024-05-09T09:55:57.400579+0000","last_fullsized":"2024-05-09T09:55:57.400579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680423+0000","last_change":"2024-05-09T09:55:10.517397+0000","last_active":"2024-05-09T09:55:55.680423+0000","last_peered":"2024-05-09T09:55:55.680423+0000","last_clean":"2024-05-09T09:55:55.680423+0000","last_became_active":"2024-05-09T09:55:10.515588+0000","last_became_peered":"2024-05-09T09:55:10.515588+0000","last_unstale":"2024-05-09T09:55:55.680423+0000","last_undegraded":"2024-05-09T09:55:55.680423+0000","last_fullsized":"2024-05-09T09:55:55.680423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:07.130003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"75'44","reported_seq":54,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678017+0000","last_change":"2024-05-09T09:55:11.515278+0000","last_active":"2024-05-09T09:55:55.678017+0000","last_peered":"2024-05-09T09:55:55.678017+0000","last_clean":"2024-05-09T09:55:55.678017+0000","last_became_active":"2024-05-09T09:55:10.518766+0000","last_became_peered":"2024-05-09T09:55:10.518766+0000","last_unstale":"2024-05-09T09:55:55.678017+0000","last_undegraded":"2024-05-09T09:55:55.678017+0000","last_fullsized":"2024-05-09T09:55:55.678017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:19.443320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":112,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'13","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680753+0000","last_change":"2024-05-09T09:55:11.060481+0000","last_active":"2024-05-09T09:55:55.680753+0000","last_peered":"2024-05-09T09:55:55.680753+0000","last_clean":"2024-05-09T09:55:55.680753+0000","last_became_active":"2024-05-09T09:55:10.509265+0000","last_became_peered":"2024-05-09T09:55:10.509265+0000","last_unstale":"2024-05-09T09:55:55.680753+0000","last_undegraded":"2024-05-09T09:55:55.680753+0000","last_fullsized":"2024-05-09T09:55:55.680753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:58:29.838618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":16398,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704209+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:55:56.704209+0000","last_peered":"2024-05-09T09:55:56.704209+0000","last_clean":"2024-05-09T09:55:56.704209+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:55:56.704209+0000","last_undegraded":"2024-05-09T09:55:56.704209+0000","last_fullsized":"2024-05-09T09:55:56.704209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704461+0000","last_change":"2024-05-09T09:55:41.502710+0000","last_active":"2024-05-09T09:55:56.704461+0000","last_peered":"2024-05-09T09:55:56.704461+0000","last_clean":"2024-05-09T09:55:56.704461+0000","last_became_active":"2024-05-09T09:55:41.498766+0000","last_became_peered":"2024-05-09T09:55:41.498766+0000","last_unstale":"2024-05-09T09:55:56.704461+0000","last_undegraded":"2024-05-09T09:55:56.704461+0000","last_fullsized":"2024-05-09T09:55:56.704461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:11.800372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705353+0000","last_change":"2024-05-09T09:55:42.422831+0000","last_active":"2024-05-09T09:55:56.705353+0000","last_peered":"2024-05-09T09:55:56.705353+0000","last_clean":"2024-05-09T09:55:56.705353+0000","last_became_active":"2024-05-09T09:55:41.513003+0000","last_became_peered":"2024-05-09T09:55:41.513003+0000","last_unstale":"2024-05-09T09:55:56.705353+0000","last_undegraded":"2024-05-09T09:55:56.705353+0000","last_fullsized":"2024-05-09T09:55:56.705353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:07.499148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"75'17","reported_seq":64,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678372+0000","last_change":"2024-05-09T09:55:10.808760+0000","last_active":"2024-05-09T09:55:55.678372+0000","last_peered":"2024-05-09T09:55:55.678372+0000","last_clean":"2024-05-09T09:55:55.678372+0000","last_became_active":"2024-05-09T09:55:10.505477+0000","last_became_peered":"2024-05-09T09:55:10.505477+0000","last_unstale":"2024-05-09T09:55:55.678372+0000","last_undegraded":"2024-05-09T09:55:55.678372+0000","last_fullsized":"2024-05-09T09:55:55.678372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:21.462968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704510+0000","last_change":"2024-05-09T09:55:10.495913+0000","last_active":"2024-05-09T09:55:56.704510+0000","last_peered":"2024-05-09T09:55:56.704510+0000","last_clean":"2024-05-09T09:55:56.704510+0000","last_became_active":"2024-05-09T09:55:10.494445+0000","last_became_peered":"2024-05-09T09:55:10.494445+0000","last_unstale":"2024-05-09T09:55:56.704510+0000","last_undegraded":"2024-05-09T09:55:56.704510+0000","last_fullsized":"2024-05-09T09:55:56.704510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:58.669871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'10","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704782+0000","last_change":"2024-05-09T09:55:42.207577+0000","last_active":"2024-05-09T09:55:56.704782+0000","last_peered":"2024-05-09T09:55:56.704782+0000","last_clean":"2024-05-09T09:55:56.704782+0000","last_became_active":"2024-05-09T09:55:41.480316+0000","last_became_peered":"2024-05-09T09:55:41.480316+0000","last_unstale":"2024-05-09T09:55:56.704782+0000","last_undegraded":"2024-05-09T09:55:56.704782+0000","last_fullsized":"2024-05-09T09:55:56.704782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705886+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:55:56.705886+0000","last_peered":"2024-05-09T09:55:56.705886+0000","last_clean":"2024-05-09T09:55:56.705886+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:55:56.705886+0000","last_undegraded":"2024-05-09T09:55:56.705886+0000","last_fullsized":"2024-05-09T09:55:56.705886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299647+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:55:57.299647+0000","last_peered":"2024-05-09T09:55:57.299647+0000","last_clean":"2024-05-09T09:55:57.299647+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:55:57.299647+0000","last_undegraded":"2024-05-09T09:55:57.299647+0000","last_fullsized":"2024-05-09T09:55:57.299647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678079+0000","last_change":"2024-05-09T09:55:10.517926+0000","last_active":"2024-05-09T09:55:55.678079+0000","last_peered":"2024-05-09T09:55:55.678079+0000","last_clean":"2024-05-09T09:55:55.678079+0000","last_became_active":"2024-05-09T09:55:10.505544+0000","last_became_peered":"2024-05-09T09:55:10.505544+0000","last_unstale":"2024-05-09T09:55:55.678079+0000","last_undegraded":"2024-05-09T09:55:55.678079+0000","last_fullsized":"2024-05-09T09:55:55.678079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:13.161392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'38","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678245+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:55:55.678245+0000","last_peered":"2024-05-09T09:55:55.678245+0000","last_clean":"2024-05-09T09:55:55.678245+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:55:55.678245+0000","last_undegraded":"2024-05-09T09:55:55.678245+0000","last_fullsized":"2024-05-09T09:55:55.678245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":51,"num_write":36,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677635+0000","last_change":"2024-05-09T09:55:10.498516+0000","last_active":"2024-05-09T09:55:55.677635+0000","last_peered":"2024-05-09T09:55:55.677635+0000","last_clean":"2024-05-09T09:55:55.677635+0000","last_became_active":"2024-05-09T09:55:10.498080+0000","last_became_peered":"2024-05-09T09:55:10.498080+0000","last_unstale":"2024-05-09T09:55:55.677635+0000","last_undegraded":"2024-05-09T09:55:55.677635+0000","last_fullsized":"2024-05-09T09:55:55.677635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:21.659232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'2","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401538+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:55:57.401538+0000","last_peered":"2024-05-09T09:55:57.401538+0000","last_clean":"2024-05-09T09:55:57.401538+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:55:57.401538+0000","last_undegraded":"2024-05-09T09:55:57.401538+0000","last_fullsized":"2024-05-09T09:55:57.401538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706114+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:55:56.706114+0000","last_peered":"2024-05-09T09:55:56.706114+0000","last_clean":"2024-05-09T09:55:56.706114+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:55:56.706114+0000","last_undegraded":"2024-05-09T09:55:56.706114+0000","last_fullsized":"2024-05-09T09:55:56.706114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704880+0000","last_change":"2024-05-09T09:55:42.429944+0000","last_active":"2024-05-09T09:55:56.704880+0000","last_peered":"2024-05-09T09:55:56.704880+0000","last_clean":"2024-05-09T09:55:56.704880+0000","last_became_active":"2024-05-09T09:55:41.516290+0000","last_became_peered":"2024-05-09T09:55:41.516290+0000","last_unstale":"2024-05-09T09:55:56.704880+0000","last_undegraded":"2024-05-09T09:55:56.704880+0000","last_fullsized":"2024-05-09T09:55:56.704880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:59.070546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706067+0000","last_change":"2024-05-09T09:55:42.380229+0000","last_active":"2024-05-09T09:55:56.706067+0000","last_peered":"2024-05-09T09:55:56.706067+0000","last_clean":"2024-05-09T09:55:56.706067+0000","last_became_active":"2024-05-09T09:55:41.489973+0000","last_became_peered":"2024-05-09T09:55:41.489973+0000","last_unstale":"2024-05-09T09:55:56.706067+0000","last_undegraded":"2024-05-09T09:55:56.706067+0000","last_fullsized":"2024-05-09T09:55:56.706067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":30736,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703216+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:55:56.703216+0000","last_peered":"2024-05-09T09:55:56.703216+0000","last_clean":"2024-05-09T09:55:56.703216+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:55:56.703216+0000","last_undegraded":"2024-05-09T09:55:56.703216+0000","last_fullsized":"2024-05-09T09:55:56.703216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"73'19","reported_seq":57,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677531+0000","last_change":"2024-05-09T09:55:10.932387+0000","last_active":"2024-05-09T09:55:55.677531+0000","last_peered":"2024-05-09T09:55:55.677531+0000","last_clean":"2024-05-09T09:55:55.677531+0000","last_became_active":"2024-05-09T09:55:10.507307+0000","last_became_peered":"2024-05-09T09:55:10.507307+0000","last_unstale":"2024-05-09T09:55:55.677531+0000","last_undegraded":"2024-05-09T09:55:55.677531+0000","last_fullsized":"2024-05-09T09:55:55.677531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:44.904375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":29,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678261+0000","last_change":"2024-05-09T09:55:10.519133+0000","last_active":"2024-05-09T09:55:55.678261+0000","last_peered":"2024-05-09T09:55:55.678261+0000","last_clean":"2024-05-09T09:55:55.678261+0000","last_became_active":"2024-05-09T09:55:10.518305+0000","last_became_peered":"2024-05-09T09:55:10.518305+0000","last_unstale":"2024-05-09T09:55:55.678261+0000","last_undegraded":"2024-05-09T09:55:55.678261+0000","last_fullsized":"2024-05-09T09:55:55.678261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:56.110070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678909+0000","last_change":"2024-05-09T09:55:10.505287+0000","last_active":"2024-05-09T09:55:55.678909+0000","last_peered":"2024-05-09T09:55:55.678909+0000","last_clean":"2024-05-09T09:55:55.678909+0000","last_became_active":"2024-05-09T09:55:10.504822+0000","last_became_peered":"2024-05-09T09:55:10.504822+0000","last_unstale":"2024-05-09T09:55:55.678909+0000","last_undegraded":"2024-05-09T09:55:55.678909+0000","last_fullsized":"2024-05-09T09:55:55.678909+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:26.980095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677938+0000","last_change":"2024-05-09T09:54:55.399423+0000","last_active":"2024-05-09T09:55:55.677938+0000","last_peered":"2024-05-09T09:55:55.677938+0000","last_clean":"2024-05-09T09:55:55.677938+0000","last_became_active":"2024-05-09T09:54:55.398970+0000","last_became_peered":"2024-05-09T09:54:55.398970+0000","last_unstale":"2024-05-09T09:55:55.677938+0000","last_undegraded":"2024-05-09T09:55:55.677938+0000","last_fullsized":"2024-05-09T09:55:55.677938+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"75'10","reported_seq":214,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680282+0000","last_change":"2024-05-09T09:55:10.626412+0000","last_active":"2024-05-09T09:55:55.680282+0000","last_peered":"2024-05-09T09:55:55.680282+0000","last_clean":"2024-05-09T09:55:55.680282+0000","last_became_active":"2024-05-09T09:55:10.499847+0000","last_became_peered":"2024-05-09T09:55:10.499847+0000","last_unstale":"2024-05-09T09:55:55.680282+0000","last_undegraded":"2024-05-09T09:55:55.680282+0000","last_fullsized":"2024-05-09T09:55:55.680282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678545+0000","last_change":"2024-05-09T09:55:10.508325+0000","last_active":"2024-05-09T09:55:55.678545+0000","last_peered":"2024-05-09T09:55:55.678545+0000","last_clean":"2024-05-09T09:55:55.678545+0000","last_became_active":"2024-05-09T09:55:10.506831+0000","last_became_peered":"2024-05-09T09:55:10.506831+0000","last_unstale":"2024-05-09T09:55:55.678545+0000","last_undegraded":"2024-05-09T09:55:55.678545+0000","last_fullsized":"2024-05-09T09:55:55.678545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:03.449411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700895+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:55:56.700895+0000","last_peered":"2024-05-09T09:55:56.700895+0000","last_clean":"2024-05-09T09:55:56.700895+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:55:56.700895+0000","last_undegraded":"2024-05-09T09:55:56.700895+0000","last_fullsized":"2024-05-09T09:55:56.700895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678249+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:55:55.678249+0000","last_peered":"2024-05-09T09:55:55.678249+0000","last_clean":"2024-05-09T09:55:55.678249+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:55:55.678249+0000","last_undegraded":"2024-05-09T09:55:55.678249+0000","last_fullsized":"2024-05-09T09:55:55.678249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700775+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:55:56.700775+0000","last_peered":"2024-05-09T09:55:56.700775+0000","last_clean":"2024-05-09T09:55:56.700775+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:55:56.700775+0000","last_undegraded":"2024-05-09T09:55:56.700775+0000","last_fullsized":"2024-05-09T09:55:56.700775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678064+0000","last_change":"2024-05-09T09:55:10.514293+0000","last_active":"2024-05-09T09:55:55.678064+0000","last_peered":"2024-05-09T09:55:55.678064+0000","last_clean":"2024-05-09T09:55:55.678064+0000","last_became_active":"2024-05-09T09:55:10.513915+0000","last_became_peered":"2024-05-09T09:55:10.513915+0000","last_unstale":"2024-05-09T09:55:55.678064+0000","last_undegraded":"2024-05-09T09:55:55.678064+0000","last_fullsized":"2024-05-09T09:55:55.678064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:03.485055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"66'9","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402201+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:55:57.402201+0000","last_peered":"2024-05-09T09:55:57.402201+0000","last_clean":"2024-05-09T09:55:57.402201+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:55:57.402201+0000","last_undegraded":"2024-05-09T09:55:57.402201+0000","last_fullsized":"2024-05-09T09:55:57.402201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677514+0000","last_change":"2024-05-09T09:55:42.066725+0000","last_active":"2024-05-09T09:55:55.677514+0000","last_peered":"2024-05-09T09:55:55.677514+0000","last_clean":"2024-05-09T09:55:55.677514+0000","last_became_active":"2024-05-09T09:55:41.506927+0000","last_became_peered":"2024-05-09T09:55:41.506927+0000","last_unstale":"2024-05-09T09:55:55.677514+0000","last_undegraded":"2024-05-09T09:55:55.677514+0000","last_fullsized":"2024-05-09T09:55:55.677514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'21","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678632+0000","last_change":"2024-05-09T09:55:11.122289+0000","last_active":"2024-05-09T09:55:55.678632+0000","last_peered":"2024-05-09T09:55:55.678632+0000","last_clean":"2024-05-09T09:55:55.678632+0000","last_became_active":"2024-05-09T09:55:10.507511+0000","last_became_peered":"2024-05-09T09:55:10.507511+0000","last_unstale":"2024-05-09T09:55:55.678632+0000","last_undegraded":"2024-05-09T09:55:55.678632+0000","last_fullsized":"2024-05-09T09:55:55.678632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:29.227840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12481,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":39,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297997+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:55:57.297997+0000","last_peered":"2024-05-09T09:55:57.297997+0000","last_clean":"2024-05-09T09:55:57.297997+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:55:57.297997+0000","last_undegraded":"2024-05-09T09:55:57.297997+0000","last_fullsized":"2024-05-09T09:55:57.297997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401098+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:55:57.401098+0000","last_peered":"2024-05-09T09:55:57.401098+0000","last_clean":"2024-05-09T09:55:57.401098+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:55:57.401098+0000","last_undegraded":"2024-05-09T09:55:57.401098+0000","last_fullsized":"2024-05-09T09:55:57.401098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'38","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677841+0000","last_change":"2024-05-09T09:55:11.526822+0000","last_active":"2024-05-09T09:55:55.677841+0000","last_peered":"2024-05-09T09:55:55.677841+0000","last_clean":"2024-05-09T09:55:55.677841+0000","last_became_active":"2024-05-09T09:55:10.520941+0000","last_became_peered":"2024-05-09T09:55:10.520941+0000","last_unstale":"2024-05-09T09:55:55.677841+0000","last_undegraded":"2024-05-09T09:55:55.677841+0000","last_fullsized":"2024-05-09T09:55:55.677841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:25.981081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706483+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:55:56.706483+0000","last_peered":"2024-05-09T09:55:56.706483+0000","last_clean":"2024-05-09T09:55:56.706483+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:55:56.706483+0000","last_undegraded":"2024-05-09T09:55:56.706483+0000","last_fullsized":"2024-05-09T09:55:56.706483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298179+0000","last_change":"2024-05-09T09:55:41.515909+0000","last_active":"2024-05-09T09:55:57.298179+0000","last_peered":"2024-05-09T09:55:57.298179+0000","last_clean":"2024-05-09T09:55:57.298179+0000","last_became_active":"2024-05-09T09:55:41.514849+0000","last_became_peered":"2024-05-09T09:55:41.514849+0000","last_unstale":"2024-05-09T09:55:57.298179+0000","last_undegraded":"2024-05-09T09:55:57.298179+0000","last_fullsized":"2024-05-09T09:55:57.298179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:02.137573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"73'15","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678379+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:55:55.678379+0000","last_peered":"2024-05-09T09:55:55.678379+0000","last_clean":"2024-05-09T09:55:55.678379+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:55:55.678379+0000","last_undegraded":"2024-05-09T09:55:55.678379+0000","last_fullsized":"2024-05-09T09:55:55.678379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703964+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:55:56.703964+0000","last_peered":"2024-05-09T09:55:56.703964+0000","last_clean":"2024-05-09T09:55:56.703964+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:55:56.703964+0000","last_undegraded":"2024-05-09T09:55:56.703964+0000","last_fullsized":"2024-05-09T09:55:56.703964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299559+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:55:57.299559+0000","last_peered":"2024-05-09T09:55:57.299559+0000","last_clean":"2024-05-09T09:55:57.299559+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:55:57.299559+0000","last_undegraded":"2024-05-09T09:55:57.299559+0000","last_fullsized":"2024-05-09T09:55:57.299559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"67'11","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511830+0000","last_change":"2024-05-09T09:55:55.809479+0000","last_active":"2024-05-09T09:55:57.511830+0000","last_peered":"2024-05-09T09:55:57.511830+0000","last_clean":"2024-05-09T09:55:57.511830+0000","last_became_active":"2024-05-09T09:55:55.677234+0000","last_became_peered":"2024-05-09T09:55:55.677234+0000","last_unstale":"2024-05-09T09:55:57.511830+0000","last_undegraded":"2024-05-09T09:55:57.511830+0000","last_fullsized":"2024-05-09T09:55:57.511830+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:44.116858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706475+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:55:56.706475+0000","last_peered":"2024-05-09T09:55:56.706475+0000","last_clean":"2024-05-09T09:55:56.706475+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:55:56.706475+0000","last_undegraded":"2024-05-09T09:55:56.706475+0000","last_fullsized":"2024-05-09T09:55:56.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"73'26","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704104+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:55:56.704104+0000","last_peered":"2024-05-09T09:55:56.704104+0000","last_clean":"2024-05-09T09:55:56.704104+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:55:56.704104+0000","last_undegraded":"2024-05-09T09:55:56.704104+0000","last_fullsized":"2024-05-09T09:55:56.704104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401447+0000","last_change":"2024-05-09T09:55:10.495749+0000","last_active":"2024-05-09T09:55:57.401447+0000","last_peered":"2024-05-09T09:55:57.401447+0000","last_clean":"2024-05-09T09:55:57.401447+0000","last_became_active":"2024-05-09T09:55:10.494186+0000","last_became_peered":"2024-05-09T09:55:10.494186+0000","last_unstale":"2024-05-09T09:55:57.401447+0000","last_undegraded":"2024-05-09T09:55:57.401447+0000","last_fullsized":"2024-05-09T09:55:57.401447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:53:44.097211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678433+0000","last_change":"2024-05-09T09:55:10.505728+0000","last_active":"2024-05-09T09:55:55.678433+0000","last_peered":"2024-05-09T09:55:55.678433+0000","last_clean":"2024-05-09T09:55:55.678433+0000","last_became_active":"2024-05-09T09:55:10.504907+0000","last_became_peered":"2024-05-09T09:55:10.504907+0000","last_unstale":"2024-05-09T09:55:55.678433+0000","last_undegraded":"2024-05-09T09:55:55.678433+0000","last_fullsized":"2024-05-09T09:55:55.678433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:34.895344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706201+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:55:56.706201+0000","last_peered":"2024-05-09T09:55:56.706201+0000","last_clean":"2024-05-09T09:55:56.706201+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:55:56.706201+0000","last_undegraded":"2024-05-09T09:55:56.706201+0000","last_fullsized":"2024-05-09T09:55:56.706201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"67'3","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701843+0000","last_change":"2024-05-09T09:55:10.559316+0000","last_active":"2024-05-09T09:55:56.701843+0000","last_peered":"2024-05-09T09:55:56.701843+0000","last_clean":"2024-05-09T09:55:56.701843+0000","last_became_active":"2024-05-09T09:55:10.497596+0000","last_became_peered":"2024-05-09T09:55:10.497596+0000","last_unstale":"2024-05-09T09:55:56.701843+0000","last_undegraded":"2024-05-09T09:55:56.701843+0000","last_fullsized":"2024-05-09T09:55:56.701843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299240+0000","last_change":"2024-05-09T09:55:41.513826+0000","last_active":"2024-05-09T09:55:57.299240+0000","last_peered":"2024-05-09T09:55:57.299240+0000","last_clean":"2024-05-09T09:55:57.299240+0000","last_became_active":"2024-05-09T09:55:41.513248+0000","last_became_peered":"2024-05-09T09:55:41.513248+0000","last_unstale":"2024-05-09T09:55:57.299240+0000","last_undegraded":"2024-05-09T09:55:57.299240+0000","last_fullsized":"2024-05-09T09:55:57.299240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:15.704381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"73'27","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679109+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:55:55.679109+0000","last_peered":"2024-05-09T09:55:55.679109+0000","last_clean":"2024-05-09T09:55:55.679109+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:55:55.679109+0000","last_undegraded":"2024-05-09T09:55:55.679109+0000","last_fullsized":"2024-05-09T09:55:55.679109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8545,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":54,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703868+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:55:56.703868+0000","last_peered":"2024-05-09T09:55:56.703868+0000","last_clean":"2024-05-09T09:55:56.703868+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:55:56.703868+0000","last_undegraded":"2024-05-09T09:55:56.703868+0000","last_fullsized":"2024-05-09T09:55:56.703868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"63'4","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297673+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:55:57.297673+0000","last_peered":"2024-05-09T09:55:57.297673+0000","last_clean":"2024-05-09T09:55:57.297673+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:55:57.297673+0000","last_undegraded":"2024-05-09T09:55:57.297673+0000","last_fullsized":"2024-05-09T09:55:57.297673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678402+0000","last_change":"2024-05-09T09:55:10.500134+0000","last_active":"2024-05-09T09:55:55.678402+0000","last_peered":"2024-05-09T09:55:55.678402+0000","last_clean":"2024-05-09T09:55:55.678402+0000","last_became_active":"2024-05-09T09:55:10.499690+0000","last_became_peered":"2024-05-09T09:55:10.499690+0000","last_unstale":"2024-05-09T09:55:55.678402+0000","last_undegraded":"2024-05-09T09:55:55.678402+0000","last_fullsized":"2024-05-09T09:55:55.678402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"66'13","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704696+0000","last_change":"2024-05-09T09:55:42.033924+0000","last_active":"2024-05-09T09:55:56.704696+0000","last_peered":"2024-05-09T09:55:56.704696+0000","last_clean":"2024-05-09T09:55:56.704696+0000","last_became_active":"2024-05-09T09:55:41.481073+0000","last_became_peered":"2024-05-09T09:55:41.481073+0000","last_unstale":"2024-05-09T09:55:56.704696+0000","last_undegraded":"2024-05-09T09:55:56.704696+0000","last_fullsized":"2024-05-09T09:55:56.704696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:48.598565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":45062,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706054+0000","last_change":"2024-05-09T09:55:41.513074+0000","last_active":"2024-05-09T09:55:56.706054+0000","last_peered":"2024-05-09T09:55:56.706054+0000","last_clean":"2024-05-09T09:55:56.706054+0000","last_became_active":"2024-05-09T09:55:41.512431+0000","last_became_peered":"2024-05-09T09:55:41.512431+0000","last_unstale":"2024-05-09T09:55:56.706054+0000","last_undegraded":"2024-05-09T09:55:56.706054+0000","last_fullsized":"2024-05-09T09:55:56.706054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:14.565690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"73'20","reported_seq":57,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680285+0000","last_change":"2024-05-09T09:55:11.526104+0000","last_active":"2024-05-09T09:55:55.680285+0000","last_peered":"2024-05-09T09:55:55.680285+0000","last_clean":"2024-05-09T09:55:55.680285+0000","last_became_active":"2024-05-09T09:55:10.517760+0000","last_became_peered":"2024-05-09T09:55:10.517760+0000","last_unstale":"2024-05-09T09:55:55.680285+0000","last_undegraded":"2024-05-09T09:55:55.680285+0000","last_fullsized":"2024-05-09T09:55:55.680285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:24.084847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":34,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703148+0000","last_change":"2024-05-09T09:55:10.485758+0000","last_active":"2024-05-09T09:55:56.703148+0000","last_peered":"2024-05-09T09:55:56.703148+0000","last_clean":"2024-05-09T09:55:56.703148+0000","last_became_active":"2024-05-09T09:55:10.485167+0000","last_became_peered":"2024-05-09T09:55:10.485167+0000","last_unstale":"2024-05-09T09:55:56.703148+0000","last_undegraded":"2024-05-09T09:55:56.703148+0000","last_fullsized":"2024-05-09T09:55:56.703148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:16.070700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400396+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:55:57.400396+0000","last_peered":"2024-05-09T09:55:57.400396+0000","last_clean":"2024-05-09T09:55:57.400396+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:55:57.400396+0000","last_undegraded":"2024-05-09T09:55:57.400396+0000","last_fullsized":"2024-05-09T09:55:57.400396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511241+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:55:57.511241+0000","last_peered":"2024-05-09T09:55:57.511241+0000","last_clean":"2024-05-09T09:55:57.511241+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:55:57.511241+0000","last_undegraded":"2024-05-09T09:55:57.511241+0000","last_fullsized":"2024-05-09T09:55:57.511241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'10","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704163+0000","last_change":"2024-05-09T09:55:41.638527+0000","last_active":"2024-05-09T09:55:56.704163+0000","last_peered":"2024-05-09T09:55:56.704163+0000","last_clean":"2024-05-09T09:55:56.704163+0000","last_became_active":"2024-05-09T09:55:41.470350+0000","last_became_peered":"2024-05-09T09:55:41.470350+0000","last_unstale":"2024-05-09T09:55:56.704163+0000","last_undegraded":"2024-05-09T09:55:56.704163+0000","last_fullsized":"2024-05-09T09:55:56.704163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:55:41.504749+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:55:41.504290+0000","last_became_peered":"2024-05-09T09:55:41.504290+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706444+0000","last_change":"2024-05-09T09:55:42.568315+0000","last_active":"2024-05-09T09:55:56.706444+0000","last_peered":"2024-05-09T09:55:56.706444+0000","last_clean":"2024-05-09T09:55:56.706444+0000","last_became_active":"2024-05-09T09:55:41.517072+0000","last_became_peered":"2024-05-09T09:55:41.517072+0000","last_unstale":"2024-05-09T09:55:56.706444+0000","last_undegraded":"2024-05-09T09:55:56.706444+0000","last_fullsized":"2024-05-09T09:55:56.706444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:54.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"80'19","reported_seq":242,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299355+0000","last_change":"2024-05-09T09:55:44.549663+0000","last_active":"2024-05-09T09:55:57.299355+0000","last_peered":"2024-05-09T09:55:57.299355+0000","last_clean":"2024-05-09T09:55:57.299355+0000","last_became_active":"2024-05-09T09:55:41.514399+0000","last_became_peered":"2024-05-09T09:55:41.514399+0000","last_unstale":"2024-05-09T09:55:57.299355+0000","last_undegraded":"2024-05-09T09:55:57.299355+0000","last_fullsized":"2024-05-09T09:55:57.299355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:46.578164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"63'2","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677507+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:55:55.677507+0000","last_peered":"2024-05-09T09:55:55.677507+0000","last_clean":"2024-05-09T09:55:55.677507+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:55:55.677507+0000","last_undegraded":"2024-05-09T09:55:55.677507+0000","last_fullsized":"2024-05-09T09:55:55.677507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704832+0000","last_change":"2024-05-09T09:55:41.514279+0000","last_active":"2024-05-09T09:55:56.704832+0000","last_peered":"2024-05-09T09:55:56.704832+0000","last_clean":"2024-05-09T09:55:56.704832+0000","last_became_active":"2024-05-09T09:55:41.513724+0000","last_became_peered":"2024-05-09T09:55:41.513724+0000","last_unstale":"2024-05-09T09:55:56.704832+0000","last_undegraded":"2024-05-09T09:55:56.704832+0000","last_fullsized":"2024-05-09T09:55:56.704832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:53.879426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511499+0000","last_change":"2024-05-09T09:55:42.243360+0000","last_active":"2024-05-09T09:55:57.511499+0000","last_peered":"2024-05-09T09:55:57.511499+0000","last_clean":"2024-05-09T09:55:57.511499+0000","last_became_active":"2024-05-09T09:55:41.495012+0000","last_became_peered":"2024-05-09T09:55:41.495012+0000","last_unstale":"2024-05-09T09:55:57.511499+0000","last_undegraded":"2024-05-09T09:55:57.511499+0000","last_fullsized":"2024-05-09T09:55:57.511499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:55:30.669989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678693+0000","last_change":"2024-05-09T09:55:41.508232+0000","last_active":"2024-05-09T09:55:55.678693+0000","last_peered":"2024-05-09T09:55:55.678693+0000","last_clean":"2024-05-09T09:55:55.678693+0000","last_became_active":"2024-05-09T09:55:41.506905+0000","last_became_peered":"2024-05-09T09:55:41.506905+0000","last_unstale":"2024-05-09T09:55:55.678693+0000","last_undegraded":"2024-05-09T09:55:55.678693+0000","last_fullsized":"2024-05-09T09:55:55.678693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"73'24","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400581+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:55:57.400581+0000","last_peered":"2024-05-09T09:55:57.400581+0000","last_clean":"2024-05-09T09:55:57.400581+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:55:57.400581+0000","last_undegraded":"2024-05-09T09:55:57.400581+0000","last_fullsized":"2024-05-09T09:55:57.400581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701605+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:55:56.701605+0000","last_peered":"2024-05-09T09:55:56.701605+0000","last_clean":"2024-05-09T09:55:56.701605+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:55:56.701605+0000","last_undegraded":"2024-05-09T09:55:56.701605+0000","last_fullsized":"2024-05-09T09:55:56.701605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681969+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:55:55.681969+0000","last_peered":"2024-05-09T09:55:55.681969+0000","last_clean":"2024-05-09T09:55:55.681969+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:55:55.681969+0000","last_undegraded":"2024-05-09T09:55:55.681969+0000","last_fullsized":"2024-05-09T09:55:55.681969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705208+0000","last_change":"2024-05-09T09:55:41.513633+0000","last_active":"2024-05-09T09:55:56.705208+0000","last_peered":"2024-05-09T09:55:56.705208+0000","last_clean":"2024-05-09T09:55:56.705208+0000","last_became_active":"2024-05-09T09:55:41.512176+0000","last_became_peered":"2024-05-09T09:55:41.512176+0000","last_unstale":"2024-05-09T09:55:56.705208+0000","last_undegraded":"2024-05-09T09:55:56.705208+0000","last_fullsized":"2024-05-09T09:55:56.705208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"68'9","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402348+0000","last_change":"2024-05-09T09:55:42.801375+0000","last_active":"2024-05-09T09:55:57.402348+0000","last_peered":"2024-05-09T09:55:57.402348+0000","last_clean":"2024-05-09T09:55:57.402348+0000","last_became_active":"2024-05-09T09:55:41.495260+0000","last_became_peered":"2024-05-09T09:55:41.495260+0000","last_unstale":"2024-05-09T09:55:57.402348+0000","last_undegraded":"2024-05-09T09:55:57.402348+0000","last_fullsized":"2024-05-09T09:55:57.402348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:20.725921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401363+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:55:57.401363+0000","last_peered":"2024-05-09T09:55:57.401363+0000","last_clean":"2024-05-09T09:55:57.401363+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:55:57.401363+0000","last_undegraded":"2024-05-09T09:55:57.401363+0000","last_fullsized":"2024-05-09T09:55:57.401363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"73'13","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701493+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:55:56.701493+0000","last_peered":"2024-05-09T09:55:56.701493+0000","last_clean":"2024-05-09T09:55:56.701493+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:55:56.701493+0000","last_undegraded":"2024-05-09T09:55:56.701493+0000","last_fullsized":"2024-05-09T09:55:56.701493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297877+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:55:57.297877+0000","last_peered":"2024-05-09T09:55:57.297877+0000","last_clean":"2024-05-09T09:55:57.297877+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:55:57.297877+0000","last_undegraded":"2024-05-09T09:55:57.297877+0000","last_fullsized":"2024-05-09T09:55:57.297877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678781+0000","last_change":"2024-05-09T09:55:10.502456+0000","last_active":"2024-05-09T09:55:55.678781+0000","last_peered":"2024-05-09T09:55:55.678781+0000","last_clean":"2024-05-09T09:55:55.678781+0000","last_became_active":"2024-05-09T09:55:10.502015+0000","last_became_peered":"2024-05-09T09:55:10.502015+0000","last_unstale":"2024-05-09T09:55:55.678781+0000","last_undegraded":"2024-05-09T09:55:55.678781+0000","last_fullsized":"2024-05-09T09:55:55.678781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:01.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"75'46","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678587+0000","last_change":"2024-05-09T09:55:10.787056+0000","last_active":"2024-05-09T09:55:55.678587+0000","last_peered":"2024-05-09T09:55:55.678587+0000","last_clean":"2024-05-09T09:55:55.678587+0000","last_became_active":"2024-05-09T09:55:10.503704+0000","last_became_peered":"2024-05-09T09:55:10.503704+0000","last_unstale":"2024-05-09T09:55:55.678587+0000","last_undegraded":"2024-05-09T09:55:55.678587+0000","last_fullsized":"2024-05-09T09:55:55.678587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:07.882920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'4","reported_seq":53,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678719+0000","last_change":"2024-05-09T09:55:11.105873+0000","last_active":"2024-05-09T09:55:55.678719+0000","last_peered":"2024-05-09T09:55:55.678719+0000","last_clean":"2024-05-09T09:55:55.678719+0000","last_became_active":"2024-05-09T09:55:10.511777+0000","last_became_peered":"2024-05-09T09:55:10.511777+0000","last_unstale":"2024-05-09T09:55:55.678719+0000","last_undegraded":"2024-05-09T09:55:55.678719+0000","last_fullsized":"2024-05-09T09:55:55.678719+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:49.719909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704012+0000","last_change":"2024-05-09T09:55:41.504930+0000","last_active":"2024-05-09T09:55:56.704012+0000","last_peered":"2024-05-09T09:55:56.704012+0000","last_clean":"2024-05-09T09:55:56.704012+0000","last_became_active":"2024-05-09T09:55:41.503996+0000","last_became_peered":"2024-05-09T09:55:41.503996+0000","last_unstale":"2024-05-09T09:55:56.704012+0000","last_undegraded":"2024-05-09T09:55:56.704012+0000","last_fullsized":"2024-05-09T09:55:56.704012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:17.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"73'12","reported_seq":51,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677974+0000","last_change":"2024-05-09T09:55:11.754129+0000","last_active":"2024-05-09T09:55:55.677974+0000","last_peered":"2024-05-09T09:55:55.677974+0000","last_clean":"2024-05-09T09:55:55.677974+0000","last_became_active":"2024-05-09T09:55:10.525384+0000","last_became_peered":"2024-05-09T09:55:10.525384+0000","last_unstale":"2024-05-09T09:55:55.677974+0000","last_undegraded":"2024-05-09T09:55:55.677974+0000","last_fullsized":"2024-05-09T09:55:55.677974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:56.439887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":18,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704813+0000","last_change":"2024-05-09T09:55:41.503227+0000","last_active":"2024-05-09T09:55:56.704813+0000","last_peered":"2024-05-09T09:55:56.704813+0000","last_clean":"2024-05-09T09:55:56.704813+0000","last_became_active":"2024-05-09T09:55:41.502389+0000","last_became_peered":"2024-05-09T09:55:41.502389+0000","last_unstale":"2024-05-09T09:55:56.704813+0000","last_undegraded":"2024-05-09T09:55:56.704813+0000","last_fullsized":"2024-05-09T09:55:56.704813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:58.478317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680868+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:55:55.680868+0000","last_peered":"2024-05-09T09:55:55.680868+0000","last_clean":"2024-05-09T09:55:55.680868+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:55:55.680868+0000","last_undegraded":"2024-05-09T09:55:55.680868+0000","last_fullsized":"2024-05-09T09:55:55.680868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703739+0000","last_change":"2024-05-09T09:55:41.504669+0000","last_active":"2024-05-09T09:55:56.703739+0000","last_peered":"2024-05-09T09:55:56.703739+0000","last_clean":"2024-05-09T09:55:56.703739+0000","last_became_active":"2024-05-09T09:55:41.503132+0000","last_became_peered":"2024-05-09T09:55:41.503132+0000","last_unstale":"2024-05-09T09:55:56.703739+0000","last_undegraded":"2024-05-09T09:55:56.703739+0000","last_fullsized":"2024-05-09T09:55:56.703739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:40.768463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706462+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:55:56.706462+0000","last_peered":"2024-05-09T09:55:56.706462+0000","last_clean":"2024-05-09T09:55:56.706462+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:55:56.706462+0000","last_undegraded":"2024-05-09T09:55:56.706462+0000","last_fullsized":"2024-05-09T09:55:56.706462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":36882,"num_write":42,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702636+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:55:56.702636+0000","last_peered":"2024-05-09T09:55:56.702636+0000","last_clean":"2024-05-09T09:55:56.702636+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:55:56.702636+0000","last_undegraded":"2024-05-09T09:55:56.702636+0000","last_fullsized":"2024-05-09T09:55:56.702636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"73'15","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704375+0000","last_change":"2024-05-09T09:55:41.528075+0000","last_active":"2024-05-09T09:55:56.704375+0000","last_peered":"2024-05-09T09:55:56.704375+0000","last_clean":"2024-05-09T09:55:56.704375+0000","last_became_active":"2024-05-09T09:55:41.453982+0000","last_became_peered":"2024-05-09T09:55:41.453982+0000","last_unstale":"2024-05-09T09:55:56.704375+0000","last_undegraded":"2024-05-09T09:55:56.704375+0000","last_fullsized":"2024-05-09T09:55:56.704375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:30.849980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703788+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:55:56.703788+0000","last_peered":"2024-05-09T09:55:56.703788+0000","last_clean":"2024-05-09T09:55:56.703788+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:55:56.703788+0000","last_undegraded":"2024-05-09T09:55:56.703788+0000","last_fullsized":"2024-05-09T09:55:56.703788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705754+0000","last_change":"2024-05-09T09:55:41.488023+0000","last_active":"2024-05-09T09:55:56.705754+0000","last_peered":"2024-05-09T09:55:56.705754+0000","last_clean":"2024-05-09T09:55:56.705754+0000","last_became_active":"2024-05-09T09:55:41.478429+0000","last_became_peered":"2024-05-09T09:55:41.478429+0000","last_unstale":"2024-05-09T09:55:56.705754+0000","last_undegraded":"2024-05-09T09:55:56.705754+0000","last_fullsized":"2024-05-09T09:55:56.705754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:21.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703865+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:55:56.703865+0000","last_peered":"2024-05-09T09:55:56.703865+0000","last_clean":"2024-05-09T09:55:56.703865+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:55:56.703865+0000","last_undegraded":"2024-05-09T09:55:56.703865+0000","last_fullsized":"2024-05-09T09:55:56.703865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":76,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298338+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:55:57.298338+0000","last_peered":"2024-05-09T09:55:57.298338+0000","last_clean":"2024-05-09T09:55:57.298338+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:55:57.298338+0000","last_undegraded":"2024-05-09T09:55:57.298338+0000","last_fullsized":"2024-05-09T09:55:57.298338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'16","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511896+0000","last_change":"2024-05-09T09:53:54.474568+0000","last_active":"2024-05-09T09:55:57.511896+0000","last_peered":"2024-05-09T09:55:57.511896+0000","last_clean":"2024-05-09T09:55:57.511896+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:55:57.511896+0000","last_undegraded":"2024-05-09T09:55:57.511896+0000","last_fullsized":"2024-05-09T09:55:57.511896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:31.979515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":38936,"num_write":56,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401833+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:55:57.401833+0000","last_peered":"2024-05-09T09:55:57.401833+0000","last_clean":"2024-05-09T09:55:57.401833+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:55:57.401833+0000","last_undegraded":"2024-05-09T09:55:57.401833+0000","last_fullsized":"2024-05-09T09:55:57.401833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401072+0000","last_change":"2024-05-09T09:55:11.421625+0000","last_active":"2024-05-09T09:55:57.401072+0000","last_peered":"2024-05-09T09:55:57.401072+0000","last_clean":"2024-05-09T09:55:57.401072+0000","last_became_active":"2024-05-09T09:55:10.518812+0000","last_became_peered":"2024-05-09T09:55:10.518812+0000","last_unstale":"2024-05-09T09:55:57.401072+0000","last_undegraded":"2024-05-09T09:55:57.401072+0000","last_fullsized":"2024-05-09T09:55:57.401072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:01.935968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":30726,"num_write":20,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703042+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:55:56.703042+0000","last_peered":"2024-05-09T09:55:56.703042+0000","last_clean":"2024-05-09T09:55:56.703042+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:55:56.703042+0000","last_undegraded":"2024-05-09T09:55:56.703042+0000","last_fullsized":"2024-05-09T09:55:56.703042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704515+0000","last_change":"2024-05-09T09:55:11.272479+0000","last_active":"2024-05-09T09:55:56.704515+0000","last_peered":"2024-05-09T09:55:56.704515+0000","last_clean":"2024-05-09T09:55:56.704515+0000","last_became_active":"2024-05-09T09:55:10.507500+0000","last_became_peered":"2024-05-09T09:55:10.507500+0000","last_unstale":"2024-05-09T09:55:56.704515+0000","last_undegraded":"2024-05-09T09:55:56.704515+0000","last_fullsized":"2024-05-09T09:55:56.704515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:01.473207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678204+0000","last_change":"2024-05-09T09:55:10.524923+0000","last_active":"2024-05-09T09:55:55.678204+0000","last_peered":"2024-05-09T09:55:55.678204+0000","last_clean":"2024-05-09T09:55:55.678204+0000","last_became_active":"2024-05-09T09:55:10.523552+0000","last_became_peered":"2024-05-09T09:55:10.523552+0000","last_unstale":"2024-05-09T09:55:55.678204+0000","last_undegraded":"2024-05-09T09:55:55.678204+0000","last_fullsized":"2024-05-09T09:55:55.678204+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:43.486340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'15","reported_seq":108,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679120+0000","last_change":"2024-05-09T09:55:42.061427+0000","last_active":"2024-05-09T09:55:55.679120+0000","last_peered":"2024-05-09T09:55:55.679120+0000","last_clean":"2024-05-09T09:55:55.679120+0000","last_became_active":"2024-05-09T09:55:41.504165+0000","last_became_peered":"2024-05-09T09:55:41.504165+0000","last_unstale":"2024-05-09T09:55:55.679120+0000","last_undegraded":"2024-05-09T09:55:55.679120+0000","last_fullsized":"2024-05-09T09:55:55.679120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:23.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":13,"num_read_kb":12298,"num_write":35,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":113246208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704514+0000","last_change":"2024-05-09T09:55:41.501384+0000","last_active":"2024-05-09T09:55:56.704514+0000","last_peered":"2024-05-09T09:55:56.704514+0000","last_clean":"2024-05-09T09:55:56.704514+0000","last_became_active":"2024-05-09T09:55:41.500371+0000","last_became_peered":"2024-05-09T09:55:41.500371+0000","last_unstale":"2024-05-09T09:55:56.704514+0000","last_undegraded":"2024-05-09T09:55:56.704514+0000","last_fullsized":"2024-05-09T09:55:56.704514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:40.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'20","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703337+0000","last_change":"2024-05-09T09:55:10.940790+0000","last_active":"2024-05-09T09:55:56.703337+0000","last_peered":"2024-05-09T09:55:56.703337+0000","last_clean":"2024-05-09T09:55:56.703337+0000","last_became_active":"2024-05-09T09:55:10.497720+0000","last_became_peered":"2024-05-09T09:55:10.497720+0000","last_unstale":"2024-05-09T09:55:56.703337+0000","last_undegraded":"2024-05-09T09:55:56.703337+0000","last_fullsized":"2024-05-09T09:55:56.703337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":40,"num_read_kb":51230,"num_write":70,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677947+0000","last_change":"2024-05-09T09:55:10.522327+0000","last_active":"2024-05-09T09:55:55.677947+0000","last_peered":"2024-05-09T09:55:55.677947+0000","last_clean":"2024-05-09T09:55:55.677947+0000","last_became_active":"2024-05-09T09:55:10.520654+0000","last_became_peered":"2024-05-09T09:55:10.520654+0000","last_unstale":"2024-05-09T09:55:55.677947+0000","last_undegraded":"2024-05-09T09:55:55.677947+0000","last_fullsized":"2024-05-09T09:55:55.677947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299280+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:55:57.299280+0000","last_peered":"2024-05-09T09:55:57.299280+0000","last_clean":"2024-05-09T09:55:57.299280+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:55:57.299280+0000","last_undegraded":"2024-05-09T09:55:57.299280+0000","last_fullsized":"2024-05-09T09:55:57.299280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297786+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:55:57.297786+0000","last_peered":"2024-05-09T09:55:57.297786+0000","last_clean":"2024-05-09T09:55:57.297786+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:55:57.297786+0000","last_undegraded":"2024-05-09T09:55:57.297786+0000","last_fullsized":"2024-05-09T09:55:57.297786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"67'7","reported_seq":78,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680554+0000","last_change":"2024-05-09T09:55:43.542093+0000","last_active":"2024-05-09T09:55:55.680554+0000","last_peered":"2024-05-09T09:55:55.680554+0000","last_clean":"2024-05-09T09:55:55.680554+0000","last_became_active":"2024-05-09T09:55:41.504555+0000","last_became_peered":"2024-05-09T09:55:41.504555+0000","last_unstale":"2024-05-09T09:55:55.680554+0000","last_undegraded":"2024-05-09T09:55:55.680554+0000","last_fullsized":"2024-05-09T09:55:55.680554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:48:05.626495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"75'34","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706338+0000","last_change":"2024-05-09T09:55:11.694902+0000","last_active":"2024-05-09T09:55:56.706338+0000","last_peered":"2024-05-09T09:55:56.706338+0000","last_clean":"2024-05-09T09:55:56.706338+0000","last_became_active":"2024-05-09T09:55:10.515872+0000","last_became_peered":"2024-05-09T09:55:10.515872+0000","last_unstale":"2024-05-09T09:55:56.706338+0000","last_undegraded":"2024-05-09T09:55:56.706338+0000","last_fullsized":"2024-05-09T09:55:56.706338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"67'8","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401104+0000","last_change":"2024-05-09T09:55:11.200964+0000","last_active":"2024-05-09T09:55:57.401104+0000","last_peered":"2024-05-09T09:55:57.401104+0000","last_clean":"2024-05-09T09:55:57.401104+0000","last_became_active":"2024-05-09T09:55:10.506370+0000","last_became_peered":"2024-05-09T09:55:10.506370+0000","last_unstale":"2024-05-09T09:55:57.401104+0000","last_undegraded":"2024-05-09T09:55:57.401104+0000","last_fullsized":"2024-05-09T09:55:57.401104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:45.803361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":16388,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706695+0000","last_change":"2024-05-09T09:55:41.494250+0000","last_active":"2024-05-09T09:55:56.706695+0000","last_peered":"2024-05-09T09:55:56.706695+0000","last_clean":"2024-05-09T09:55:56.706695+0000","last_became_active":"2024-05-09T09:55:41.492423+0000","last_became_peered":"2024-05-09T09:55:41.492423+0000","last_unstale":"2024-05-09T09:55:56.706695+0000","last_undegraded":"2024-05-09T09:55:56.706695+0000","last_fullsized":"2024-05-09T09:55:56.706695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'9","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678507+0000","last_change":"2024-05-09T09:55:44.733118+0000","last_active":"2024-05-09T09:55:55.678507+0000","last_peered":"2024-05-09T09:55:55.678507+0000","last_clean":"2024-05-09T09:55:55.678507+0000","last_became_active":"2024-05-09T09:55:41.505078+0000","last_became_peered":"2024-05-09T09:55:41.505078+0000","last_unstale":"2024-05-09T09:55:55.678507+0000","last_undegraded":"2024-05-09T09:55:55.678507+0000","last_fullsized":"2024-05-09T09:55:55.678507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:36.404862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512634+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:55:57.512634+0000","last_peered":"2024-05-09T09:55:57.512634+0000","last_clean":"2024-05-09T09:55:57.512634+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:55:57.512634+0000","last_undegraded":"2024-05-09T09:55:57.512634+0000","last_fullsized":"2024-05-09T09:55:57.512634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'18","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401073+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:55:57.401073+0000","last_peered":"2024-05-09T09:55:57.401073+0000","last_clean":"2024-05-09T09:55:57.401073+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:55:57.401073+0000","last_undegraded":"2024-05-09T09:55:57.401073+0000","last_fullsized":"2024-05-09T09:55:57.401073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":63494,"num_write":28,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'34","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705523+0000","last_change":"2024-05-09T09:55:42.435861+0000","last_active":"2024-05-09T09:55:56.705523+0000","last_peered":"2024-05-09T09:55:56.705523+0000","last_clean":"2024-05-09T09:55:56.705523+0000","last_became_active":"2024-05-09T09:55:41.516340+0000","last_became_peered":"2024-05-09T09:55:41.516340+0000","last_unstale":"2024-05-09T09:55:56.705523+0000","last_undegraded":"2024-05-09T09:55:56.705523+0000","last_fullsized":"2024-05-09T09:55:56.705523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'12","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512299+0000","last_change":"2024-05-09T09:53:54.475107+0000","last_active":"2024-05-09T09:55:57.512299+0000","last_peered":"2024-05-09T09:55:57.512299+0000","last_clean":"2024-05-09T09:55:57.512299+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:55:57.512299+0000","last_undegraded":"2024-05-09T09:55:57.512299+0000","last_fullsized":"2024-05-09T09:55:57.512299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:07.978606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":40972,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'10","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.725591+0000","last_change":"2024-05-09T09:55:55.725591+0000","last_active":"2024-05-09T09:55:55.725591+0000","last_peered":"2024-05-09T09:55:55.725591+0000","last_clean":"2024-05-09T09:55:55.725591+0000","last_became_active":"2024-05-09T09:55:55.721121+0000","last_became_peered":"2024-05-09T09:55:55.721121+0000","last_unstale":"2024-05-09T09:55:55.725591+0000","last_undegraded":"2024-05-09T09:55:55.725591+0000","last_fullsized":"2024-05-09T09:55:55.725591+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298788+0000","last_change":"2024-05-09T09:55:43.389559+0000","last_active":"2024-05-09T09:55:57.298788+0000","last_peered":"2024-05-09T09:55:57.298788+0000","last_clean":"2024-05-09T09:55:57.298788+0000","last_became_active":"2024-05-09T09:55:41.513564+0000","last_became_peered":"2024-05-09T09:55:41.513564+0000","last_unstale":"2024-05-09T09:55:57.298788+0000","last_undegraded":"2024-05-09T09:55:57.298788+0000","last_fullsized":"2024-05-09T09:55:57.298788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:27.560582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"63'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702094+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:55:56.702094+0000","last_peered":"2024-05-09T09:55:56.702094+0000","last_clean":"2024-05-09T09:55:56.702094+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:55:56.702094+0000","last_undegraded":"2024-05-09T09:55:56.702094+0000","last_fullsized":"2024-05-09T09:55:56.702094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'9","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680450+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:55:55.680450+0000","last_peered":"2024-05-09T09:55:55.680450+0000","last_clean":"2024-05-09T09:55:55.680450+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:55:55.680450+0000","last_undegraded":"2024-05-09T09:55:55.680450+0000","last_fullsized":"2024-05-09T09:55:55.680450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"63'6","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678343+0000","last_change":"2024-05-09T09:55:10.683098+0000","last_active":"2024-05-09T09:55:55.678343+0000","last_peered":"2024-05-09T09:55:55.678343+0000","last_clean":"2024-05-09T09:55:55.678343+0000","last_became_active":"2024-05-09T09:55:10.495708+0000","last_became_peered":"2024-05-09T09:55:10.495708+0000","last_unstale":"2024-05-09T09:55:55.678343+0000","last_undegraded":"2024-05-09T09:55:55.678343+0000","last_fullsized":"2024-05-09T09:55:55.678343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:35.537784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'19","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513097+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:55:57.513097+0000","last_peered":"2024-05-09T09:55:57.513097+0000","last_clean":"2024-05-09T09:55:57.513097+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:55:57.513097+0000","last_undegraded":"2024-05-09T09:55:57.513097+0000","last_fullsized":"2024-05-09T09:55:57.513097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":39,"num_read_kb":53278,"num_write":69,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'6","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677835+0000","last_change":"2024-05-09T09:55:10.943382+0000","last_active":"2024-05-09T09:55:55.677835+0000","last_peered":"2024-05-09T09:55:55.677835+0000","last_clean":"2024-05-09T09:55:55.677835+0000","last_became_active":"2024-05-09T09:55:10.500255+0000","last_became_peered":"2024-05-09T09:55:10.500255+0000","last_unstale":"2024-05-09T09:55:55.677835+0000","last_undegraded":"2024-05-09T09:55:55.677835+0000","last_fullsized":"2024-05-09T09:55:55.677835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"68'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402011+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.402011+0000","last_peered":"2024-05-09T09:55:57.402011+0000","last_clean":"2024-05-09T09:55:57.402011+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:55:57.402011+0000","last_undegraded":"2024-05-09T09:55:57.402011+0000","last_fullsized":"2024-05-09T09:55:57.402011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"69'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400979+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:55:57.400979+0000","last_peered":"2024-05-09T09:55:57.400979+0000","last_clean":"2024-05-09T09:55:57.400979+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:55:57.400979+0000","last_undegraded":"2024-05-09T09:55:57.400979+0000","last_fullsized":"2024-05-09T09:55:57.400979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706291+0000","last_change":"2024-05-09T09:55:10.507173+0000","last_active":"2024-05-09T09:55:56.706291+0000","last_peered":"2024-05-09T09:55:56.706291+0000","last_clean":"2024-05-09T09:55:56.706291+0000","last_became_active":"2024-05-09T09:55:10.506690+0000","last_became_peered":"2024-05-09T09:55:10.506690+0000","last_unstale":"2024-05-09T09:55:56.706291+0000","last_undegraded":"2024-05-09T09:55:56.706291+0000","last_fullsized":"2024-05-09T09:55:56.706291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'10","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702042+0000","last_change":"2024-05-09T09:55:41.773438+0000","last_active":"2024-05-09T09:55:56.702042+0000","last_peered":"2024-05-09T09:55:56.702042+0000","last_clean":"2024-05-09T09:55:56.702042+0000","last_became_active":"2024-05-09T09:55:41.504558+0000","last_became_peered":"2024-05-09T09:55:41.504558+0000","last_unstale":"2024-05-09T09:55:56.702042+0000","last_undegraded":"2024-05-09T09:55:56.702042+0000","last_fullsized":"2024-05-09T09:55:56.702042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26642,"num_write":40,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399757+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:55:57.399757+0000","last_peered":"2024-05-09T09:55:57.399757+0000","last_clean":"2024-05-09T09:55:57.399757+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:55:57.399757+0000","last_undegraded":"2024-05-09T09:55:57.399757+0000","last_fullsized":"2024-05-09T09:55:57.399757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":634,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":234941,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":916,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":46305,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":230722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":639,"ondisk_log_size":639,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1642,"num_read_kb":1223,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1022,"num_read_kb":1804930,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":1302331392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503992,"kb_used_data":472812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93867848,"statfs":{"total":96636764160,"available":96120676352,"internally_reserved":0,"allocated":484159488,"data_stored":483620955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":392792,"kb_used_data":361604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93979048,"statfs":{"total":96636764160,"available":96234545152,"internally_reserved":0,"allocated":370282496,"data_stored":369785753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":525996,"kb_used_data":494816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93845844,"statfs":{"total":96636764160,"available":96098144256,"internally_reserved":0,"allocated":506691584,"data_stored":506135230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505404,"kb_used_data":474220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866436,"statfs":{"total":96636764160,"available":96119230464,"internally_reserved":0,"allocated":485601280,"data_stored":485118321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462508,"kb_used_data":427168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93909332,"statfs":{"total":96636764160,"available":96163155968,"internally_reserved":0,"allocated":437420032,"data_stored":436904310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331364,"kb_used_data":296024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94040476,"statfs":{"total":96636764160,"available":96297447424,"internally_reserved":0,"allocated":303128576,"data_stored":302653917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315080,"kb_used_data":279732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94056760,"statfs":{"total":96636764160,"available":96314122240,"internally_reserved":0,"allocated":286445568,"data_stored":285929009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434400,"kb_used_data":399056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93937440,"statfs":{"total":96636764160,"available":96191938560,"internally_reserved":0,"allocated":408633344,"data_stored":408125441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":406847488,"data_stored":406847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":285212672,"data_stored":285212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":301989888,"data_stored":301989888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":436207616,"data_stored":436207616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":505413632,"data_stored":505413632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":369098752,"data_stored":369098752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":20947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":38049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":62333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":25989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:56:00.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:56:00.595 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:00.617 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:56:00.618 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-05-09T09:55:59.344532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636605482,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3772,"num_read_kb":1807243,"num_write":3328,"num_write_kb":2051082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":598,"num_bytes_recovered":1302381373,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2053,"ondisk_log_size":2053,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":531,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3471536,"kb_used_data":3205432,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":751503184,"statfs":{"total":773094113280,"available":769539260416,"internally_reserved":0,"allocated":3282362368,"data_stored":3278272936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":272354867},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.696257"},"pg_stats":[{"pgid":"3.3f","version":"73'14","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681695+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:55:55.681695+0000","last_peered":"2024-05-09T09:55:55.681695+0000","last_clean":"2024-05-09T09:55:55.681695+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:55:55.681695+0000","last_undegraded":"2024-05-09T09:55:55.681695+0000","last_fullsized":"2024-05-09T09:55:55.681695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":47116,"num_write":34,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400553+0000","last_change":"2024-05-09T09:55:41.485053+0000","last_active":"2024-05-09T09:55:57.400553+0000","last_peered":"2024-05-09T09:55:57.400553+0000","last_clean":"2024-05-09T09:55:57.400553+0000","last_became_active":"2024-05-09T09:55:41.484367+0000","last_became_peered":"2024-05-09T09:55:41.484367+0000","last_unstale":"2024-05-09T09:55:57.400553+0000","last_undegraded":"2024-05-09T09:55:57.400553+0000","last_fullsized":"2024-05-09T09:55:57.400553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:39.155356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"73'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703942+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:55:56.703942+0000","last_peered":"2024-05-09T09:55:56.703942+0000","last_clean":"2024-05-09T09:55:56.703942+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:55:56.703942+0000","last_undegraded":"2024-05-09T09:55:56.703942+0000","last_fullsized":"2024-05-09T09:55:56.703942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'40","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678333+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:55:55.678333+0000","last_peered":"2024-05-09T09:55:55.678333+0000","last_clean":"2024-05-09T09:55:55.678333+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:55:55.678333+0000","last_undegraded":"2024-05-09T09:55:55.678333+0000","last_fullsized":"2024-05-09T09:55:55.678333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"73'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705841+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:55:56.705841+0000","last_peered":"2024-05-09T09:55:56.705841+0000","last_clean":"2024-05-09T09:55:56.705841+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:55:56.705841+0000","last_undegraded":"2024-05-09T09:55:56.705841+0000","last_fullsized":"2024-05-09T09:55:56.705841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":38918,"num_write":22,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705052+0000","last_change":"2024-05-09T09:55:41.476462+0000","last_active":"2024-05-09T09:55:56.705052+0000","last_peered":"2024-05-09T09:55:56.705052+0000","last_clean":"2024-05-09T09:55:56.705052+0000","last_became_active":"2024-05-09T09:55:41.474847+0000","last_became_peered":"2024-05-09T09:55:41.474847+0000","last_unstale":"2024-05-09T09:55:56.705052+0000","last_undegraded":"2024-05-09T09:55:56.705052+0000","last_fullsized":"2024-05-09T09:55:56.705052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'10","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401959+0000","last_change":"2024-05-09T09:55:11.074408+0000","last_active":"2024-05-09T09:55:57.401959+0000","last_peered":"2024-05-09T09:55:57.401959+0000","last_clean":"2024-05-09T09:55:57.401959+0000","last_became_active":"2024-05-09T09:55:10.495355+0000","last_became_peered":"2024-05-09T09:55:10.495355+0000","last_unstale":"2024-05-09T09:55:57.401959+0000","last_undegraded":"2024-05-09T09:55:57.401959+0000","last_fullsized":"2024-05-09T09:55:57.401959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:16:55.087662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704348+0000","last_change":"2024-05-09T09:55:10.508149+0000","last_active":"2024-05-09T09:55:56.704348+0000","last_peered":"2024-05-09T09:55:56.704348+0000","last_clean":"2024-05-09T09:55:56.704348+0000","last_became_active":"2024-05-09T09:55:10.506740+0000","last_became_peered":"2024-05-09T09:55:10.506740+0000","last_unstale":"2024-05-09T09:55:56.704348+0000","last_undegraded":"2024-05-09T09:55:56.704348+0000","last_fullsized":"2024-05-09T09:55:56.704348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:15.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"67'10","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297604+0000","last_change":"2024-05-09T09:53:54.477992+0000","last_active":"2024-05-09T09:55:57.297604+0000","last_peered":"2024-05-09T09:55:57.297604+0000","last_clean":"2024-05-09T09:55:57.297604+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:55:57.297604+0000","last_undegraded":"2024-05-09T09:55:57.297604+0000","last_fullsized":"2024-05-09T09:55:57.297604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:38.501294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'14","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400463+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:55:57.400463+0000","last_peered":"2024-05-09T09:55:57.400463+0000","last_clean":"2024-05-09T09:55:57.400463+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:55:57.400463+0000","last_undegraded":"2024-05-09T09:55:57.400463+0000","last_fullsized":"2024-05-09T09:55:57.400463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:45:31.509591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":34840,"num_write":54,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'38","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706070+0000","last_change":"2024-05-09T09:55:41.723376+0000","last_active":"2024-05-09T09:55:56.706070+0000","last_peered":"2024-05-09T09:55:56.706070+0000","last_clean":"2024-05-09T09:55:56.706070+0000","last_became_active":"2024-05-09T09:55:41.470370+0000","last_became_peered":"2024-05-09T09:55:41.470370+0000","last_unstale":"2024-05-09T09:55:56.706070+0000","last_undegraded":"2024-05-09T09:55:56.706070+0000","last_fullsized":"2024-05-09T09:55:56.706070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:01.442445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"64'9","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678625+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:55:55.678625+0000","last_peered":"2024-05-09T09:55:55.678625+0000","last_clean":"2024-05-09T09:55:55.678625+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:55:55.678625+0000","last_undegraded":"2024-05-09T09:55:55.678625+0000","last_fullsized":"2024-05-09T09:55:55.678625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":34816,"num_write":9,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399784+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:55:57.399784+0000","last_peered":"2024-05-09T09:55:57.399784+0000","last_clean":"2024-05-09T09:55:57.399784+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:55:57.399784+0000","last_undegraded":"2024-05-09T09:55:57.399784+0000","last_fullsized":"2024-05-09T09:55:57.399784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'15","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677573+0000","last_change":"2024-05-09T09:55:11.513082+0000","last_active":"2024-05-09T09:55:55.677573+0000","last_peered":"2024-05-09T09:55:55.677573+0000","last_clean":"2024-05-09T09:55:55.677573+0000","last_became_active":"2024-05-09T09:55:10.517657+0000","last_became_peered":"2024-05-09T09:55:10.517657+0000","last_unstale":"2024-05-09T09:55:55.677573+0000","last_undegraded":"2024-05-09T09:55:55.677573+0000","last_fullsized":"2024-05-09T09:55:55.677573+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:28.563341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":22558,"num_write":65,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513158+0000","last_change":"2024-05-09T09:55:10.525459+0000","last_active":"2024-05-09T09:55:57.513158+0000","last_peered":"2024-05-09T09:55:57.513158+0000","last_clean":"2024-05-09T09:55:57.513158+0000","last_became_active":"2024-05-09T09:55:10.525051+0000","last_became_peered":"2024-05-09T09:55:10.525051+0000","last_unstale":"2024-05-09T09:55:57.513158+0000","last_undegraded":"2024-05-09T09:55:57.513158+0000","last_fullsized":"2024-05-09T09:55:57.513158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:08.309277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704076+0000","last_change":"2024-05-09T09:55:41.727656+0000","last_active":"2024-05-09T09:55:56.704076+0000","last_peered":"2024-05-09T09:55:56.704076+0000","last_clean":"2024-05-09T09:55:56.704076+0000","last_became_active":"2024-05-09T09:55:41.468227+0000","last_became_peered":"2024-05-09T09:55:41.468227+0000","last_unstale":"2024-05-09T09:55:56.704076+0000","last_undegraded":"2024-05-09T09:55:56.704076+0000","last_fullsized":"2024-05-09T09:55:56.704076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681714+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:55:55.681714+0000","last_peered":"2024-05-09T09:55:55.681714+0000","last_clean":"2024-05-09T09:55:55.681714+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:55:55.681714+0000","last_undegraded":"2024-05-09T09:55:55.681714+0000","last_fullsized":"2024-05-09T09:55:55.681714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678528+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:55:55.678528+0000","last_peered":"2024-05-09T09:55:55.678528+0000","last_clean":"2024-05-09T09:55:55.678528+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:55:55.678528+0000","last_undegraded":"2024-05-09T09:55:55.678528+0000","last_fullsized":"2024-05-09T09:55:55.678528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299075+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.299075+0000","last_peered":"2024-05-09T09:55:57.299075+0000","last_clean":"2024-05-09T09:55:57.299075+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:55:57.299075+0000","last_undegraded":"2024-05-09T09:55:57.299075+0000","last_fullsized":"2024-05-09T09:55:57.299075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400770+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:55:57.400770+0000","last_peered":"2024-05-09T09:55:57.400770+0000","last_clean":"2024-05-09T09:55:57.400770+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:55:57.400770+0000","last_undegraded":"2024-05-09T09:55:57.400770+0000","last_fullsized":"2024-05-09T09:55:57.400770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299149+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:55:57.299149+0000","last_peered":"2024-05-09T09:55:57.299149+0000","last_clean":"2024-05-09T09:55:57.299149+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:55:57.299149+0000","last_undegraded":"2024-05-09T09:55:57.299149+0000","last_fullsized":"2024-05-09T09:55:57.299149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512589+0000","last_change":"2024-05-09T09:55:10.502036+0000","last_active":"2024-05-09T09:55:57.512589+0000","last_peered":"2024-05-09T09:55:57.512589+0000","last_clean":"2024-05-09T09:55:57.512589+0000","last_became_active":"2024-05-09T09:55:10.501517+0000","last_became_peered":"2024-05-09T09:55:10.501517+0000","last_unstale":"2024-05-09T09:55:57.512589+0000","last_undegraded":"2024-05-09T09:55:57.512589+0000","last_fullsized":"2024-05-09T09:55:57.512589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:30.945254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"66'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705752+0000","last_change":"2024-05-09T09:55:42.549939+0000","last_active":"2024-05-09T09:55:56.705752+0000","last_peered":"2024-05-09T09:55:56.705752+0000","last_clean":"2024-05-09T09:55:56.705752+0000","last_became_active":"2024-05-09T09:55:41.517108+0000","last_became_peered":"2024-05-09T09:55:41.517108+0000","last_unstale":"2024-05-09T09:55:56.705752+0000","last_undegraded":"2024-05-09T09:55:56.705752+0000","last_fullsized":"2024-05-09T09:55:56.705752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:39.522749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511344+0000","last_change":"2024-05-09T09:55:41.495787+0000","last_active":"2024-05-09T09:55:57.511344+0000","last_peered":"2024-05-09T09:55:57.511344+0000","last_clean":"2024-05-09T09:55:57.511344+0000","last_became_active":"2024-05-09T09:55:41.495217+0000","last_became_peered":"2024-05-09T09:55:41.495217+0000","last_unstale":"2024-05-09T09:55:57.511344+0000","last_undegraded":"2024-05-09T09:55:57.511344+0000","last_fullsized":"2024-05-09T09:55:57.511344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:19.303237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"67'12","reported_seq":71,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678814+0000","last_change":"2024-05-09T09:55:11.744028+0000","last_active":"2024-05-09T09:55:55.678814+0000","last_peered":"2024-05-09T09:55:55.678814+0000","last_clean":"2024-05-09T09:55:55.678814+0000","last_became_active":"2024-05-09T09:55:10.515515+0000","last_became_peered":"2024-05-09T09:55:10.515515+0000","last_unstale":"2024-05-09T09:55:55.678814+0000","last_undegraded":"2024-05-09T09:55:55.678814+0000","last_fullsized":"2024-05-09T09:55:55.678814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:26:21.134168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":77594624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706053+0000","last_change":"2024-05-09T09:55:41.471993+0000","last_active":"2024-05-09T09:55:56.706053+0000","last_peered":"2024-05-09T09:55:56.706053+0000","last_clean":"2024-05-09T09:55:56.706053+0000","last_became_active":"2024-05-09T09:55:41.469463+0000","last_became_peered":"2024-05-09T09:55:41.469463+0000","last_unstale":"2024-05-09T09:55:56.706053+0000","last_undegraded":"2024-05-09T09:55:56.706053+0000","last_fullsized":"2024-05-09T09:55:56.706053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:09.428329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702672+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:55:56.702672+0000","last_peered":"2024-05-09T09:55:56.702672+0000","last_clean":"2024-05-09T09:55:56.702672+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:55:56.702672+0000","last_undegraded":"2024-05-09T09:55:56.702672+0000","last_fullsized":"2024-05-09T09:55:56.702672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703760+0000","last_change":"2024-05-09T09:55:41.489025+0000","last_active":"2024-05-09T09:55:56.703760+0000","last_peered":"2024-05-09T09:55:56.703760+0000","last_clean":"2024-05-09T09:55:56.703760+0000","last_became_active":"2024-05-09T09:55:41.479825+0000","last_became_peered":"2024-05-09T09:55:41.479825+0000","last_unstale":"2024-05-09T09:55:56.703760+0000","last_undegraded":"2024-05-09T09:55:56.703760+0000","last_fullsized":"2024-05-09T09:55:56.703760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677835+0000","last_change":"2024-05-09T09:55:10.499813+0000","last_active":"2024-05-09T09:55:55.677835+0000","last_peered":"2024-05-09T09:55:55.677835+0000","last_clean":"2024-05-09T09:55:55.677835+0000","last_became_active":"2024-05-09T09:55:10.499014+0000","last_became_peered":"2024-05-09T09:55:10.499014+0000","last_unstale":"2024-05-09T09:55:55.677835+0000","last_undegraded":"2024-05-09T09:55:55.677835+0000","last_fullsized":"2024-05-09T09:55:55.677835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:12.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"68'9","reported_seq":208,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680527+0000","last_change":"2024-05-09T09:55:43.099041+0000","last_active":"2024-05-09T09:55:55.680527+0000","last_peered":"2024-05-09T09:55:55.680527+0000","last_clean":"2024-05-09T09:55:55.680527+0000","last_became_active":"2024-05-09T09:55:41.507252+0000","last_became_peered":"2024-05-09T09:55:41.507252+0000","last_unstale":"2024-05-09T09:55:55.680527+0000","last_undegraded":"2024-05-09T09:55:55.680527+0000","last_fullsized":"2024-05-09T09:55:55.680527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401721+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:55:57.401721+0000","last_peered":"2024-05-09T09:55:57.401721+0000","last_clean":"2024-05-09T09:55:57.401721+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:55:57.401721+0000","last_undegraded":"2024-05-09T09:55:57.401721+0000","last_fullsized":"2024-05-09T09:55:57.401721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"73'16","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706715+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:55:56.706715+0000","last_peered":"2024-05-09T09:55:56.706715+0000","last_clean":"2024-05-09T09:55:56.706715+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:55:56.706715+0000","last_undegraded":"2024-05-09T09:55:56.706715+0000","last_fullsized":"2024-05-09T09:55:56.706715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680623+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:55:55.680623+0000","last_peered":"2024-05-09T09:55:55.680623+0000","last_clean":"2024-05-09T09:55:55.680623+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:55:55.680623+0000","last_undegraded":"2024-05-09T09:55:55.680623+0000","last_fullsized":"2024-05-09T09:55:55.680623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400280+0000","last_change":"2024-05-09T09:55:41.487851+0000","last_active":"2024-05-09T09:55:57.400280+0000","last_peered":"2024-05-09T09:55:57.400280+0000","last_clean":"2024-05-09T09:55:57.400280+0000","last_became_active":"2024-05-09T09:55:41.487060+0000","last_became_peered":"2024-05-09T09:55:41.487060+0000","last_unstale":"2024-05-09T09:55:57.400280+0000","last_undegraded":"2024-05-09T09:55:57.400280+0000","last_fullsized":"2024-05-09T09:55:57.400280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:54:51.000892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402309+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:55:57.402309+0000","last_peered":"2024-05-09T09:55:57.402309+0000","last_clean":"2024-05-09T09:55:57.402309+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:55:57.402309+0000","last_undegraded":"2024-05-09T09:55:57.402309+0000","last_fullsized":"2024-05-09T09:55:57.402309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'4","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702911+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:55:56.702911+0000","last_peered":"2024-05-09T09:55:56.702911+0000","last_clean":"2024-05-09T09:55:56.702911+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:55:56.702911+0000","last_undegraded":"2024-05-09T09:55:56.702911+0000","last_fullsized":"2024-05-09T09:55:56.702911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12294,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679625+0000","last_change":"2024-05-09T09:55:10.509010+0000","last_active":"2024-05-09T09:55:55.679625+0000","last_peered":"2024-05-09T09:55:55.679625+0000","last_clean":"2024-05-09T09:55:55.679625+0000","last_became_active":"2024-05-09T09:55:10.506778+0000","last_became_peered":"2024-05-09T09:55:10.506778+0000","last_unstale":"2024-05-09T09:55:55.679625+0000","last_undegraded":"2024-05-09T09:55:55.679625+0000","last_fullsized":"2024-05-09T09:55:55.679625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706557+0000","last_change":"2024-05-09T09:55:41.534680+0000","last_active":"2024-05-09T09:55:56.706557+0000","last_peered":"2024-05-09T09:55:56.706557+0000","last_clean":"2024-05-09T09:55:56.706557+0000","last_became_active":"2024-05-09T09:55:41.467079+0000","last_became_peered":"2024-05-09T09:55:41.467079+0000","last_unstale":"2024-05-09T09:55:56.706557+0000","last_undegraded":"2024-05-09T09:55:56.706557+0000","last_fullsized":"2024-05-09T09:55:56.706557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:22.934731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706204+0000","last_change":"2024-05-09T09:55:41.468769+0000","last_active":"2024-05-09T09:55:56.706204+0000","last_peered":"2024-05-09T09:55:56.706204+0000","last_clean":"2024-05-09T09:55:56.706204+0000","last_became_active":"2024-05-09T09:55:41.467929+0000","last_became_peered":"2024-05-09T09:55:41.467929+0000","last_unstale":"2024-05-09T09:55:56.706204+0000","last_undegraded":"2024-05-09T09:55:56.706204+0000","last_fullsized":"2024-05-09T09:55:56.706204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:02.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702279+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:55:56.702279+0000","last_peered":"2024-05-09T09:55:56.702279+0000","last_clean":"2024-05-09T09:55:56.702279+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:55:56.702279+0000","last_undegraded":"2024-05-09T09:55:56.702279+0000","last_fullsized":"2024-05-09T09:55:56.702279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705924+0000","last_change":"2024-05-09T09:55:10.483103+0000","last_active":"2024-05-09T09:55:56.705924+0000","last_peered":"2024-05-09T09:55:56.705924+0000","last_clean":"2024-05-09T09:55:56.705924+0000","last_became_active":"2024-05-09T09:55:10.482649+0000","last_became_peered":"2024-05-09T09:55:10.482649+0000","last_unstale":"2024-05-09T09:55:56.705924+0000","last_undegraded":"2024-05-09T09:55:56.705924+0000","last_fullsized":"2024-05-09T09:55:56.705924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'14","reported_seq":220,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678798+0000","last_change":"2024-05-09T09:55:45.036128+0000","last_active":"2024-05-09T09:55:55.678798+0000","last_peered":"2024-05-09T09:55:55.678798+0000","last_clean":"2024-05-09T09:55:55.678798+0000","last_became_active":"2024-05-09T09:55:41.508695+0000","last_became_peered":"2024-05-09T09:55:41.508695+0000","last_unstale":"2024-05-09T09:55:55.678798+0000","last_undegraded":"2024-05-09T09:55:55.678798+0000","last_fullsized":"2024-05-09T09:55:55.678798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":38936,"num_write":54,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680195+0000","last_change":"2024-05-09T09:55:10.510105+0000","last_active":"2024-05-09T09:55:55.680195+0000","last_peered":"2024-05-09T09:55:55.680195+0000","last_clean":"2024-05-09T09:55:55.680195+0000","last_became_active":"2024-05-09T09:55:10.508122+0000","last_became_peered":"2024-05-09T09:55:10.508122+0000","last_unstale":"2024-05-09T09:55:55.680195+0000","last_undegraded":"2024-05-09T09:55:55.680195+0000","last_fullsized":"2024-05-09T09:55:55.680195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"63'11","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511453+0000","last_change":"2024-05-09T09:55:43.116362+0000","last_active":"2024-05-09T09:55:57.511453+0000","last_peered":"2024-05-09T09:55:57.511453+0000","last_clean":"2024-05-09T09:55:57.511453+0000","last_became_active":"2024-05-09T09:55:41.506785+0000","last_became_peered":"2024-05-09T09:55:41.506785+0000","last_unstale":"2024-05-09T09:55:57.511453+0000","last_undegraded":"2024-05-09T09:55:57.511453+0000","last_fullsized":"2024-05-09T09:55:57.511453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:30.446781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"75'14","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681231+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:55:55.681231+0000","last_peered":"2024-05-09T09:55:55.681231+0000","last_clean":"2024-05-09T09:55:55.681231+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:55:55.681231+0000","last_undegraded":"2024-05-09T09:55:55.681231+0000","last_fullsized":"2024-05-09T09:55:55.681231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705111+0000","last_change":"2024-05-09T09:55:42.211684+0000","last_active":"2024-05-09T09:55:56.705111+0000","last_peered":"2024-05-09T09:55:56.705111+0000","last_clean":"2024-05-09T09:55:56.705111+0000","last_became_active":"2024-05-09T09:55:41.492528+0000","last_became_peered":"2024-05-09T09:55:41.492528+0000","last_unstale":"2024-05-09T09:55:56.705111+0000","last_undegraded":"2024-05-09T09:55:56.705111+0000","last_fullsized":"2024-05-09T09:55:56.705111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:23.272525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680947+0000","last_change":"2024-05-09T09:55:10.510510+0000","last_active":"2024-05-09T09:55:55.680947+0000","last_peered":"2024-05-09T09:55:55.680947+0000","last_clean":"2024-05-09T09:55:55.680947+0000","last_became_active":"2024-05-09T09:55:10.508721+0000","last_became_peered":"2024-05-09T09:55:10.508721+0000","last_unstale":"2024-05-09T09:55:55.680947+0000","last_undegraded":"2024-05-09T09:55:55.680947+0000","last_fullsized":"2024-05-09T09:55:55.680947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'7","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298120+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:55:57.298120+0000","last_peered":"2024-05-09T09:55:57.298120+0000","last_clean":"2024-05-09T09:55:57.298120+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:55:57.298120+0000","last_undegraded":"2024-05-09T09:55:57.298120+0000","last_fullsized":"2024-05-09T09:55:57.298120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401894+0000","last_change":"2024-05-09T09:55:10.508180+0000","last_active":"2024-05-09T09:55:57.401894+0000","last_peered":"2024-05-09T09:55:57.401894+0000","last_clean":"2024-05-09T09:55:57.401894+0000","last_became_active":"2024-05-09T09:55:10.507504+0000","last_became_peered":"2024-05-09T09:55:10.507504+0000","last_unstale":"2024-05-09T09:55:57.401894+0000","last_undegraded":"2024-05-09T09:55:57.401894+0000","last_fullsized":"2024-05-09T09:55:57.401894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:26.131778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"73'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681026+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:55:55.681026+0000","last_peered":"2024-05-09T09:55:55.681026+0000","last_clean":"2024-05-09T09:55:55.681026+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:55:55.681026+0000","last_undegraded":"2024-05-09T09:55:55.681026+0000","last_fullsized":"2024-05-09T09:55:55.681026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"75'17","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679404+0000","last_change":"2024-05-09T09:55:10.785031+0000","last_active":"2024-05-09T09:55:55.679404+0000","last_peered":"2024-05-09T09:55:55.679404+0000","last_clean":"2024-05-09T09:55:55.679404+0000","last_became_active":"2024-05-09T09:55:10.502644+0000","last_became_peered":"2024-05-09T09:55:10.502644+0000","last_unstale":"2024-05-09T09:55:55.679404+0000","last_undegraded":"2024-05-09T09:55:55.679404+0000","last_fullsized":"2024-05-09T09:55:55.679404+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:14.036784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400855+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:55:57.400855+0000","last_peered":"2024-05-09T09:55:57.400855+0000","last_clean":"2024-05-09T09:55:57.400855+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:55:57.400855+0000","last_undegraded":"2024-05-09T09:55:57.400855+0000","last_fullsized":"2024-05-09T09:55:57.400855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"75'12","reported_seq":216,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681855+0000","last_change":"2024-05-09T09:55:44.175359+0000","last_active":"2024-05-09T09:55:55.681855+0000","last_peered":"2024-05-09T09:55:55.681855+0000","last_clean":"2024-05-09T09:55:55.681855+0000","last_became_active":"2024-05-09T09:55:41.507201+0000","last_became_peered":"2024-05-09T09:55:41.507201+0000","last_unstale":"2024-05-09T09:55:55.681855+0000","last_undegraded":"2024-05-09T09:55:55.681855+0000","last_fullsized":"2024-05-09T09:55:55.681855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:07.511876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677971+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:55:55.677971+0000","last_peered":"2024-05-09T09:55:55.677971+0000","last_clean":"2024-05-09T09:55:55.677971+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:55:55.677971+0000","last_undegraded":"2024-05-09T09:55:55.677971+0000","last_fullsized":"2024-05-09T09:55:55.677971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'27","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401423+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:55:57.401423+0000","last_peered":"2024-05-09T09:55:57.401423+0000","last_clean":"2024-05-09T09:55:57.401423+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:55:57.401423+0000","last_undegraded":"2024-05-09T09:55:57.401423+0000","last_fullsized":"2024-05-09T09:55:57.401423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704309+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:55:56.704309+0000","last_peered":"2024-05-09T09:55:56.704309+0000","last_clean":"2024-05-09T09:55:56.704309+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:55:56.704309+0000","last_undegraded":"2024-05-09T09:55:56.704309+0000","last_fullsized":"2024-05-09T09:55:56.704309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401424+0000","last_change":"2024-05-09T09:55:41.485193+0000","last_active":"2024-05-09T09:55:57.401424+0000","last_peered":"2024-05-09T09:55:57.401424+0000","last_clean":"2024-05-09T09:55:57.401424+0000","last_became_active":"2024-05-09T09:55:41.484312+0000","last_became_peered":"2024-05-09T09:55:41.484312+0000","last_unstale":"2024-05-09T09:55:57.401424+0000","last_undegraded":"2024-05-09T09:55:57.401424+0000","last_fullsized":"2024-05-09T09:55:57.401424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:59.737104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704125+0000","last_change":"2024-05-09T09:55:41.479720+0000","last_active":"2024-05-09T09:55:56.704125+0000","last_peered":"2024-05-09T09:55:56.704125+0000","last_clean":"2024-05-09T09:55:56.704125+0000","last_became_active":"2024-05-09T09:55:41.472133+0000","last_became_peered":"2024-05-09T09:55:41.472133+0000","last_unstale":"2024-05-09T09:55:56.704125+0000","last_undegraded":"2024-05-09T09:55:56.704125+0000","last_fullsized":"2024-05-09T09:55:56.704125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:55.564231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"64'4","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681445+0000","last_change":"2024-05-09T09:55:44.852684+0000","last_active":"2024-05-09T09:55:55.681445+0000","last_peered":"2024-05-09T09:55:55.681445+0000","last_clean":"2024-05-09T09:55:55.681445+0000","last_became_active":"2024-05-09T09:55:41.507751+0000","last_became_peered":"2024-05-09T09:55:41.507751+0000","last_unstale":"2024-05-09T09:55:55.681445+0000","last_undegraded":"2024-05-09T09:55:55.681445+0000","last_fullsized":"2024-05-09T09:55:55.681445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:13.201219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511904+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:55:57.511904+0000","last_peered":"2024-05-09T09:55:57.511904+0000","last_clean":"2024-05-09T09:55:57.511904+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:55:57.511904+0000","last_undegraded":"2024-05-09T09:55:57.511904+0000","last_fullsized":"2024-05-09T09:55:57.511904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"73'13","reported_seq":55,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677844+0000","last_change":"2024-05-09T09:55:11.749967+0000","last_active":"2024-05-09T09:55:55.677844+0000","last_peered":"2024-05-09T09:55:55.677844+0000","last_clean":"2024-05-09T09:55:55.677844+0000","last_became_active":"2024-05-09T09:55:10.522763+0000","last_became_peered":"2024-05-09T09:55:10.522763+0000","last_unstale":"2024-05-09T09:55:55.677844+0000","last_undegraded":"2024-05-09T09:55:55.677844+0000","last_fullsized":"2024-05-09T09:55:55.677844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:03.450608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677898+0000","last_change":"2024-05-09T09:55:10.505759+0000","last_active":"2024-05-09T09:55:55.677898+0000","last_peered":"2024-05-09T09:55:55.677898+0000","last_clean":"2024-05-09T09:55:55.677898+0000","last_became_active":"2024-05-09T09:55:10.504789+0000","last_became_peered":"2024-05-09T09:55:10.504789+0000","last_unstale":"2024-05-09T09:55:55.677898+0000","last_undegraded":"2024-05-09T09:55:55.677898+0000","last_fullsized":"2024-05-09T09:55:55.677898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:53.805557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298207+0000","last_change":"2024-05-09T09:55:41.506430+0000","last_active":"2024-05-09T09:55:57.298207+0000","last_peered":"2024-05-09T09:55:57.298207+0000","last_clean":"2024-05-09T09:55:57.298207+0000","last_became_active":"2024-05-09T09:55:41.505745+0000","last_became_peered":"2024-05-09T09:55:41.505745+0000","last_unstale":"2024-05-09T09:55:57.298207+0000","last_undegraded":"2024-05-09T09:55:57.298207+0000","last_fullsized":"2024-05-09T09:55:57.298207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:18.090362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'12","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680190+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:55:55.680190+0000","last_peered":"2024-05-09T09:55:55.680190+0000","last_clean":"2024-05-09T09:55:55.680190+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:55:55.680190+0000","last_undegraded":"2024-05-09T09:55:55.680190+0000","last_fullsized":"2024-05-09T09:55:55.680190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512208+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:55:57.512208+0000","last_peered":"2024-05-09T09:55:57.512208+0000","last_clean":"2024-05-09T09:55:57.512208+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:55:57.512208+0000","last_undegraded":"2024-05-09T09:55:57.512208+0000","last_fullsized":"2024-05-09T09:55:57.512208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"73'21","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678181+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:55:55.678181+0000","last_peered":"2024-05-09T09:55:55.678181+0000","last_clean":"2024-05-09T09:55:55.678181+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:55:55.678181+0000","last_undegraded":"2024-05-09T09:55:55.678181+0000","last_fullsized":"2024-05-09T09:55:55.678181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"75'14","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700958+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:55:56.700958+0000","last_peered":"2024-05-09T09:55:56.700958+0000","last_clean":"2024-05-09T09:55:56.700958+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:55:56.700958+0000","last_undegraded":"2024-05-09T09:55:56.700958+0000","last_fullsized":"2024-05-09T09:55:56.700958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706729+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:55:56.706729+0000","last_peered":"2024-05-09T09:55:56.706729+0000","last_clean":"2024-05-09T09:55:56.706729+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:55:56.706729+0000","last_undegraded":"2024-05-09T09:55:56.706729+0000","last_fullsized":"2024-05-09T09:55:56.706729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705393+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:55:56.705393+0000","last_peered":"2024-05-09T09:55:56.705393+0000","last_clean":"2024-05-09T09:55:56.705393+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:55:56.705393+0000","last_undegraded":"2024-05-09T09:55:56.705393+0000","last_fullsized":"2024-05-09T09:55:56.705393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'12","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402227+0000","last_change":"2024-05-09T09:55:11.694165+0000","last_active":"2024-05-09T09:55:57.402227+0000","last_peered":"2024-05-09T09:55:57.402227+0000","last_clean":"2024-05-09T09:55:57.402227+0000","last_became_active":"2024-05-09T09:55:10.521894+0000","last_became_peered":"2024-05-09T09:55:10.521894+0000","last_unstale":"2024-05-09T09:55:57.402227+0000","last_undegraded":"2024-05-09T09:55:57.402227+0000","last_fullsized":"2024-05-09T09:55:57.402227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:04.661085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38924,"num_write":32,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511206+0000","last_change":"2024-05-09T09:55:41.484220+0000","last_active":"2024-05-09T09:55:57.511206+0000","last_peered":"2024-05-09T09:55:57.511206+0000","last_clean":"2024-05-09T09:55:57.511206+0000","last_became_active":"2024-05-09T09:55:41.483828+0000","last_became_peered":"2024-05-09T09:55:41.483828+0000","last_unstale":"2024-05-09T09:55:57.511206+0000","last_undegraded":"2024-05-09T09:55:57.511206+0000","last_fullsized":"2024-05-09T09:55:57.511206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:12.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701503+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:55:56.701503+0000","last_peered":"2024-05-09T09:55:56.701503+0000","last_clean":"2024-05-09T09:55:56.701503+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:55:56.701503+0000","last_undegraded":"2024-05-09T09:55:56.701503+0000","last_fullsized":"2024-05-09T09:55:56.701503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13754,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":60,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511648+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:55:57.511648+0000","last_peered":"2024-05-09T09:55:57.511648+0000","last_clean":"2024-05-09T09:55:57.511648+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:55:57.511648+0000","last_undegraded":"2024-05-09T09:55:57.511648+0000","last_fullsized":"2024-05-09T09:55:57.511648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703562+0000","last_change":"2024-05-09T09:55:10.518479+0000","last_active":"2024-05-09T09:55:56.703562+0000","last_peered":"2024-05-09T09:55:56.703562+0000","last_clean":"2024-05-09T09:55:56.703562+0000","last_became_active":"2024-05-09T09:55:10.518109+0000","last_became_peered":"2024-05-09T09:55:10.518109+0000","last_unstale":"2024-05-09T09:55:56.703562+0000","last_undegraded":"2024-05-09T09:55:56.703562+0000","last_fullsized":"2024-05-09T09:55:56.703562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705558+0000","last_change":"2024-05-09T09:55:41.491823+0000","last_active":"2024-05-09T09:55:56.705558+0000","last_peered":"2024-05-09T09:55:56.705558+0000","last_clean":"2024-05-09T09:55:56.705558+0000","last_became_active":"2024-05-09T09:55:41.488846+0000","last_became_peered":"2024-05-09T09:55:41.488846+0000","last_unstale":"2024-05-09T09:55:56.705558+0000","last_undegraded":"2024-05-09T09:55:56.705558+0000","last_fullsized":"2024-05-09T09:55:56.705558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:00.130607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"73'11","reported_seq":61,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678718+0000","last_change":"2024-05-09T09:55:10.972117+0000","last_active":"2024-05-09T09:55:55.678718+0000","last_peered":"2024-05-09T09:55:55.678718+0000","last_clean":"2024-05-09T09:55:55.678718+0000","last_became_active":"2024-05-09T09:55:10.507132+0000","last_became_peered":"2024-05-09T09:55:10.507132+0000","last_unstale":"2024-05-09T09:55:55.678718+0000","last_undegraded":"2024-05-09T09:55:55.678718+0000","last_fullsized":"2024-05-09T09:55:55.678718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:59.211608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":22550,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512533+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:55:57.512533+0000","last_peered":"2024-05-09T09:55:57.512533+0000","last_clean":"2024-05-09T09:55:57.512533+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:55:57.512533+0000","last_undegraded":"2024-05-09T09:55:57.512533+0000","last_fullsized":"2024-05-09T09:55:57.512533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"78'20","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706140+0000","last_change":"2024-05-09T09:55:42.405072+0000","last_active":"2024-05-09T09:55:56.706140+0000","last_peered":"2024-05-09T09:55:56.706140+0000","last_clean":"2024-05-09T09:55:56.706140+0000","last_became_active":"2024-05-09T09:55:41.509467+0000","last_became_peered":"2024-05-09T09:55:41.509467+0000","last_unstale":"2024-05-09T09:55:56.706140+0000","last_undegraded":"2024-05-09T09:55:56.706140+0000","last_fullsized":"2024-05-09T09:55:56.706140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:31.891322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":28,"num_write":26,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":6936,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706227+0000","last_change":"2024-05-09T09:55:10.506676+0000","last_active":"2024-05-09T09:55:56.706227+0000","last_peered":"2024-05-09T09:55:56.706227+0000","last_clean":"2024-05-09T09:55:56.706227+0000","last_became_active":"2024-05-09T09:55:10.506376+0000","last_became_peered":"2024-05-09T09:55:10.506376+0000","last_unstale":"2024-05-09T09:55:56.706227+0000","last_undegraded":"2024-05-09T09:55:56.706227+0000","last_fullsized":"2024-05-09T09:55:56.706227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:18.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"63'2","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678205+0000","last_change":"2024-05-09T09:55:11.409285+0000","last_active":"2024-05-09T09:55:55.678205+0000","last_peered":"2024-05-09T09:55:55.678205+0000","last_clean":"2024-05-09T09:55:55.678205+0000","last_became_active":"2024-05-09T09:55:10.512509+0000","last_became_peered":"2024-05-09T09:55:10.512509+0000","last_unstale":"2024-05-09T09:55:55.678205+0000","last_undegraded":"2024-05-09T09:55:55.678205+0000","last_fullsized":"2024-05-09T09:55:55.678205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:08.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706333+0000","last_change":"2024-05-09T09:55:41.477052+0000","last_active":"2024-05-09T09:55:56.706333+0000","last_peered":"2024-05-09T09:55:56.706333+0000","last_clean":"2024-05-09T09:55:56.706333+0000","last_became_active":"2024-05-09T09:55:41.471497+0000","last_became_peered":"2024-05-09T09:55:41.471497+0000","last_unstale":"2024-05-09T09:55:56.706333+0000","last_undegraded":"2024-05-09T09:55:56.706333+0000","last_fullsized":"2024-05-09T09:55:56.706333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:59:59.078912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'10","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298753+0000","last_change":"2024-05-09T09:55:42.508840+0000","last_active":"2024-05-09T09:55:57.298753+0000","last_peered":"2024-05-09T09:55:57.298753+0000","last_clean":"2024-05-09T09:55:57.298753+0000","last_became_active":"2024-05-09T09:55:41.513259+0000","last_became_peered":"2024-05-09T09:55:41.513259+0000","last_unstale":"2024-05-09T09:55:57.298753+0000","last_undegraded":"2024-05-09T09:55:57.298753+0000","last_fullsized":"2024-05-09T09:55:57.298753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703127+0000","last_change":"2024-05-09T09:55:41.505012+0000","last_active":"2024-05-09T09:55:56.703127+0000","last_peered":"2024-05-09T09:55:56.703127+0000","last_clean":"2024-05-09T09:55:56.703127+0000","last_became_active":"2024-05-09T09:55:41.504609+0000","last_became_peered":"2024-05-09T09:55:41.504609+0000","last_unstale":"2024-05-09T09:55:56.703127+0000","last_undegraded":"2024-05-09T09:55:56.703127+0000","last_fullsized":"2024-05-09T09:55:56.703127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"73'24","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512979+0000","last_change":"2024-05-09T09:55:10.818400+0000","last_active":"2024-05-09T09:55:57.512979+0000","last_peered":"2024-05-09T09:55:57.512979+0000","last_clean":"2024-05-09T09:55:57.512979+0000","last_became_active":"2024-05-09T09:55:10.520615+0000","last_became_peered":"2024-05-09T09:55:10.520615+0000","last_unstale":"2024-05-09T09:55:57.512979+0000","last_undegraded":"2024-05-09T09:55:57.512979+0000","last_fullsized":"2024-05-09T09:55:57.512979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:32.213479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":3002,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"75'14","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512957+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:55:57.512957+0000","last_peered":"2024-05-09T09:55:57.512957+0000","last_clean":"2024-05-09T09:55:57.512957+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:55:57.512957+0000","last_undegraded":"2024-05-09T09:55:57.512957+0000","last_fullsized":"2024-05-09T09:55:57.512957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702414+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:55:56.702414+0000","last_peered":"2024-05-09T09:55:56.702414+0000","last_clean":"2024-05-09T09:55:56.702414+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:55:56.702414+0000","last_undegraded":"2024-05-09T09:55:56.702414+0000","last_fullsized":"2024-05-09T09:55:56.702414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706758+0000","last_change":"2024-05-09T09:55:42.572344+0000","last_active":"2024-05-09T09:55:56.706758+0000","last_peered":"2024-05-09T09:55:56.706758+0000","last_clean":"2024-05-09T09:55:56.706758+0000","last_became_active":"2024-05-09T09:55:41.517278+0000","last_became_peered":"2024-05-09T09:55:41.517278+0000","last_unstale":"2024-05-09T09:55:56.706758+0000","last_undegraded":"2024-05-09T09:55:56.706758+0000","last_fullsized":"2024-05-09T09:55:56.706758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'12","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704482+0000","last_change":"2024-05-09T09:55:42.204305+0000","last_active":"2024-05-09T09:55:56.704482+0000","last_peered":"2024-05-09T09:55:56.704482+0000","last_clean":"2024-05-09T09:55:56.704482+0000","last_became_active":"2024-05-09T09:55:41.481490+0000","last_became_peered":"2024-05-09T09:55:41.481490+0000","last_unstale":"2024-05-09T09:55:56.704482+0000","last_undegraded":"2024-05-09T09:55:56.704482+0000","last_fullsized":"2024-05-09T09:55:56.704482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402933+0000","last_change":"2024-05-09T09:55:41.651487+0000","last_active":"2024-05-09T09:55:57.402933+0000","last_peered":"2024-05-09T09:55:57.402933+0000","last_clean":"2024-05-09T09:55:57.402933+0000","last_became_active":"2024-05-09T09:55:41.495448+0000","last_became_peered":"2024-05-09T09:55:41.495448+0000","last_unstale":"2024-05-09T09:55:57.402933+0000","last_undegraded":"2024-05-09T09:55:57.402933+0000","last_fullsized":"2024-05-09T09:55:57.402933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:09.689288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":57,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679462+0000","last_change":"2024-05-09T09:55:11.115278+0000","last_active":"2024-05-09T09:55:55.679462+0000","last_peered":"2024-05-09T09:55:55.679462+0000","last_clean":"2024-05-09T09:55:55.679462+0000","last_became_active":"2024-05-09T09:55:10.512273+0000","last_became_peered":"2024-05-09T09:55:10.512273+0000","last_unstale":"2024-05-09T09:55:55.679462+0000","last_undegraded":"2024-05-09T09:55:55.679462+0000","last_fullsized":"2024-05-09T09:55:55.679462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:23:44.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"75'14","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298672+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:55:57.298672+0000","last_peered":"2024-05-09T09:55:57.298672+0000","last_clean":"2024-05-09T09:55:57.298672+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:55:57.298672+0000","last_undegraded":"2024-05-09T09:55:57.298672+0000","last_fullsized":"2024-05-09T09:55:57.298672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705087+0000","last_change":"2024-05-09T09:55:41.475763+0000","last_active":"2024-05-09T09:55:56.705087+0000","last_peered":"2024-05-09T09:55:56.705087+0000","last_clean":"2024-05-09T09:55:56.705087+0000","last_became_active":"2024-05-09T09:55:41.474020+0000","last_became_peered":"2024-05-09T09:55:41.474020+0000","last_unstale":"2024-05-09T09:55:56.705087+0000","last_undegraded":"2024-05-09T09:55:56.705087+0000","last_fullsized":"2024-05-09T09:55:56.705087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:59.415817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"75'42","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703965+0000","last_change":"2024-05-09T09:55:11.077756+0000","last_active":"2024-05-09T09:55:56.703965+0000","last_peered":"2024-05-09T09:55:56.703965+0000","last_clean":"2024-05-09T09:55:56.703965+0000","last_became_active":"2024-05-09T09:55:10.516407+0000","last_became_peered":"2024-05-09T09:55:10.516407+0000","last_unstale":"2024-05-09T09:55:56.703965+0000","last_undegraded":"2024-05-09T09:55:56.703965+0000","last_fullsized":"2024-05-09T09:55:56.703965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:29.572431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'7","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677715+0000","last_change":"2024-05-09T09:55:11.190571+0000","last_active":"2024-05-09T09:55:55.677715+0000","last_peered":"2024-05-09T09:55:55.677715+0000","last_clean":"2024-05-09T09:55:55.677715+0000","last_became_active":"2024-05-09T09:55:10.516633+0000","last_became_peered":"2024-05-09T09:55:10.516633+0000","last_unstale":"2024-05-09T09:55:55.677715+0000","last_undegraded":"2024-05-09T09:55:55.677715+0000","last_fullsized":"2024-05-09T09:55:55.677715+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:56.816319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706539+0000","last_change":"2024-05-09T09:55:41.480580+0000","last_active":"2024-05-09T09:55:56.706539+0000","last_peered":"2024-05-09T09:55:56.706539+0000","last_clean":"2024-05-09T09:55:56.706539+0000","last_became_active":"2024-05-09T09:55:41.479634+0000","last_became_peered":"2024-05-09T09:55:41.479634+0000","last_unstale":"2024-05-09T09:55:56.706539+0000","last_undegraded":"2024-05-09T09:55:56.706539+0000","last_fullsized":"2024-05-09T09:55:56.706539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:12.037871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401416+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:55:57.401416+0000","last_peered":"2024-05-09T09:55:57.401416+0000","last_clean":"2024-05-09T09:55:57.401416+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:55:57.401416+0000","last_undegraded":"2024-05-09T09:55:57.401416+0000","last_fullsized":"2024-05-09T09:55:57.401416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298448+0000","last_change":"2024-05-09T09:55:10.503163+0000","last_active":"2024-05-09T09:55:57.298448+0000","last_peered":"2024-05-09T09:55:57.298448+0000","last_clean":"2024-05-09T09:55:57.298448+0000","last_became_active":"2024-05-09T09:55:10.501658+0000","last_became_peered":"2024-05-09T09:55:10.501658+0000","last_unstale":"2024-05-09T09:55:57.298448+0000","last_undegraded":"2024-05-09T09:55:57.298448+0000","last_fullsized":"2024-05-09T09:55:57.298448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:16.963610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704206+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:55:56.704206+0000","last_peered":"2024-05-09T09:55:56.704206+0000","last_clean":"2024-05-09T09:55:56.704206+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:55:56.704206+0000","last_undegraded":"2024-05-09T09:55:56.704206+0000","last_fullsized":"2024-05-09T09:55:56.704206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299020+0000","last_change":"2024-05-09T09:55:41.514105+0000","last_active":"2024-05-09T09:55:57.299020+0000","last_peered":"2024-05-09T09:55:57.299020+0000","last_clean":"2024-05-09T09:55:57.299020+0000","last_became_active":"2024-05-09T09:55:41.513454+0000","last_became_peered":"2024-05-09T09:55:41.513454+0000","last_unstale":"2024-05-09T09:55:57.299020+0000","last_undegraded":"2024-05-09T09:55:57.299020+0000","last_fullsized":"2024-05-09T09:55:57.299020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:12.201246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":316,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678368+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:55:55.678368+0000","last_peered":"2024-05-09T09:55:55.678368+0000","last_clean":"2024-05-09T09:55:55.678368+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:55:55.678368+0000","last_undegraded":"2024-05-09T09:55:55.678368+0000","last_fullsized":"2024-05-09T09:55:55.678368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401371+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:55:57.401371+0000","last_peered":"2024-05-09T09:55:57.401371+0000","last_clean":"2024-05-09T09:55:57.401371+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:55:57.401371+0000","last_undegraded":"2024-05-09T09:55:57.401371+0000","last_fullsized":"2024-05-09T09:55:57.401371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'10","reported_seq":65,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677799+0000","last_change":"2024-05-09T09:55:10.921973+0000","last_active":"2024-05-09T09:55:55.677799+0000","last_peered":"2024-05-09T09:55:55.677799+0000","last_clean":"2024-05-09T09:55:55.677799+0000","last_became_active":"2024-05-09T09:55:10.505428+0000","last_became_peered":"2024-05-09T09:55:10.505428+0000","last_unstale":"2024-05-09T09:55:55.677799+0000","last_undegraded":"2024-05-09T09:55:55.677799+0000","last_fullsized":"2024-05-09T09:55:55.677799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:11.081894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679490+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:55:55.679490+0000","last_peered":"2024-05-09T09:55:55.679490+0000","last_clean":"2024-05-09T09:55:55.679490+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:55:55.679490+0000","last_undegraded":"2024-05-09T09:55:55.679490+0000","last_fullsized":"2024-05-09T09:55:55.679490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'36","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402785+0000","last_change":"2024-05-09T09:55:11.706091+0000","last_active":"2024-05-09T09:55:57.402785+0000","last_peered":"2024-05-09T09:55:57.402785+0000","last_clean":"2024-05-09T09:55:57.402785+0000","last_became_active":"2024-05-09T09:55:10.522989+0000","last_became_peered":"2024-05-09T09:55:10.522989+0000","last_unstale":"2024-05-09T09:55:57.402785+0000","last_undegraded":"2024-05-09T09:55:57.402785+0000","last_fullsized":"2024-05-09T09:55:57.402785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:21.617588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":11272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706558+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:55:56.706558+0000","last_peered":"2024-05-09T09:55:56.706558+0000","last_clean":"2024-05-09T09:55:56.706558+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:55:56.706558+0000","last_undegraded":"2024-05-09T09:55:56.706558+0000","last_fullsized":"2024-05-09T09:55:56.706558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297460+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:55:57.297460+0000","last_peered":"2024-05-09T09:55:57.297460+0000","last_clean":"2024-05-09T09:55:57.297460+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:55:57.297460+0000","last_undegraded":"2024-05-09T09:55:57.297460+0000","last_fullsized":"2024-05-09T09:55:57.297460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706199+0000","last_change":"2024-05-09T09:53:54.476843+0000","last_active":"2024-05-09T09:55:56.706199+0000","last_peered":"2024-05-09T09:55:56.706199+0000","last_clean":"2024-05-09T09:55:56.706199+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:55:56.706199+0000","last_undegraded":"2024-05-09T09:55:56.706199+0000","last_fullsized":"2024-05-09T09:55:56.706199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:48.486905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678114+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:55:55.678114+0000","last_peered":"2024-05-09T09:55:55.678114+0000","last_clean":"2024-05-09T09:55:55.678114+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:55:55.678114+0000","last_undegraded":"2024-05-09T09:55:55.678114+0000","last_fullsized":"2024-05-09T09:55:55.678114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701698+0000","last_change":"2024-05-09T09:55:42.599407+0000","last_active":"2024-05-09T09:55:56.701698+0000","last_peered":"2024-05-09T09:55:56.701698+0000","last_clean":"2024-05-09T09:55:56.701698+0000","last_became_active":"2024-05-09T09:55:41.489210+0000","last_became_peered":"2024-05-09T09:55:41.489210+0000","last_unstale":"2024-05-09T09:55:56.701698+0000","last_undegraded":"2024-05-09T09:55:56.701698+0000","last_fullsized":"2024-05-09T09:55:56.701698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:36:38.674440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":7,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402446+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:55:57.402446+0000","last_peered":"2024-05-09T09:55:57.402446+0000","last_clean":"2024-05-09T09:55:57.402446+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:55:57.402446+0000","last_undegraded":"2024-05-09T09:55:57.402446+0000","last_fullsized":"2024-05-09T09:55:57.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'59","reported_seq":265,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703222+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:55:56.703222+0000","last_peered":"2024-05-09T09:55:56.703222+0000","last_clean":"2024-05-09T09:55:56.703222+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:55:56.703222+0000","last_undegraded":"2024-05-09T09:55:56.703222+0000","last_fullsized":"2024-05-09T09:55:56.703222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26264,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":86,"num_read_kb":110,"num_write":58,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681115+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:55:55.681115+0000","last_peered":"2024-05-09T09:55:55.681115+0000","last_clean":"2024-05-09T09:55:55.681115+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:55:55.681115+0000","last_undegraded":"2024-05-09T09:55:55.681115+0000","last_fullsized":"2024-05-09T09:55:55.681115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704712+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:55:56.704712+0000","last_peered":"2024-05-09T09:55:56.704712+0000","last_clean":"2024-05-09T09:55:56.704712+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:55:56.704712+0000","last_undegraded":"2024-05-09T09:55:56.704712+0000","last_fullsized":"2024-05-09T09:55:56.704712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'46","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704619+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:55:56.704619+0000","last_peered":"2024-05-09T09:55:56.704619+0000","last_clean":"2024-05-09T09:55:56.704619+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:55:56.704619+0000","last_undegraded":"2024-05-09T09:55:56.704619+0000","last_fullsized":"2024-05-09T09:55:56.704619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512113+0000","last_change":"2024-05-09T09:55:10.500785+0000","last_active":"2024-05-09T09:55:57.512113+0000","last_peered":"2024-05-09T09:55:57.512113+0000","last_clean":"2024-05-09T09:55:57.512113+0000","last_became_active":"2024-05-09T09:55:10.500197+0000","last_became_peered":"2024-05-09T09:55:10.500197+0000","last_unstale":"2024-05-09T09:55:57.512113+0000","last_undegraded":"2024-05-09T09:55:57.512113+0000","last_fullsized":"2024-05-09T09:55:57.512113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:17.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700597+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:55:56.700597+0000","last_peered":"2024-05-09T09:55:56.700597+0000","last_clean":"2024-05-09T09:55:56.700597+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:55:56.700597+0000","last_undegraded":"2024-05-09T09:55:56.700597+0000","last_fullsized":"2024-05-09T09:55:56.700597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513015+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:55:57.513015+0000","last_peered":"2024-05-09T09:55:57.513015+0000","last_clean":"2024-05-09T09:55:57.513015+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:55:57.513015+0000","last_undegraded":"2024-05-09T09:55:57.513015+0000","last_fullsized":"2024-05-09T09:55:57.513015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"30'15","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680934+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:55:55.680934+0000","last_peered":"2024-05-09T09:55:55.680934+0000","last_clean":"2024-05-09T09:55:55.680934+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:55:55.680934+0000","last_undegraded":"2024-05-09T09:55:55.680934+0000","last_fullsized":"2024-05-09T09:55:55.680934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704334+0000","last_change":"2024-05-09T09:55:41.486659+0000","last_active":"2024-05-09T09:55:56.704334+0000","last_peered":"2024-05-09T09:55:56.704334+0000","last_clean":"2024-05-09T09:55:56.704334+0000","last_became_active":"2024-05-09T09:55:41.486383+0000","last_became_peered":"2024-05-09T09:55:41.486383+0000","last_unstale":"2024-05-09T09:55:56.704334+0000","last_undegraded":"2024-05-09T09:55:56.704334+0000","last_fullsized":"2024-05-09T09:55:56.704334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:13.922715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"75'2","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678949+0000","last_change":"2024-05-09T09:55:44.856823+0000","last_active":"2024-05-09T09:55:55.678949+0000","last_peered":"2024-05-09T09:55:55.678949+0000","last_clean":"2024-05-09T09:55:55.678949+0000","last_became_active":"2024-05-09T09:55:41.512553+0000","last_became_peered":"2024-05-09T09:55:41.512553+0000","last_unstale":"2024-05-09T09:55:55.678949+0000","last_undegraded":"2024-05-09T09:55:55.678949+0000","last_fullsized":"2024-05-09T09:55:55.678949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401767+0000","last_change":"2024-05-09T09:54:55.401865+0000","last_active":"2024-05-09T09:55:57.401767+0000","last_peered":"2024-05-09T09:55:57.401767+0000","last_clean":"2024-05-09T09:55:57.401767+0000","last_became_active":"2024-05-09T09:54:55.401038+0000","last_became_peered":"2024-05-09T09:54:55.401038+0000","last_unstale":"2024-05-09T09:55:57.401767+0000","last_undegraded":"2024-05-09T09:55:57.401767+0000","last_fullsized":"2024-05-09T09:55:57.401767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:01.972187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399656+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:55:57.399656+0000","last_peered":"2024-05-09T09:55:57.399656+0000","last_clean":"2024-05-09T09:55:57.399656+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:55:57.399656+0000","last_undegraded":"2024-05-09T09:55:57.399656+0000","last_fullsized":"2024-05-09T09:55:57.399656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705226+0000","last_change":"2024-05-09T09:55:41.719143+0000","last_active":"2024-05-09T09:55:56.705226+0000","last_peered":"2024-05-09T09:55:56.705226+0000","last_clean":"2024-05-09T09:55:56.705226+0000","last_became_active":"2024-05-09T09:55:41.469663+0000","last_became_peered":"2024-05-09T09:55:41.469663+0000","last_unstale":"2024-05-09T09:55:56.705226+0000","last_undegraded":"2024-05-09T09:55:56.705226+0000","last_fullsized":"2024-05-09T09:55:56.705226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:45.753913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705749+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:55:56.705749+0000","last_peered":"2024-05-09T09:55:56.705749+0000","last_clean":"2024-05-09T09:55:56.705749+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:55:56.705749+0000","last_undegraded":"2024-05-09T09:55:56.705749+0000","last_fullsized":"2024-05-09T09:55:56.705749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":78,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678610+0000","last_change":"2024-05-09T09:55:42.823551+0000","last_active":"2024-05-09T09:55:55.678610+0000","last_peered":"2024-05-09T09:55:55.678610+0000","last_clean":"2024-05-09T09:55:55.678610+0000","last_became_active":"2024-05-09T09:55:41.504368+0000","last_became_peered":"2024-05-09T09:55:41.504368+0000","last_unstale":"2024-05-09T09:55:55.678610+0000","last_undegraded":"2024-05-09T09:55:55.678610+0000","last_fullsized":"2024-05-09T09:55:55.678610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:38.841317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299096+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:55:57.299096+0000","last_peered":"2024-05-09T09:55:57.299096+0000","last_clean":"2024-05-09T09:55:57.299096+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:55:57.299096+0000","last_undegraded":"2024-05-09T09:55:57.299096+0000","last_fullsized":"2024-05-09T09:55:57.299096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400161+0000","last_change":"2024-05-09T09:55:10.495545+0000","last_active":"2024-05-09T09:55:57.400161+0000","last_peered":"2024-05-09T09:55:57.400161+0000","last_clean":"2024-05-09T09:55:57.400161+0000","last_became_active":"2024-05-09T09:55:10.494741+0000","last_became_peered":"2024-05-09T09:55:10.494741+0000","last_unstale":"2024-05-09T09:55:57.400161+0000","last_undegraded":"2024-05-09T09:55:57.400161+0000","last_fullsized":"2024-05-09T09:55:57.400161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:36.220917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703539+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:55:56.703539+0000","last_peered":"2024-05-09T09:55:56.703539+0000","last_clean":"2024-05-09T09:55:56.703539+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:55:56.703539+0000","last_undegraded":"2024-05-09T09:55:56.703539+0000","last_fullsized":"2024-05-09T09:55:56.703539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'13","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402554+0000","last_change":"2024-05-09T09:55:10.791937+0000","last_active":"2024-05-09T09:55:57.402554+0000","last_peered":"2024-05-09T09:55:57.402554+0000","last_clean":"2024-05-09T09:55:57.402554+0000","last_became_active":"2024-05-09T09:55:10.494626+0000","last_became_peered":"2024-05-09T09:55:10.494626+0000","last_unstale":"2024-05-09T09:55:57.402554+0000","last_undegraded":"2024-05-09T09:55:57.402554+0000","last_fullsized":"2024-05-09T09:55:57.402554+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:06:49.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702746+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:55:56.702746+0000","last_peered":"2024-05-09T09:55:56.702746+0000","last_clean":"2024-05-09T09:55:56.702746+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:55:56.702746+0000","last_undegraded":"2024-05-09T09:55:56.702746+0000","last_fullsized":"2024-05-09T09:55:56.702746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704736+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:55:56.704736+0000","last_peered":"2024-05-09T09:55:56.704736+0000","last_clean":"2024-05-09T09:55:56.704736+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:55:56.704736+0000","last_undegraded":"2024-05-09T09:55:56.704736+0000","last_fullsized":"2024-05-09T09:55:56.704736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'32","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700571+0000","last_change":"2024-05-09T09:55:10.807327+0000","last_active":"2024-05-09T09:55:56.700571+0000","last_peered":"2024-05-09T09:55:56.700571+0000","last_clean":"2024-05-09T09:55:56.700571+0000","last_became_active":"2024-05-09T09:55:10.495540+0000","last_became_peered":"2024-05-09T09:55:10.495540+0000","last_unstale":"2024-05-09T09:55:56.700571+0000","last_undegraded":"2024-05-09T09:55:56.700571+0000","last_fullsized":"2024-05-09T09:55:56.700571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:01.735473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":3221,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704004+0000","last_change":"2024-05-09T09:55:41.499842+0000","last_active":"2024-05-09T09:55:56.704004+0000","last_peered":"2024-05-09T09:55:56.704004+0000","last_clean":"2024-05-09T09:55:56.704004+0000","last_became_active":"2024-05-09T09:55:41.496466+0000","last_became_peered":"2024-05-09T09:55:41.496466+0000","last_unstale":"2024-05-09T09:55:56.704004+0000","last_undegraded":"2024-05-09T09:55:56.704004+0000","last_fullsized":"2024-05-09T09:55:56.704004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:35.612226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706873+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:55:56.706873+0000","last_peered":"2024-05-09T09:55:56.706873+0000","last_clean":"2024-05-09T09:55:56.706873+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:55:56.706873+0000","last_undegraded":"2024-05-09T09:55:56.706873+0000","last_fullsized":"2024-05-09T09:55:56.706873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705288+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:55:56.705288+0000","last_peered":"2024-05-09T09:55:56.705288+0000","last_clean":"2024-05-09T09:55:56.705288+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:55:56.705288+0000","last_undegraded":"2024-05-09T09:55:56.705288+0000","last_fullsized":"2024-05-09T09:55:56.705288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702837+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:55:56.702837+0000","last_peered":"2024-05-09T09:55:56.702837+0000","last_clean":"2024-05-09T09:55:56.702837+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:55:56.702837+0000","last_undegraded":"2024-05-09T09:55:56.702837+0000","last_fullsized":"2024-05-09T09:55:56.702837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":22546,"num_write":39,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678937+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:55:55.678937+0000","last_peered":"2024-05-09T09:55:55.678937+0000","last_clean":"2024-05-09T09:55:55.678937+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:55:55.678937+0000","last_undegraded":"2024-05-09T09:55:55.678937+0000","last_fullsized":"2024-05-09T09:55:55.678937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298282+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:55:57.298282+0000","last_peered":"2024-05-09T09:55:57.298282+0000","last_clean":"2024-05-09T09:55:57.298282+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:55:57.298282+0000","last_undegraded":"2024-05-09T09:55:57.298282+0000","last_fullsized":"2024-05-09T09:55:57.298282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702821+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:55:56.702821+0000","last_peered":"2024-05-09T09:55:56.702821+0000","last_clean":"2024-05-09T09:55:56.702821+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:55:56.702821+0000","last_undegraded":"2024-05-09T09:55:56.702821+0000","last_fullsized":"2024-05-09T09:55:56.702821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"75'14","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400579+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:55:57.400579+0000","last_peered":"2024-05-09T09:55:57.400579+0000","last_clean":"2024-05-09T09:55:57.400579+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:55:57.400579+0000","last_undegraded":"2024-05-09T09:55:57.400579+0000","last_fullsized":"2024-05-09T09:55:57.400579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680423+0000","last_change":"2024-05-09T09:55:10.517397+0000","last_active":"2024-05-09T09:55:55.680423+0000","last_peered":"2024-05-09T09:55:55.680423+0000","last_clean":"2024-05-09T09:55:55.680423+0000","last_became_active":"2024-05-09T09:55:10.515588+0000","last_became_peered":"2024-05-09T09:55:10.515588+0000","last_unstale":"2024-05-09T09:55:55.680423+0000","last_undegraded":"2024-05-09T09:55:55.680423+0000","last_fullsized":"2024-05-09T09:55:55.680423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:07.130003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"75'44","reported_seq":54,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678017+0000","last_change":"2024-05-09T09:55:11.515278+0000","last_active":"2024-05-09T09:55:55.678017+0000","last_peered":"2024-05-09T09:55:55.678017+0000","last_clean":"2024-05-09T09:55:55.678017+0000","last_became_active":"2024-05-09T09:55:10.518766+0000","last_became_peered":"2024-05-09T09:55:10.518766+0000","last_unstale":"2024-05-09T09:55:55.678017+0000","last_undegraded":"2024-05-09T09:55:55.678017+0000","last_fullsized":"2024-05-09T09:55:55.678017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:19.443320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":112,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'13","reported_seq":67,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680753+0000","last_change":"2024-05-09T09:55:11.060481+0000","last_active":"2024-05-09T09:55:55.680753+0000","last_peered":"2024-05-09T09:55:55.680753+0000","last_clean":"2024-05-09T09:55:55.680753+0000","last_became_active":"2024-05-09T09:55:10.509265+0000","last_became_peered":"2024-05-09T09:55:10.509265+0000","last_unstale":"2024-05-09T09:55:55.680753+0000","last_undegraded":"2024-05-09T09:55:55.680753+0000","last_fullsized":"2024-05-09T09:55:55.680753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:58:29.838618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":16398,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704209+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:55:56.704209+0000","last_peered":"2024-05-09T09:55:56.704209+0000","last_clean":"2024-05-09T09:55:56.704209+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:55:56.704209+0000","last_undegraded":"2024-05-09T09:55:56.704209+0000","last_fullsized":"2024-05-09T09:55:56.704209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704461+0000","last_change":"2024-05-09T09:55:41.502710+0000","last_active":"2024-05-09T09:55:56.704461+0000","last_peered":"2024-05-09T09:55:56.704461+0000","last_clean":"2024-05-09T09:55:56.704461+0000","last_became_active":"2024-05-09T09:55:41.498766+0000","last_became_peered":"2024-05-09T09:55:41.498766+0000","last_unstale":"2024-05-09T09:55:56.704461+0000","last_undegraded":"2024-05-09T09:55:56.704461+0000","last_fullsized":"2024-05-09T09:55:56.704461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:11.800372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705353+0000","last_change":"2024-05-09T09:55:42.422831+0000","last_active":"2024-05-09T09:55:56.705353+0000","last_peered":"2024-05-09T09:55:56.705353+0000","last_clean":"2024-05-09T09:55:56.705353+0000","last_became_active":"2024-05-09T09:55:41.513003+0000","last_became_peered":"2024-05-09T09:55:41.513003+0000","last_unstale":"2024-05-09T09:55:56.705353+0000","last_undegraded":"2024-05-09T09:55:56.705353+0000","last_fullsized":"2024-05-09T09:55:56.705353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:07.499148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"75'17","reported_seq":64,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678372+0000","last_change":"2024-05-09T09:55:10.808760+0000","last_active":"2024-05-09T09:55:55.678372+0000","last_peered":"2024-05-09T09:55:55.678372+0000","last_clean":"2024-05-09T09:55:55.678372+0000","last_became_active":"2024-05-09T09:55:10.505477+0000","last_became_peered":"2024-05-09T09:55:10.505477+0000","last_unstale":"2024-05-09T09:55:55.678372+0000","last_undegraded":"2024-05-09T09:55:55.678372+0000","last_fullsized":"2024-05-09T09:55:55.678372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:21.462968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704510+0000","last_change":"2024-05-09T09:55:10.495913+0000","last_active":"2024-05-09T09:55:56.704510+0000","last_peered":"2024-05-09T09:55:56.704510+0000","last_clean":"2024-05-09T09:55:56.704510+0000","last_became_active":"2024-05-09T09:55:10.494445+0000","last_became_peered":"2024-05-09T09:55:10.494445+0000","last_unstale":"2024-05-09T09:55:56.704510+0000","last_undegraded":"2024-05-09T09:55:56.704510+0000","last_fullsized":"2024-05-09T09:55:56.704510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:58.669871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'10","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704782+0000","last_change":"2024-05-09T09:55:42.207577+0000","last_active":"2024-05-09T09:55:56.704782+0000","last_peered":"2024-05-09T09:55:56.704782+0000","last_clean":"2024-05-09T09:55:56.704782+0000","last_became_active":"2024-05-09T09:55:41.480316+0000","last_became_peered":"2024-05-09T09:55:41.480316+0000","last_unstale":"2024-05-09T09:55:56.704782+0000","last_undegraded":"2024-05-09T09:55:56.704782+0000","last_fullsized":"2024-05-09T09:55:56.704782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705886+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:55:56.705886+0000","last_peered":"2024-05-09T09:55:56.705886+0000","last_clean":"2024-05-09T09:55:56.705886+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:55:56.705886+0000","last_undegraded":"2024-05-09T09:55:56.705886+0000","last_fullsized":"2024-05-09T09:55:56.705886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299647+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:55:57.299647+0000","last_peered":"2024-05-09T09:55:57.299647+0000","last_clean":"2024-05-09T09:55:57.299647+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:55:57.299647+0000","last_undegraded":"2024-05-09T09:55:57.299647+0000","last_fullsized":"2024-05-09T09:55:57.299647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678079+0000","last_change":"2024-05-09T09:55:10.517926+0000","last_active":"2024-05-09T09:55:55.678079+0000","last_peered":"2024-05-09T09:55:55.678079+0000","last_clean":"2024-05-09T09:55:55.678079+0000","last_became_active":"2024-05-09T09:55:10.505544+0000","last_became_peered":"2024-05-09T09:55:10.505544+0000","last_unstale":"2024-05-09T09:55:55.678079+0000","last_undegraded":"2024-05-09T09:55:55.678079+0000","last_fullsized":"2024-05-09T09:55:55.678079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:13.161392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'38","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678245+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:55:55.678245+0000","last_peered":"2024-05-09T09:55:55.678245+0000","last_clean":"2024-05-09T09:55:55.678245+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:55:55.678245+0000","last_undegraded":"2024-05-09T09:55:55.678245+0000","last_fullsized":"2024-05-09T09:55:55.678245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":51,"num_write":36,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677635+0000","last_change":"2024-05-09T09:55:10.498516+0000","last_active":"2024-05-09T09:55:55.677635+0000","last_peered":"2024-05-09T09:55:55.677635+0000","last_clean":"2024-05-09T09:55:55.677635+0000","last_became_active":"2024-05-09T09:55:10.498080+0000","last_became_peered":"2024-05-09T09:55:10.498080+0000","last_unstale":"2024-05-09T09:55:55.677635+0000","last_undegraded":"2024-05-09T09:55:55.677635+0000","last_fullsized":"2024-05-09T09:55:55.677635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:21.659232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'2","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401538+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:55:57.401538+0000","last_peered":"2024-05-09T09:55:57.401538+0000","last_clean":"2024-05-09T09:55:57.401538+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:55:57.401538+0000","last_undegraded":"2024-05-09T09:55:57.401538+0000","last_fullsized":"2024-05-09T09:55:57.401538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706114+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:55:56.706114+0000","last_peered":"2024-05-09T09:55:56.706114+0000","last_clean":"2024-05-09T09:55:56.706114+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:55:56.706114+0000","last_undegraded":"2024-05-09T09:55:56.706114+0000","last_fullsized":"2024-05-09T09:55:56.706114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704880+0000","last_change":"2024-05-09T09:55:42.429944+0000","last_active":"2024-05-09T09:55:56.704880+0000","last_peered":"2024-05-09T09:55:56.704880+0000","last_clean":"2024-05-09T09:55:56.704880+0000","last_became_active":"2024-05-09T09:55:41.516290+0000","last_became_peered":"2024-05-09T09:55:41.516290+0000","last_unstale":"2024-05-09T09:55:56.704880+0000","last_undegraded":"2024-05-09T09:55:56.704880+0000","last_fullsized":"2024-05-09T09:55:56.704880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:59.070546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706067+0000","last_change":"2024-05-09T09:55:42.380229+0000","last_active":"2024-05-09T09:55:56.706067+0000","last_peered":"2024-05-09T09:55:56.706067+0000","last_clean":"2024-05-09T09:55:56.706067+0000","last_became_active":"2024-05-09T09:55:41.489973+0000","last_became_peered":"2024-05-09T09:55:41.489973+0000","last_unstale":"2024-05-09T09:55:56.706067+0000","last_undegraded":"2024-05-09T09:55:56.706067+0000","last_fullsized":"2024-05-09T09:55:56.706067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":30736,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703216+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:55:56.703216+0000","last_peered":"2024-05-09T09:55:56.703216+0000","last_clean":"2024-05-09T09:55:56.703216+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:55:56.703216+0000","last_undegraded":"2024-05-09T09:55:56.703216+0000","last_fullsized":"2024-05-09T09:55:56.703216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"73'19","reported_seq":57,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677531+0000","last_change":"2024-05-09T09:55:10.932387+0000","last_active":"2024-05-09T09:55:55.677531+0000","last_peered":"2024-05-09T09:55:55.677531+0000","last_clean":"2024-05-09T09:55:55.677531+0000","last_became_active":"2024-05-09T09:55:10.507307+0000","last_became_peered":"2024-05-09T09:55:10.507307+0000","last_unstale":"2024-05-09T09:55:55.677531+0000","last_undegraded":"2024-05-09T09:55:55.677531+0000","last_fullsized":"2024-05-09T09:55:55.677531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:44.904375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":29,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678261+0000","last_change":"2024-05-09T09:55:10.519133+0000","last_active":"2024-05-09T09:55:55.678261+0000","last_peered":"2024-05-09T09:55:55.678261+0000","last_clean":"2024-05-09T09:55:55.678261+0000","last_became_active":"2024-05-09T09:55:10.518305+0000","last_became_peered":"2024-05-09T09:55:10.518305+0000","last_unstale":"2024-05-09T09:55:55.678261+0000","last_undegraded":"2024-05-09T09:55:55.678261+0000","last_fullsized":"2024-05-09T09:55:55.678261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:56.110070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678909+0000","last_change":"2024-05-09T09:55:10.505287+0000","last_active":"2024-05-09T09:55:55.678909+0000","last_peered":"2024-05-09T09:55:55.678909+0000","last_clean":"2024-05-09T09:55:55.678909+0000","last_became_active":"2024-05-09T09:55:10.504822+0000","last_became_peered":"2024-05-09T09:55:10.504822+0000","last_unstale":"2024-05-09T09:55:55.678909+0000","last_undegraded":"2024-05-09T09:55:55.678909+0000","last_fullsized":"2024-05-09T09:55:55.678909+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:26.980095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677938+0000","last_change":"2024-05-09T09:54:55.399423+0000","last_active":"2024-05-09T09:55:55.677938+0000","last_peered":"2024-05-09T09:55:55.677938+0000","last_clean":"2024-05-09T09:55:55.677938+0000","last_became_active":"2024-05-09T09:54:55.398970+0000","last_became_peered":"2024-05-09T09:54:55.398970+0000","last_unstale":"2024-05-09T09:55:55.677938+0000","last_undegraded":"2024-05-09T09:55:55.677938+0000","last_fullsized":"2024-05-09T09:55:55.677938+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"75'10","reported_seq":214,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680282+0000","last_change":"2024-05-09T09:55:10.626412+0000","last_active":"2024-05-09T09:55:55.680282+0000","last_peered":"2024-05-09T09:55:55.680282+0000","last_clean":"2024-05-09T09:55:55.680282+0000","last_became_active":"2024-05-09T09:55:10.499847+0000","last_became_peered":"2024-05-09T09:55:10.499847+0000","last_unstale":"2024-05-09T09:55:55.680282+0000","last_undegraded":"2024-05-09T09:55:55.680282+0000","last_fullsized":"2024-05-09T09:55:55.680282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678545+0000","last_change":"2024-05-09T09:55:10.508325+0000","last_active":"2024-05-09T09:55:55.678545+0000","last_peered":"2024-05-09T09:55:55.678545+0000","last_clean":"2024-05-09T09:55:55.678545+0000","last_became_active":"2024-05-09T09:55:10.506831+0000","last_became_peered":"2024-05-09T09:55:10.506831+0000","last_unstale":"2024-05-09T09:55:55.678545+0000","last_undegraded":"2024-05-09T09:55:55.678545+0000","last_fullsized":"2024-05-09T09:55:55.678545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:03.449411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700895+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:55:56.700895+0000","last_peered":"2024-05-09T09:55:56.700895+0000","last_clean":"2024-05-09T09:55:56.700895+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:55:56.700895+0000","last_undegraded":"2024-05-09T09:55:56.700895+0000","last_fullsized":"2024-05-09T09:55:56.700895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678249+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:55:55.678249+0000","last_peered":"2024-05-09T09:55:55.678249+0000","last_clean":"2024-05-09T09:55:55.678249+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:55:55.678249+0000","last_undegraded":"2024-05-09T09:55:55.678249+0000","last_fullsized":"2024-05-09T09:55:55.678249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700775+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:55:56.700775+0000","last_peered":"2024-05-09T09:55:56.700775+0000","last_clean":"2024-05-09T09:55:56.700775+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:55:56.700775+0000","last_undegraded":"2024-05-09T09:55:56.700775+0000","last_fullsized":"2024-05-09T09:55:56.700775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678064+0000","last_change":"2024-05-09T09:55:10.514293+0000","last_active":"2024-05-09T09:55:55.678064+0000","last_peered":"2024-05-09T09:55:55.678064+0000","last_clean":"2024-05-09T09:55:55.678064+0000","last_became_active":"2024-05-09T09:55:10.513915+0000","last_became_peered":"2024-05-09T09:55:10.513915+0000","last_unstale":"2024-05-09T09:55:55.678064+0000","last_undegraded":"2024-05-09T09:55:55.678064+0000","last_fullsized":"2024-05-09T09:55:55.678064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:03.485055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"66'9","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402201+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:55:57.402201+0000","last_peered":"2024-05-09T09:55:57.402201+0000","last_clean":"2024-05-09T09:55:57.402201+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:55:57.402201+0000","last_undegraded":"2024-05-09T09:55:57.402201+0000","last_fullsized":"2024-05-09T09:55:57.402201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677514+0000","last_change":"2024-05-09T09:55:42.066725+0000","last_active":"2024-05-09T09:55:55.677514+0000","last_peered":"2024-05-09T09:55:55.677514+0000","last_clean":"2024-05-09T09:55:55.677514+0000","last_became_active":"2024-05-09T09:55:41.506927+0000","last_became_peered":"2024-05-09T09:55:41.506927+0000","last_unstale":"2024-05-09T09:55:55.677514+0000","last_undegraded":"2024-05-09T09:55:55.677514+0000","last_fullsized":"2024-05-09T09:55:55.677514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'21","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678632+0000","last_change":"2024-05-09T09:55:11.122289+0000","last_active":"2024-05-09T09:55:55.678632+0000","last_peered":"2024-05-09T09:55:55.678632+0000","last_clean":"2024-05-09T09:55:55.678632+0000","last_became_active":"2024-05-09T09:55:10.507511+0000","last_became_peered":"2024-05-09T09:55:10.507511+0000","last_unstale":"2024-05-09T09:55:55.678632+0000","last_undegraded":"2024-05-09T09:55:55.678632+0000","last_fullsized":"2024-05-09T09:55:55.678632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:29.227840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12481,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":39,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297997+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:55:57.297997+0000","last_peered":"2024-05-09T09:55:57.297997+0000","last_clean":"2024-05-09T09:55:57.297997+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:55:57.297997+0000","last_undegraded":"2024-05-09T09:55:57.297997+0000","last_fullsized":"2024-05-09T09:55:57.297997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401098+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:55:57.401098+0000","last_peered":"2024-05-09T09:55:57.401098+0000","last_clean":"2024-05-09T09:55:57.401098+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:55:57.401098+0000","last_undegraded":"2024-05-09T09:55:57.401098+0000","last_fullsized":"2024-05-09T09:55:57.401098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'38","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677841+0000","last_change":"2024-05-09T09:55:11.526822+0000","last_active":"2024-05-09T09:55:55.677841+0000","last_peered":"2024-05-09T09:55:55.677841+0000","last_clean":"2024-05-09T09:55:55.677841+0000","last_became_active":"2024-05-09T09:55:10.520941+0000","last_became_peered":"2024-05-09T09:55:10.520941+0000","last_unstale":"2024-05-09T09:55:55.677841+0000","last_undegraded":"2024-05-09T09:55:55.677841+0000","last_fullsized":"2024-05-09T09:55:55.677841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:25.981081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706483+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:55:56.706483+0000","last_peered":"2024-05-09T09:55:56.706483+0000","last_clean":"2024-05-09T09:55:56.706483+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:55:56.706483+0000","last_undegraded":"2024-05-09T09:55:56.706483+0000","last_fullsized":"2024-05-09T09:55:56.706483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298179+0000","last_change":"2024-05-09T09:55:41.515909+0000","last_active":"2024-05-09T09:55:57.298179+0000","last_peered":"2024-05-09T09:55:57.298179+0000","last_clean":"2024-05-09T09:55:57.298179+0000","last_became_active":"2024-05-09T09:55:41.514849+0000","last_became_peered":"2024-05-09T09:55:41.514849+0000","last_unstale":"2024-05-09T09:55:57.298179+0000","last_undegraded":"2024-05-09T09:55:57.298179+0000","last_fullsized":"2024-05-09T09:55:57.298179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:02.137573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"73'15","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678379+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:55:55.678379+0000","last_peered":"2024-05-09T09:55:55.678379+0000","last_clean":"2024-05-09T09:55:55.678379+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:55:55.678379+0000","last_undegraded":"2024-05-09T09:55:55.678379+0000","last_fullsized":"2024-05-09T09:55:55.678379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703964+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:55:56.703964+0000","last_peered":"2024-05-09T09:55:56.703964+0000","last_clean":"2024-05-09T09:55:56.703964+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:55:56.703964+0000","last_undegraded":"2024-05-09T09:55:56.703964+0000","last_fullsized":"2024-05-09T09:55:56.703964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299559+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:55:57.299559+0000","last_peered":"2024-05-09T09:55:57.299559+0000","last_clean":"2024-05-09T09:55:57.299559+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:55:57.299559+0000","last_undegraded":"2024-05-09T09:55:57.299559+0000","last_fullsized":"2024-05-09T09:55:57.299559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"67'11","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511830+0000","last_change":"2024-05-09T09:55:55.809479+0000","last_active":"2024-05-09T09:55:57.511830+0000","last_peered":"2024-05-09T09:55:57.511830+0000","last_clean":"2024-05-09T09:55:57.511830+0000","last_became_active":"2024-05-09T09:55:55.677234+0000","last_became_peered":"2024-05-09T09:55:55.677234+0000","last_unstale":"2024-05-09T09:55:57.511830+0000","last_undegraded":"2024-05-09T09:55:57.511830+0000","last_fullsized":"2024-05-09T09:55:57.511830+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:44.116858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706475+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:55:56.706475+0000","last_peered":"2024-05-09T09:55:56.706475+0000","last_clean":"2024-05-09T09:55:56.706475+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:55:56.706475+0000","last_undegraded":"2024-05-09T09:55:56.706475+0000","last_fullsized":"2024-05-09T09:55:56.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"73'26","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704104+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:55:56.704104+0000","last_peered":"2024-05-09T09:55:56.704104+0000","last_clean":"2024-05-09T09:55:56.704104+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:55:56.704104+0000","last_undegraded":"2024-05-09T09:55:56.704104+0000","last_fullsized":"2024-05-09T09:55:56.704104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401447+0000","last_change":"2024-05-09T09:55:10.495749+0000","last_active":"2024-05-09T09:55:57.401447+0000","last_peered":"2024-05-09T09:55:57.401447+0000","last_clean":"2024-05-09T09:55:57.401447+0000","last_became_active":"2024-05-09T09:55:10.494186+0000","last_became_peered":"2024-05-09T09:55:10.494186+0000","last_unstale":"2024-05-09T09:55:57.401447+0000","last_undegraded":"2024-05-09T09:55:57.401447+0000","last_fullsized":"2024-05-09T09:55:57.401447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:53:44.097211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678433+0000","last_change":"2024-05-09T09:55:10.505728+0000","last_active":"2024-05-09T09:55:55.678433+0000","last_peered":"2024-05-09T09:55:55.678433+0000","last_clean":"2024-05-09T09:55:55.678433+0000","last_became_active":"2024-05-09T09:55:10.504907+0000","last_became_peered":"2024-05-09T09:55:10.504907+0000","last_unstale":"2024-05-09T09:55:55.678433+0000","last_undegraded":"2024-05-09T09:55:55.678433+0000","last_fullsized":"2024-05-09T09:55:55.678433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:34.895344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706201+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:55:56.706201+0000","last_peered":"2024-05-09T09:55:56.706201+0000","last_clean":"2024-05-09T09:55:56.706201+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:55:56.706201+0000","last_undegraded":"2024-05-09T09:55:56.706201+0000","last_fullsized":"2024-05-09T09:55:56.706201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"67'3","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701843+0000","last_change":"2024-05-09T09:55:10.559316+0000","last_active":"2024-05-09T09:55:56.701843+0000","last_peered":"2024-05-09T09:55:56.701843+0000","last_clean":"2024-05-09T09:55:56.701843+0000","last_became_active":"2024-05-09T09:55:10.497596+0000","last_became_peered":"2024-05-09T09:55:10.497596+0000","last_unstale":"2024-05-09T09:55:56.701843+0000","last_undegraded":"2024-05-09T09:55:56.701843+0000","last_fullsized":"2024-05-09T09:55:56.701843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299240+0000","last_change":"2024-05-09T09:55:41.513826+0000","last_active":"2024-05-09T09:55:57.299240+0000","last_peered":"2024-05-09T09:55:57.299240+0000","last_clean":"2024-05-09T09:55:57.299240+0000","last_became_active":"2024-05-09T09:55:41.513248+0000","last_became_peered":"2024-05-09T09:55:41.513248+0000","last_unstale":"2024-05-09T09:55:57.299240+0000","last_undegraded":"2024-05-09T09:55:57.299240+0000","last_fullsized":"2024-05-09T09:55:57.299240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:15.704381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"73'27","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679109+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:55:55.679109+0000","last_peered":"2024-05-09T09:55:55.679109+0000","last_clean":"2024-05-09T09:55:55.679109+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:55:55.679109+0000","last_undegraded":"2024-05-09T09:55:55.679109+0000","last_fullsized":"2024-05-09T09:55:55.679109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8545,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":54,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703868+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:55:56.703868+0000","last_peered":"2024-05-09T09:55:56.703868+0000","last_clean":"2024-05-09T09:55:56.703868+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:55:56.703868+0000","last_undegraded":"2024-05-09T09:55:56.703868+0000","last_fullsized":"2024-05-09T09:55:56.703868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"63'4","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297673+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:55:57.297673+0000","last_peered":"2024-05-09T09:55:57.297673+0000","last_clean":"2024-05-09T09:55:57.297673+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:55:57.297673+0000","last_undegraded":"2024-05-09T09:55:57.297673+0000","last_fullsized":"2024-05-09T09:55:57.297673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678402+0000","last_change":"2024-05-09T09:55:10.500134+0000","last_active":"2024-05-09T09:55:55.678402+0000","last_peered":"2024-05-09T09:55:55.678402+0000","last_clean":"2024-05-09T09:55:55.678402+0000","last_became_active":"2024-05-09T09:55:10.499690+0000","last_became_peered":"2024-05-09T09:55:10.499690+0000","last_unstale":"2024-05-09T09:55:55.678402+0000","last_undegraded":"2024-05-09T09:55:55.678402+0000","last_fullsized":"2024-05-09T09:55:55.678402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"66'13","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704696+0000","last_change":"2024-05-09T09:55:42.033924+0000","last_active":"2024-05-09T09:55:56.704696+0000","last_peered":"2024-05-09T09:55:56.704696+0000","last_clean":"2024-05-09T09:55:56.704696+0000","last_became_active":"2024-05-09T09:55:41.481073+0000","last_became_peered":"2024-05-09T09:55:41.481073+0000","last_unstale":"2024-05-09T09:55:56.704696+0000","last_undegraded":"2024-05-09T09:55:56.704696+0000","last_fullsized":"2024-05-09T09:55:56.704696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:48.598565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":45062,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706054+0000","last_change":"2024-05-09T09:55:41.513074+0000","last_active":"2024-05-09T09:55:56.706054+0000","last_peered":"2024-05-09T09:55:56.706054+0000","last_clean":"2024-05-09T09:55:56.706054+0000","last_became_active":"2024-05-09T09:55:41.512431+0000","last_became_peered":"2024-05-09T09:55:41.512431+0000","last_unstale":"2024-05-09T09:55:56.706054+0000","last_undegraded":"2024-05-09T09:55:56.706054+0000","last_fullsized":"2024-05-09T09:55:56.706054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:14.565690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"73'20","reported_seq":57,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680285+0000","last_change":"2024-05-09T09:55:11.526104+0000","last_active":"2024-05-09T09:55:55.680285+0000","last_peered":"2024-05-09T09:55:55.680285+0000","last_clean":"2024-05-09T09:55:55.680285+0000","last_became_active":"2024-05-09T09:55:10.517760+0000","last_became_peered":"2024-05-09T09:55:10.517760+0000","last_unstale":"2024-05-09T09:55:55.680285+0000","last_undegraded":"2024-05-09T09:55:55.680285+0000","last_fullsized":"2024-05-09T09:55:55.680285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:24.084847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":34,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703148+0000","last_change":"2024-05-09T09:55:10.485758+0000","last_active":"2024-05-09T09:55:56.703148+0000","last_peered":"2024-05-09T09:55:56.703148+0000","last_clean":"2024-05-09T09:55:56.703148+0000","last_became_active":"2024-05-09T09:55:10.485167+0000","last_became_peered":"2024-05-09T09:55:10.485167+0000","last_unstale":"2024-05-09T09:55:56.703148+0000","last_undegraded":"2024-05-09T09:55:56.703148+0000","last_fullsized":"2024-05-09T09:55:56.703148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:16.070700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400396+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:55:57.400396+0000","last_peered":"2024-05-09T09:55:57.400396+0000","last_clean":"2024-05-09T09:55:57.400396+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:55:57.400396+0000","last_undegraded":"2024-05-09T09:55:57.400396+0000","last_fullsized":"2024-05-09T09:55:57.400396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511241+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:55:57.511241+0000","last_peered":"2024-05-09T09:55:57.511241+0000","last_clean":"2024-05-09T09:55:57.511241+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:55:57.511241+0000","last_undegraded":"2024-05-09T09:55:57.511241+0000","last_fullsized":"2024-05-09T09:55:57.511241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'10","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704163+0000","last_change":"2024-05-09T09:55:41.638527+0000","last_active":"2024-05-09T09:55:56.704163+0000","last_peered":"2024-05-09T09:55:56.704163+0000","last_clean":"2024-05-09T09:55:56.704163+0000","last_became_active":"2024-05-09T09:55:41.470350+0000","last_became_peered":"2024-05-09T09:55:41.470350+0000","last_unstale":"2024-05-09T09:55:56.704163+0000","last_undegraded":"2024-05-09T09:55:56.704163+0000","last_fullsized":"2024-05-09T09:55:56.704163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:55:41.504749+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:55:41.504290+0000","last_became_peered":"2024-05-09T09:55:41.504290+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706444+0000","last_change":"2024-05-09T09:55:42.568315+0000","last_active":"2024-05-09T09:55:56.706444+0000","last_peered":"2024-05-09T09:55:56.706444+0000","last_clean":"2024-05-09T09:55:56.706444+0000","last_became_active":"2024-05-09T09:55:41.517072+0000","last_became_peered":"2024-05-09T09:55:41.517072+0000","last_unstale":"2024-05-09T09:55:56.706444+0000","last_undegraded":"2024-05-09T09:55:56.706444+0000","last_fullsized":"2024-05-09T09:55:56.706444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:54.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"80'19","reported_seq":242,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299355+0000","last_change":"2024-05-09T09:55:44.549663+0000","last_active":"2024-05-09T09:55:57.299355+0000","last_peered":"2024-05-09T09:55:57.299355+0000","last_clean":"2024-05-09T09:55:57.299355+0000","last_became_active":"2024-05-09T09:55:41.514399+0000","last_became_peered":"2024-05-09T09:55:41.514399+0000","last_unstale":"2024-05-09T09:55:57.299355+0000","last_undegraded":"2024-05-09T09:55:57.299355+0000","last_fullsized":"2024-05-09T09:55:57.299355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:46.578164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"63'2","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677507+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:55:55.677507+0000","last_peered":"2024-05-09T09:55:55.677507+0000","last_clean":"2024-05-09T09:55:55.677507+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:55:55.677507+0000","last_undegraded":"2024-05-09T09:55:55.677507+0000","last_fullsized":"2024-05-09T09:55:55.677507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704832+0000","last_change":"2024-05-09T09:55:41.514279+0000","last_active":"2024-05-09T09:55:56.704832+0000","last_peered":"2024-05-09T09:55:56.704832+0000","last_clean":"2024-05-09T09:55:56.704832+0000","last_became_active":"2024-05-09T09:55:41.513724+0000","last_became_peered":"2024-05-09T09:55:41.513724+0000","last_unstale":"2024-05-09T09:55:56.704832+0000","last_undegraded":"2024-05-09T09:55:56.704832+0000","last_fullsized":"2024-05-09T09:55:56.704832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:53.879426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511499+0000","last_change":"2024-05-09T09:55:42.243360+0000","last_active":"2024-05-09T09:55:57.511499+0000","last_peered":"2024-05-09T09:55:57.511499+0000","last_clean":"2024-05-09T09:55:57.511499+0000","last_became_active":"2024-05-09T09:55:41.495012+0000","last_became_peered":"2024-05-09T09:55:41.495012+0000","last_unstale":"2024-05-09T09:55:57.511499+0000","last_undegraded":"2024-05-09T09:55:57.511499+0000","last_fullsized":"2024-05-09T09:55:57.511499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:55:30.669989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678693+0000","last_change":"2024-05-09T09:55:41.508232+0000","last_active":"2024-05-09T09:55:55.678693+0000","last_peered":"2024-05-09T09:55:55.678693+0000","last_clean":"2024-05-09T09:55:55.678693+0000","last_became_active":"2024-05-09T09:55:41.506905+0000","last_became_peered":"2024-05-09T09:55:41.506905+0000","last_unstale":"2024-05-09T09:55:55.678693+0000","last_undegraded":"2024-05-09T09:55:55.678693+0000","last_fullsized":"2024-05-09T09:55:55.678693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"73'24","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400581+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:55:57.400581+0000","last_peered":"2024-05-09T09:55:57.400581+0000","last_clean":"2024-05-09T09:55:57.400581+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:55:57.400581+0000","last_undegraded":"2024-05-09T09:55:57.400581+0000","last_fullsized":"2024-05-09T09:55:57.400581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701605+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:55:56.701605+0000","last_peered":"2024-05-09T09:55:56.701605+0000","last_clean":"2024-05-09T09:55:56.701605+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:55:56.701605+0000","last_undegraded":"2024-05-09T09:55:56.701605+0000","last_fullsized":"2024-05-09T09:55:56.701605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.681969+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:55:55.681969+0000","last_peered":"2024-05-09T09:55:55.681969+0000","last_clean":"2024-05-09T09:55:55.681969+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:55:55.681969+0000","last_undegraded":"2024-05-09T09:55:55.681969+0000","last_fullsized":"2024-05-09T09:55:55.681969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705208+0000","last_change":"2024-05-09T09:55:41.513633+0000","last_active":"2024-05-09T09:55:56.705208+0000","last_peered":"2024-05-09T09:55:56.705208+0000","last_clean":"2024-05-09T09:55:56.705208+0000","last_became_active":"2024-05-09T09:55:41.512176+0000","last_became_peered":"2024-05-09T09:55:41.512176+0000","last_unstale":"2024-05-09T09:55:56.705208+0000","last_undegraded":"2024-05-09T09:55:56.705208+0000","last_fullsized":"2024-05-09T09:55:56.705208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"68'9","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402348+0000","last_change":"2024-05-09T09:55:42.801375+0000","last_active":"2024-05-09T09:55:57.402348+0000","last_peered":"2024-05-09T09:55:57.402348+0000","last_clean":"2024-05-09T09:55:57.402348+0000","last_became_active":"2024-05-09T09:55:41.495260+0000","last_became_peered":"2024-05-09T09:55:41.495260+0000","last_unstale":"2024-05-09T09:55:57.402348+0000","last_undegraded":"2024-05-09T09:55:57.402348+0000","last_fullsized":"2024-05-09T09:55:57.402348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:20.725921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401363+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:55:57.401363+0000","last_peered":"2024-05-09T09:55:57.401363+0000","last_clean":"2024-05-09T09:55:57.401363+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:55:57.401363+0000","last_undegraded":"2024-05-09T09:55:57.401363+0000","last_fullsized":"2024-05-09T09:55:57.401363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"73'13","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701493+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:55:56.701493+0000","last_peered":"2024-05-09T09:55:56.701493+0000","last_clean":"2024-05-09T09:55:56.701493+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:55:56.701493+0000","last_undegraded":"2024-05-09T09:55:56.701493+0000","last_fullsized":"2024-05-09T09:55:56.701493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297877+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:55:57.297877+0000","last_peered":"2024-05-09T09:55:57.297877+0000","last_clean":"2024-05-09T09:55:57.297877+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:55:57.297877+0000","last_undegraded":"2024-05-09T09:55:57.297877+0000","last_fullsized":"2024-05-09T09:55:57.297877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678781+0000","last_change":"2024-05-09T09:55:10.502456+0000","last_active":"2024-05-09T09:55:55.678781+0000","last_peered":"2024-05-09T09:55:55.678781+0000","last_clean":"2024-05-09T09:55:55.678781+0000","last_became_active":"2024-05-09T09:55:10.502015+0000","last_became_peered":"2024-05-09T09:55:10.502015+0000","last_unstale":"2024-05-09T09:55:55.678781+0000","last_undegraded":"2024-05-09T09:55:55.678781+0000","last_fullsized":"2024-05-09T09:55:55.678781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:01.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"75'46","reported_seq":52,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678587+0000","last_change":"2024-05-09T09:55:10.787056+0000","last_active":"2024-05-09T09:55:55.678587+0000","last_peered":"2024-05-09T09:55:55.678587+0000","last_clean":"2024-05-09T09:55:55.678587+0000","last_became_active":"2024-05-09T09:55:10.503704+0000","last_became_peered":"2024-05-09T09:55:10.503704+0000","last_unstale":"2024-05-09T09:55:55.678587+0000","last_undegraded":"2024-05-09T09:55:55.678587+0000","last_fullsized":"2024-05-09T09:55:55.678587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:07.882920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'4","reported_seq":53,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678719+0000","last_change":"2024-05-09T09:55:11.105873+0000","last_active":"2024-05-09T09:55:55.678719+0000","last_peered":"2024-05-09T09:55:55.678719+0000","last_clean":"2024-05-09T09:55:55.678719+0000","last_became_active":"2024-05-09T09:55:10.511777+0000","last_became_peered":"2024-05-09T09:55:10.511777+0000","last_unstale":"2024-05-09T09:55:55.678719+0000","last_undegraded":"2024-05-09T09:55:55.678719+0000","last_fullsized":"2024-05-09T09:55:55.678719+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:49.719909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704012+0000","last_change":"2024-05-09T09:55:41.504930+0000","last_active":"2024-05-09T09:55:56.704012+0000","last_peered":"2024-05-09T09:55:56.704012+0000","last_clean":"2024-05-09T09:55:56.704012+0000","last_became_active":"2024-05-09T09:55:41.503996+0000","last_became_peered":"2024-05-09T09:55:41.503996+0000","last_unstale":"2024-05-09T09:55:56.704012+0000","last_undegraded":"2024-05-09T09:55:56.704012+0000","last_fullsized":"2024-05-09T09:55:56.704012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:17.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"73'12","reported_seq":51,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677974+0000","last_change":"2024-05-09T09:55:11.754129+0000","last_active":"2024-05-09T09:55:55.677974+0000","last_peered":"2024-05-09T09:55:55.677974+0000","last_clean":"2024-05-09T09:55:55.677974+0000","last_became_active":"2024-05-09T09:55:10.525384+0000","last_became_peered":"2024-05-09T09:55:10.525384+0000","last_unstale":"2024-05-09T09:55:55.677974+0000","last_undegraded":"2024-05-09T09:55:55.677974+0000","last_fullsized":"2024-05-09T09:55:55.677974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:56.439887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":18,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704813+0000","last_change":"2024-05-09T09:55:41.503227+0000","last_active":"2024-05-09T09:55:56.704813+0000","last_peered":"2024-05-09T09:55:56.704813+0000","last_clean":"2024-05-09T09:55:56.704813+0000","last_became_active":"2024-05-09T09:55:41.502389+0000","last_became_peered":"2024-05-09T09:55:41.502389+0000","last_unstale":"2024-05-09T09:55:56.704813+0000","last_undegraded":"2024-05-09T09:55:56.704813+0000","last_fullsized":"2024-05-09T09:55:56.704813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:58.478317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680868+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:55:55.680868+0000","last_peered":"2024-05-09T09:55:55.680868+0000","last_clean":"2024-05-09T09:55:55.680868+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:55:55.680868+0000","last_undegraded":"2024-05-09T09:55:55.680868+0000","last_fullsized":"2024-05-09T09:55:55.680868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703739+0000","last_change":"2024-05-09T09:55:41.504669+0000","last_active":"2024-05-09T09:55:56.703739+0000","last_peered":"2024-05-09T09:55:56.703739+0000","last_clean":"2024-05-09T09:55:56.703739+0000","last_became_active":"2024-05-09T09:55:41.503132+0000","last_became_peered":"2024-05-09T09:55:41.503132+0000","last_unstale":"2024-05-09T09:55:56.703739+0000","last_undegraded":"2024-05-09T09:55:56.703739+0000","last_fullsized":"2024-05-09T09:55:56.703739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:40.768463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706462+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:55:56.706462+0000","last_peered":"2024-05-09T09:55:56.706462+0000","last_clean":"2024-05-09T09:55:56.706462+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:55:56.706462+0000","last_undegraded":"2024-05-09T09:55:56.706462+0000","last_fullsized":"2024-05-09T09:55:56.706462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":36882,"num_write":42,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702636+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:55:56.702636+0000","last_peered":"2024-05-09T09:55:56.702636+0000","last_clean":"2024-05-09T09:55:56.702636+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:55:56.702636+0000","last_undegraded":"2024-05-09T09:55:56.702636+0000","last_fullsized":"2024-05-09T09:55:56.702636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"73'15","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704375+0000","last_change":"2024-05-09T09:55:41.528075+0000","last_active":"2024-05-09T09:55:56.704375+0000","last_peered":"2024-05-09T09:55:56.704375+0000","last_clean":"2024-05-09T09:55:56.704375+0000","last_became_active":"2024-05-09T09:55:41.453982+0000","last_became_peered":"2024-05-09T09:55:41.453982+0000","last_unstale":"2024-05-09T09:55:56.704375+0000","last_undegraded":"2024-05-09T09:55:56.704375+0000","last_fullsized":"2024-05-09T09:55:56.704375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:30.849980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703788+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:55:56.703788+0000","last_peered":"2024-05-09T09:55:56.703788+0000","last_clean":"2024-05-09T09:55:56.703788+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:55:56.703788+0000","last_undegraded":"2024-05-09T09:55:56.703788+0000","last_fullsized":"2024-05-09T09:55:56.703788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705754+0000","last_change":"2024-05-09T09:55:41.488023+0000","last_active":"2024-05-09T09:55:56.705754+0000","last_peered":"2024-05-09T09:55:56.705754+0000","last_clean":"2024-05-09T09:55:56.705754+0000","last_became_active":"2024-05-09T09:55:41.478429+0000","last_became_peered":"2024-05-09T09:55:41.478429+0000","last_unstale":"2024-05-09T09:55:56.705754+0000","last_undegraded":"2024-05-09T09:55:56.705754+0000","last_fullsized":"2024-05-09T09:55:56.705754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:21.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703865+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:55:56.703865+0000","last_peered":"2024-05-09T09:55:56.703865+0000","last_clean":"2024-05-09T09:55:56.703865+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:55:56.703865+0000","last_undegraded":"2024-05-09T09:55:56.703865+0000","last_fullsized":"2024-05-09T09:55:56.703865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":76,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298338+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:55:57.298338+0000","last_peered":"2024-05-09T09:55:57.298338+0000","last_clean":"2024-05-09T09:55:57.298338+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:55:57.298338+0000","last_undegraded":"2024-05-09T09:55:57.298338+0000","last_fullsized":"2024-05-09T09:55:57.298338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'16","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511896+0000","last_change":"2024-05-09T09:53:54.474568+0000","last_active":"2024-05-09T09:55:57.511896+0000","last_peered":"2024-05-09T09:55:57.511896+0000","last_clean":"2024-05-09T09:55:57.511896+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:55:57.511896+0000","last_undegraded":"2024-05-09T09:55:57.511896+0000","last_fullsized":"2024-05-09T09:55:57.511896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:31.979515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":38936,"num_write":56,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401833+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:55:57.401833+0000","last_peered":"2024-05-09T09:55:57.401833+0000","last_clean":"2024-05-09T09:55:57.401833+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:55:57.401833+0000","last_undegraded":"2024-05-09T09:55:57.401833+0000","last_fullsized":"2024-05-09T09:55:57.401833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401072+0000","last_change":"2024-05-09T09:55:11.421625+0000","last_active":"2024-05-09T09:55:57.401072+0000","last_peered":"2024-05-09T09:55:57.401072+0000","last_clean":"2024-05-09T09:55:57.401072+0000","last_became_active":"2024-05-09T09:55:10.518812+0000","last_became_peered":"2024-05-09T09:55:10.518812+0000","last_unstale":"2024-05-09T09:55:57.401072+0000","last_undegraded":"2024-05-09T09:55:57.401072+0000","last_fullsized":"2024-05-09T09:55:57.401072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:01.935968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":30726,"num_write":20,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703042+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:55:56.703042+0000","last_peered":"2024-05-09T09:55:56.703042+0000","last_clean":"2024-05-09T09:55:56.703042+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:55:56.703042+0000","last_undegraded":"2024-05-09T09:55:56.703042+0000","last_fullsized":"2024-05-09T09:55:56.703042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704515+0000","last_change":"2024-05-09T09:55:11.272479+0000","last_active":"2024-05-09T09:55:56.704515+0000","last_peered":"2024-05-09T09:55:56.704515+0000","last_clean":"2024-05-09T09:55:56.704515+0000","last_became_active":"2024-05-09T09:55:10.507500+0000","last_became_peered":"2024-05-09T09:55:10.507500+0000","last_unstale":"2024-05-09T09:55:56.704515+0000","last_undegraded":"2024-05-09T09:55:56.704515+0000","last_fullsized":"2024-05-09T09:55:56.704515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:01.473207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678204+0000","last_change":"2024-05-09T09:55:10.524923+0000","last_active":"2024-05-09T09:55:55.678204+0000","last_peered":"2024-05-09T09:55:55.678204+0000","last_clean":"2024-05-09T09:55:55.678204+0000","last_became_active":"2024-05-09T09:55:10.523552+0000","last_became_peered":"2024-05-09T09:55:10.523552+0000","last_unstale":"2024-05-09T09:55:55.678204+0000","last_undegraded":"2024-05-09T09:55:55.678204+0000","last_fullsized":"2024-05-09T09:55:55.678204+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:43.486340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'15","reported_seq":108,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.679120+0000","last_change":"2024-05-09T09:55:42.061427+0000","last_active":"2024-05-09T09:55:55.679120+0000","last_peered":"2024-05-09T09:55:55.679120+0000","last_clean":"2024-05-09T09:55:55.679120+0000","last_became_active":"2024-05-09T09:55:41.504165+0000","last_became_peered":"2024-05-09T09:55:41.504165+0000","last_unstale":"2024-05-09T09:55:55.679120+0000","last_undegraded":"2024-05-09T09:55:55.679120+0000","last_fullsized":"2024-05-09T09:55:55.679120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:23.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":13,"num_read_kb":12298,"num_write":35,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":113246208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704514+0000","last_change":"2024-05-09T09:55:41.501384+0000","last_active":"2024-05-09T09:55:56.704514+0000","last_peered":"2024-05-09T09:55:56.704514+0000","last_clean":"2024-05-09T09:55:56.704514+0000","last_became_active":"2024-05-09T09:55:41.500371+0000","last_became_peered":"2024-05-09T09:55:41.500371+0000","last_unstale":"2024-05-09T09:55:56.704514+0000","last_undegraded":"2024-05-09T09:55:56.704514+0000","last_fullsized":"2024-05-09T09:55:56.704514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:40.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'20","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703337+0000","last_change":"2024-05-09T09:55:10.940790+0000","last_active":"2024-05-09T09:55:56.703337+0000","last_peered":"2024-05-09T09:55:56.703337+0000","last_clean":"2024-05-09T09:55:56.703337+0000","last_became_active":"2024-05-09T09:55:10.497720+0000","last_became_peered":"2024-05-09T09:55:10.497720+0000","last_unstale":"2024-05-09T09:55:56.703337+0000","last_undegraded":"2024-05-09T09:55:56.703337+0000","last_fullsized":"2024-05-09T09:55:56.703337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":40,"num_read_kb":51230,"num_write":70,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677947+0000","last_change":"2024-05-09T09:55:10.522327+0000","last_active":"2024-05-09T09:55:55.677947+0000","last_peered":"2024-05-09T09:55:55.677947+0000","last_clean":"2024-05-09T09:55:55.677947+0000","last_became_active":"2024-05-09T09:55:10.520654+0000","last_became_peered":"2024-05-09T09:55:10.520654+0000","last_unstale":"2024-05-09T09:55:55.677947+0000","last_undegraded":"2024-05-09T09:55:55.677947+0000","last_fullsized":"2024-05-09T09:55:55.677947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299280+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:55:57.299280+0000","last_peered":"2024-05-09T09:55:57.299280+0000","last_clean":"2024-05-09T09:55:57.299280+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:55:57.299280+0000","last_undegraded":"2024-05-09T09:55:57.299280+0000","last_fullsized":"2024-05-09T09:55:57.299280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297786+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:55:57.297786+0000","last_peered":"2024-05-09T09:55:57.297786+0000","last_clean":"2024-05-09T09:55:57.297786+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:55:57.297786+0000","last_undegraded":"2024-05-09T09:55:57.297786+0000","last_fullsized":"2024-05-09T09:55:57.297786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"67'7","reported_seq":78,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680554+0000","last_change":"2024-05-09T09:55:43.542093+0000","last_active":"2024-05-09T09:55:55.680554+0000","last_peered":"2024-05-09T09:55:55.680554+0000","last_clean":"2024-05-09T09:55:55.680554+0000","last_became_active":"2024-05-09T09:55:41.504555+0000","last_became_peered":"2024-05-09T09:55:41.504555+0000","last_unstale":"2024-05-09T09:55:55.680554+0000","last_undegraded":"2024-05-09T09:55:55.680554+0000","last_fullsized":"2024-05-09T09:55:55.680554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:48:05.626495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"75'34","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706338+0000","last_change":"2024-05-09T09:55:11.694902+0000","last_active":"2024-05-09T09:55:56.706338+0000","last_peered":"2024-05-09T09:55:56.706338+0000","last_clean":"2024-05-09T09:55:56.706338+0000","last_became_active":"2024-05-09T09:55:10.515872+0000","last_became_peered":"2024-05-09T09:55:10.515872+0000","last_unstale":"2024-05-09T09:55:56.706338+0000","last_undegraded":"2024-05-09T09:55:56.706338+0000","last_fullsized":"2024-05-09T09:55:56.706338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"67'8","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401104+0000","last_change":"2024-05-09T09:55:11.200964+0000","last_active":"2024-05-09T09:55:57.401104+0000","last_peered":"2024-05-09T09:55:57.401104+0000","last_clean":"2024-05-09T09:55:57.401104+0000","last_became_active":"2024-05-09T09:55:10.506370+0000","last_became_peered":"2024-05-09T09:55:10.506370+0000","last_unstale":"2024-05-09T09:55:57.401104+0000","last_undegraded":"2024-05-09T09:55:57.401104+0000","last_fullsized":"2024-05-09T09:55:57.401104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:45.803361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":16388,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706695+0000","last_change":"2024-05-09T09:55:41.494250+0000","last_active":"2024-05-09T09:55:56.706695+0000","last_peered":"2024-05-09T09:55:56.706695+0000","last_clean":"2024-05-09T09:55:56.706695+0000","last_became_active":"2024-05-09T09:55:41.492423+0000","last_became_peered":"2024-05-09T09:55:41.492423+0000","last_unstale":"2024-05-09T09:55:56.706695+0000","last_undegraded":"2024-05-09T09:55:56.706695+0000","last_fullsized":"2024-05-09T09:55:56.706695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'9","reported_seq":86,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678507+0000","last_change":"2024-05-09T09:55:44.733118+0000","last_active":"2024-05-09T09:55:55.678507+0000","last_peered":"2024-05-09T09:55:55.678507+0000","last_clean":"2024-05-09T09:55:55.678507+0000","last_became_active":"2024-05-09T09:55:41.505078+0000","last_became_peered":"2024-05-09T09:55:41.505078+0000","last_unstale":"2024-05-09T09:55:55.678507+0000","last_undegraded":"2024-05-09T09:55:55.678507+0000","last_fullsized":"2024-05-09T09:55:55.678507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:36.404862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512634+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:55:57.512634+0000","last_peered":"2024-05-09T09:55:57.512634+0000","last_clean":"2024-05-09T09:55:57.512634+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:55:57.512634+0000","last_undegraded":"2024-05-09T09:55:57.512634+0000","last_fullsized":"2024-05-09T09:55:57.512634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'18","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401073+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:55:57.401073+0000","last_peered":"2024-05-09T09:55:57.401073+0000","last_clean":"2024-05-09T09:55:57.401073+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:55:57.401073+0000","last_undegraded":"2024-05-09T09:55:57.401073+0000","last_fullsized":"2024-05-09T09:55:57.401073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":63494,"num_write":28,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'34","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705523+0000","last_change":"2024-05-09T09:55:42.435861+0000","last_active":"2024-05-09T09:55:56.705523+0000","last_peered":"2024-05-09T09:55:56.705523+0000","last_clean":"2024-05-09T09:55:56.705523+0000","last_became_active":"2024-05-09T09:55:41.516340+0000","last_became_peered":"2024-05-09T09:55:41.516340+0000","last_unstale":"2024-05-09T09:55:56.705523+0000","last_undegraded":"2024-05-09T09:55:56.705523+0000","last_fullsized":"2024-05-09T09:55:56.705523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'12","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512299+0000","last_change":"2024-05-09T09:53:54.475107+0000","last_active":"2024-05-09T09:55:57.512299+0000","last_peered":"2024-05-09T09:55:57.512299+0000","last_clean":"2024-05-09T09:55:57.512299+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:55:57.512299+0000","last_undegraded":"2024-05-09T09:55:57.512299+0000","last_fullsized":"2024-05-09T09:55:57.512299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:07.978606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":40972,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'10","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.725591+0000","last_change":"2024-05-09T09:55:55.725591+0000","last_active":"2024-05-09T09:55:55.725591+0000","last_peered":"2024-05-09T09:55:55.725591+0000","last_clean":"2024-05-09T09:55:55.725591+0000","last_became_active":"2024-05-09T09:55:55.721121+0000","last_became_peered":"2024-05-09T09:55:55.721121+0000","last_unstale":"2024-05-09T09:55:55.725591+0000","last_undegraded":"2024-05-09T09:55:55.725591+0000","last_fullsized":"2024-05-09T09:55:55.725591+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298788+0000","last_change":"2024-05-09T09:55:43.389559+0000","last_active":"2024-05-09T09:55:57.298788+0000","last_peered":"2024-05-09T09:55:57.298788+0000","last_clean":"2024-05-09T09:55:57.298788+0000","last_became_active":"2024-05-09T09:55:41.513564+0000","last_became_peered":"2024-05-09T09:55:41.513564+0000","last_unstale":"2024-05-09T09:55:57.298788+0000","last_undegraded":"2024-05-09T09:55:57.298788+0000","last_fullsized":"2024-05-09T09:55:57.298788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:27.560582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"63'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702094+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:55:56.702094+0000","last_peered":"2024-05-09T09:55:56.702094+0000","last_clean":"2024-05-09T09:55:56.702094+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:55:56.702094+0000","last_undegraded":"2024-05-09T09:55:56.702094+0000","last_fullsized":"2024-05-09T09:55:56.702094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'9","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.680450+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:55:55.680450+0000","last_peered":"2024-05-09T09:55:55.680450+0000","last_clean":"2024-05-09T09:55:55.680450+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:55:55.680450+0000","last_undegraded":"2024-05-09T09:55:55.680450+0000","last_fullsized":"2024-05-09T09:55:55.680450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"63'6","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.678343+0000","last_change":"2024-05-09T09:55:10.683098+0000","last_active":"2024-05-09T09:55:55.678343+0000","last_peered":"2024-05-09T09:55:55.678343+0000","last_clean":"2024-05-09T09:55:55.678343+0000","last_became_active":"2024-05-09T09:55:10.495708+0000","last_became_peered":"2024-05-09T09:55:10.495708+0000","last_unstale":"2024-05-09T09:55:55.678343+0000","last_undegraded":"2024-05-09T09:55:55.678343+0000","last_fullsized":"2024-05-09T09:55:55.678343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:35.537784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'19","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513097+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:55:57.513097+0000","last_peered":"2024-05-09T09:55:57.513097+0000","last_clean":"2024-05-09T09:55:57.513097+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:55:57.513097+0000","last_undegraded":"2024-05-09T09:55:57.513097+0000","last_fullsized":"2024-05-09T09:55:57.513097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":39,"num_read_kb":53278,"num_write":69,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'6","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-05-09T09:55:55.677835+0000","last_change":"2024-05-09T09:55:10.943382+0000","last_active":"2024-05-09T09:55:55.677835+0000","last_peered":"2024-05-09T09:55:55.677835+0000","last_clean":"2024-05-09T09:55:55.677835+0000","last_became_active":"2024-05-09T09:55:10.500255+0000","last_became_peered":"2024-05-09T09:55:10.500255+0000","last_unstale":"2024-05-09T09:55:55.677835+0000","last_undegraded":"2024-05-09T09:55:55.677835+0000","last_fullsized":"2024-05-09T09:55:55.677835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"68'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402011+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.402011+0000","last_peered":"2024-05-09T09:55:57.402011+0000","last_clean":"2024-05-09T09:55:57.402011+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:55:57.402011+0000","last_undegraded":"2024-05-09T09:55:57.402011+0000","last_fullsized":"2024-05-09T09:55:57.402011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"69'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400979+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:55:57.400979+0000","last_peered":"2024-05-09T09:55:57.400979+0000","last_clean":"2024-05-09T09:55:57.400979+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:55:57.400979+0000","last_undegraded":"2024-05-09T09:55:57.400979+0000","last_fullsized":"2024-05-09T09:55:57.400979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706291+0000","last_change":"2024-05-09T09:55:10.507173+0000","last_active":"2024-05-09T09:55:56.706291+0000","last_peered":"2024-05-09T09:55:56.706291+0000","last_clean":"2024-05-09T09:55:56.706291+0000","last_became_active":"2024-05-09T09:55:10.506690+0000","last_became_peered":"2024-05-09T09:55:10.506690+0000","last_unstale":"2024-05-09T09:55:56.706291+0000","last_undegraded":"2024-05-09T09:55:56.706291+0000","last_fullsized":"2024-05-09T09:55:56.706291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'10","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702042+0000","last_change":"2024-05-09T09:55:41.773438+0000","last_active":"2024-05-09T09:55:56.702042+0000","last_peered":"2024-05-09T09:55:56.702042+0000","last_clean":"2024-05-09T09:55:56.702042+0000","last_became_active":"2024-05-09T09:55:41.504558+0000","last_became_peered":"2024-05-09T09:55:41.504558+0000","last_unstale":"2024-05-09T09:55:56.702042+0000","last_undegraded":"2024-05-09T09:55:56.702042+0000","last_fullsized":"2024-05-09T09:55:56.702042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26642,"num_write":40,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399757+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:55:57.399757+0000","last_peered":"2024-05-09T09:55:57.399757+0000","last_clean":"2024-05-09T09:55:57.399757+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:55:57.399757+0000","last_undegraded":"2024-05-09T09:55:57.399757+0000","last_fullsized":"2024-05-09T09:55:57.399757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":634,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":234941,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":916,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":46305,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":230722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":639,"ondisk_log_size":639,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1642,"num_read_kb":1223,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1022,"num_read_kb":1804930,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":1302331392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503992,"kb_used_data":472812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93867848,"statfs":{"total":96636764160,"available":96120676352,"internally_reserved":0,"allocated":484159488,"data_stored":483620955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":392792,"kb_used_data":361604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93979048,"statfs":{"total":96636764160,"available":96234545152,"internally_reserved":0,"allocated":370282496,"data_stored":369785753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":525996,"kb_used_data":494816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93845844,"statfs":{"total":96636764160,"available":96098144256,"internally_reserved":0,"allocated":506691584,"data_stored":506135230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505404,"kb_used_data":474220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866436,"statfs":{"total":96636764160,"available":96119230464,"internally_reserved":0,"allocated":485601280,"data_stored":485118321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462508,"kb_used_data":427168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93909332,"statfs":{"total":96636764160,"available":96163155968,"internally_reserved":0,"allocated":437420032,"data_stored":436904310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331364,"kb_used_data":296024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94040476,"statfs":{"total":96636764160,"available":96297447424,"internally_reserved":0,"allocated":303128576,"data_stored":302653917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315080,"kb_used_data":279732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94056760,"statfs":{"total":96636764160,"available":96314122240,"internally_reserved":0,"allocated":286445568,"data_stored":285929009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434400,"kb_used_data":399056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93937440,"statfs":{"total":96636764160,"available":96191938560,"internally_reserved":0,"allocated":408633344,"data_stored":408125441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":406847488,"data_stored":406847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":285212672,"data_stored":285212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":301989888,"data_stored":301989888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":436207616,"data_stored":436207616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":505413632,"data_stored":505413632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":369098752,"data_stored":369098752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":20947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":38049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":62333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":25989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:56:00.628 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-09T09:56:00.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-05-09T09:56:00.948 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-09T09:56:00.958 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-09T09:56:00.958 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:56:00.959 INFO:tasks.rgw.client.0.smithi032.stdout:2024-05-09T09:56:00.958+0000 7f0bdb7fe640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31016) UID: 0 2024-05-09T09:56:00.959 INFO:tasks.rgw.client.0.smithi032.stdout:2024-05-09T09:56:00.958+0000 7f0bec2559c0 -1 shutting down 2024-05-09T09:56:03.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-09T09:56:07.059 INFO:tasks.rgw.client.0:Stopped 2024-05-09T09:56:07.060 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-09T09:56:07.067 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f /etc/ceph/vault-root-token 2024-05-09T09:56:07.127 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-09T09:56:07.182 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-09T09:56:07.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-09T09:56:07.182 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-09T09:56:08.294 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T09:56:08.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T09:56:08.304 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:56:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:08.666 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:56:08.683 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-05-09T09:56:07.349030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636605482,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3772,"num_read_kb":1807243,"num_write":3328,"num_write_kb":2051082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":598,"num_bytes_recovered":1302381373,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2063,"ondisk_log_size":2063,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3471544,"kb_used_data":3205480,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":751503176,"statfs":{"total":773094113280,"available":769539252224,"internally_reserved":0,"allocated":3282411520,"data_stored":3278304908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":272354867},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.652339"},"pg_stats":[{"pgid":"3.3f","version":"73'14","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017601+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:55:58.017601+0000","last_peered":"2024-05-09T09:55:58.017601+0000","last_clean":"2024-05-09T09:55:58.017601+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:55:58.017601+0000","last_undegraded":"2024-05-09T09:55:58.017601+0000","last_fullsized":"2024-05-09T09:55:58.017601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":47116,"num_write":34,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400553+0000","last_change":"2024-05-09T09:55:41.485053+0000","last_active":"2024-05-09T09:55:57.400553+0000","last_peered":"2024-05-09T09:55:57.400553+0000","last_clean":"2024-05-09T09:55:57.400553+0000","last_became_active":"2024-05-09T09:55:41.484367+0000","last_became_peered":"2024-05-09T09:55:41.484367+0000","last_unstale":"2024-05-09T09:55:57.400553+0000","last_undegraded":"2024-05-09T09:55:57.400553+0000","last_fullsized":"2024-05-09T09:55:57.400553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:39.155356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"73'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703942+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:55:56.703942+0000","last_peered":"2024-05-09T09:55:56.703942+0000","last_clean":"2024-05-09T09:55:56.703942+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:55:56.703942+0000","last_undegraded":"2024-05-09T09:55:56.703942+0000","last_fullsized":"2024-05-09T09:55:56.703942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'40","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015392+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:55:58.015392+0000","last_peered":"2024-05-09T09:55:58.015392+0000","last_clean":"2024-05-09T09:55:58.015392+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:55:58.015392+0000","last_undegraded":"2024-05-09T09:55:58.015392+0000","last_fullsized":"2024-05-09T09:55:58.015392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"73'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705841+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:55:56.705841+0000","last_peered":"2024-05-09T09:55:56.705841+0000","last_clean":"2024-05-09T09:55:56.705841+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:55:56.705841+0000","last_undegraded":"2024-05-09T09:55:56.705841+0000","last_fullsized":"2024-05-09T09:55:56.705841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":38918,"num_write":22,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705052+0000","last_change":"2024-05-09T09:55:41.476462+0000","last_active":"2024-05-09T09:55:56.705052+0000","last_peered":"2024-05-09T09:55:56.705052+0000","last_clean":"2024-05-09T09:55:56.705052+0000","last_became_active":"2024-05-09T09:55:41.474847+0000","last_became_peered":"2024-05-09T09:55:41.474847+0000","last_unstale":"2024-05-09T09:55:56.705052+0000","last_undegraded":"2024-05-09T09:55:56.705052+0000","last_fullsized":"2024-05-09T09:55:56.705052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'10","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401959+0000","last_change":"2024-05-09T09:55:11.074408+0000","last_active":"2024-05-09T09:55:57.401959+0000","last_peered":"2024-05-09T09:55:57.401959+0000","last_clean":"2024-05-09T09:55:57.401959+0000","last_became_active":"2024-05-09T09:55:10.495355+0000","last_became_peered":"2024-05-09T09:55:10.495355+0000","last_unstale":"2024-05-09T09:55:57.401959+0000","last_undegraded":"2024-05-09T09:55:57.401959+0000","last_fullsized":"2024-05-09T09:55:57.401959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:16:55.087662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704348+0000","last_change":"2024-05-09T09:55:10.508149+0000","last_active":"2024-05-09T09:55:56.704348+0000","last_peered":"2024-05-09T09:55:56.704348+0000","last_clean":"2024-05-09T09:55:56.704348+0000","last_became_active":"2024-05-09T09:55:10.506740+0000","last_became_peered":"2024-05-09T09:55:10.506740+0000","last_unstale":"2024-05-09T09:55:56.704348+0000","last_undegraded":"2024-05-09T09:55:56.704348+0000","last_fullsized":"2024-05-09T09:55:56.704348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:15.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"67'10","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297604+0000","last_change":"2024-05-09T09:53:54.477992+0000","last_active":"2024-05-09T09:55:57.297604+0000","last_peered":"2024-05-09T09:55:57.297604+0000","last_clean":"2024-05-09T09:55:57.297604+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:55:57.297604+0000","last_undegraded":"2024-05-09T09:55:57.297604+0000","last_fullsized":"2024-05-09T09:55:57.297604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:38.501294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'14","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400463+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:55:57.400463+0000","last_peered":"2024-05-09T09:55:57.400463+0000","last_clean":"2024-05-09T09:55:57.400463+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:55:57.400463+0000","last_undegraded":"2024-05-09T09:55:57.400463+0000","last_fullsized":"2024-05-09T09:55:57.400463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:45:31.509591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":34840,"num_write":54,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'38","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706070+0000","last_change":"2024-05-09T09:55:41.723376+0000","last_active":"2024-05-09T09:55:56.706070+0000","last_peered":"2024-05-09T09:55:56.706070+0000","last_clean":"2024-05-09T09:55:56.706070+0000","last_became_active":"2024-05-09T09:55:41.470370+0000","last_became_peered":"2024-05-09T09:55:41.470370+0000","last_unstale":"2024-05-09T09:55:56.706070+0000","last_undegraded":"2024-05-09T09:55:56.706070+0000","last_fullsized":"2024-05-09T09:55:56.706070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:01.442445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"64'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016806+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:55:58.016806+0000","last_peered":"2024-05-09T09:55:58.016806+0000","last_clean":"2024-05-09T09:55:58.016806+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:55:58.016806+0000","last_undegraded":"2024-05-09T09:55:58.016806+0000","last_fullsized":"2024-05-09T09:55:58.016806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":34816,"num_write":9,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399784+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:55:57.399784+0000","last_peered":"2024-05-09T09:55:57.399784+0000","last_clean":"2024-05-09T09:55:57.399784+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:55:57.399784+0000","last_undegraded":"2024-05-09T09:55:57.399784+0000","last_fullsized":"2024-05-09T09:55:57.399784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'15","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013473+0000","last_change":"2024-05-09T09:55:11.513082+0000","last_active":"2024-05-09T09:55:58.013473+0000","last_peered":"2024-05-09T09:55:58.013473+0000","last_clean":"2024-05-09T09:55:58.013473+0000","last_became_active":"2024-05-09T09:55:10.517657+0000","last_became_peered":"2024-05-09T09:55:10.517657+0000","last_unstale":"2024-05-09T09:55:58.013473+0000","last_undegraded":"2024-05-09T09:55:58.013473+0000","last_fullsized":"2024-05-09T09:55:58.013473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:28.563341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":22558,"num_write":65,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513158+0000","last_change":"2024-05-09T09:55:10.525459+0000","last_active":"2024-05-09T09:55:57.513158+0000","last_peered":"2024-05-09T09:55:57.513158+0000","last_clean":"2024-05-09T09:55:57.513158+0000","last_became_active":"2024-05-09T09:55:10.525051+0000","last_became_peered":"2024-05-09T09:55:10.525051+0000","last_unstale":"2024-05-09T09:55:57.513158+0000","last_undegraded":"2024-05-09T09:55:57.513158+0000","last_fullsized":"2024-05-09T09:55:57.513158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:08.309277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704076+0000","last_change":"2024-05-09T09:55:41.727656+0000","last_active":"2024-05-09T09:55:56.704076+0000","last_peered":"2024-05-09T09:55:56.704076+0000","last_clean":"2024-05-09T09:55:56.704076+0000","last_became_active":"2024-05-09T09:55:41.468227+0000","last_became_peered":"2024-05-09T09:55:41.468227+0000","last_unstale":"2024-05-09T09:55:56.704076+0000","last_undegraded":"2024-05-09T09:55:56.704076+0000","last_fullsized":"2024-05-09T09:55:56.704076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017765+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:55:58.017765+0000","last_peered":"2024-05-09T09:55:58.017765+0000","last_clean":"2024-05-09T09:55:58.017765+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:55:58.017765+0000","last_undegraded":"2024-05-09T09:55:58.017765+0000","last_fullsized":"2024-05-09T09:55:58.017765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014983+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:55:58.014983+0000","last_peered":"2024-05-09T09:55:58.014983+0000","last_clean":"2024-05-09T09:55:58.014983+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:55:58.014983+0000","last_undegraded":"2024-05-09T09:55:58.014983+0000","last_fullsized":"2024-05-09T09:55:58.014983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299075+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.299075+0000","last_peered":"2024-05-09T09:55:57.299075+0000","last_clean":"2024-05-09T09:55:57.299075+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:55:57.299075+0000","last_undegraded":"2024-05-09T09:55:57.299075+0000","last_fullsized":"2024-05-09T09:55:57.299075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400770+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:55:57.400770+0000","last_peered":"2024-05-09T09:55:57.400770+0000","last_clean":"2024-05-09T09:55:57.400770+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:55:57.400770+0000","last_undegraded":"2024-05-09T09:55:57.400770+0000","last_fullsized":"2024-05-09T09:55:57.400770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299149+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:55:57.299149+0000","last_peered":"2024-05-09T09:55:57.299149+0000","last_clean":"2024-05-09T09:55:57.299149+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:55:57.299149+0000","last_undegraded":"2024-05-09T09:55:57.299149+0000","last_fullsized":"2024-05-09T09:55:57.299149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512589+0000","last_change":"2024-05-09T09:55:10.502036+0000","last_active":"2024-05-09T09:55:57.512589+0000","last_peered":"2024-05-09T09:55:57.512589+0000","last_clean":"2024-05-09T09:55:57.512589+0000","last_became_active":"2024-05-09T09:55:10.501517+0000","last_became_peered":"2024-05-09T09:55:10.501517+0000","last_unstale":"2024-05-09T09:55:57.512589+0000","last_undegraded":"2024-05-09T09:55:57.512589+0000","last_fullsized":"2024-05-09T09:55:57.512589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:30.945254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"66'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705752+0000","last_change":"2024-05-09T09:55:42.549939+0000","last_active":"2024-05-09T09:55:56.705752+0000","last_peered":"2024-05-09T09:55:56.705752+0000","last_clean":"2024-05-09T09:55:56.705752+0000","last_became_active":"2024-05-09T09:55:41.517108+0000","last_became_peered":"2024-05-09T09:55:41.517108+0000","last_unstale":"2024-05-09T09:55:56.705752+0000","last_undegraded":"2024-05-09T09:55:56.705752+0000","last_fullsized":"2024-05-09T09:55:56.705752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:39.522749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511344+0000","last_change":"2024-05-09T09:55:41.495787+0000","last_active":"2024-05-09T09:55:57.511344+0000","last_peered":"2024-05-09T09:55:57.511344+0000","last_clean":"2024-05-09T09:55:57.511344+0000","last_became_active":"2024-05-09T09:55:41.495217+0000","last_became_peered":"2024-05-09T09:55:41.495217+0000","last_unstale":"2024-05-09T09:55:57.511344+0000","last_undegraded":"2024-05-09T09:55:57.511344+0000","last_fullsized":"2024-05-09T09:55:57.511344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:19.303237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"67'12","reported_seq":73,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017067+0000","last_change":"2024-05-09T09:55:11.744028+0000","last_active":"2024-05-09T09:55:58.017067+0000","last_peered":"2024-05-09T09:55:58.017067+0000","last_clean":"2024-05-09T09:55:58.017067+0000","last_became_active":"2024-05-09T09:55:10.515515+0000","last_became_peered":"2024-05-09T09:55:10.515515+0000","last_unstale":"2024-05-09T09:55:58.017067+0000","last_undegraded":"2024-05-09T09:55:58.017067+0000","last_fullsized":"2024-05-09T09:55:58.017067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:26:21.134168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":77594624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706053+0000","last_change":"2024-05-09T09:55:41.471993+0000","last_active":"2024-05-09T09:55:56.706053+0000","last_peered":"2024-05-09T09:55:56.706053+0000","last_clean":"2024-05-09T09:55:56.706053+0000","last_became_active":"2024-05-09T09:55:41.469463+0000","last_became_peered":"2024-05-09T09:55:41.469463+0000","last_unstale":"2024-05-09T09:55:56.706053+0000","last_undegraded":"2024-05-09T09:55:56.706053+0000","last_fullsized":"2024-05-09T09:55:56.706053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:09.428329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702672+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:55:56.702672+0000","last_peered":"2024-05-09T09:55:56.702672+0000","last_clean":"2024-05-09T09:55:56.702672+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:55:56.702672+0000","last_undegraded":"2024-05-09T09:55:56.702672+0000","last_fullsized":"2024-05-09T09:55:56.702672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703760+0000","last_change":"2024-05-09T09:55:41.489025+0000","last_active":"2024-05-09T09:55:56.703760+0000","last_peered":"2024-05-09T09:55:56.703760+0000","last_clean":"2024-05-09T09:55:56.703760+0000","last_became_active":"2024-05-09T09:55:41.479825+0000","last_became_peered":"2024-05-09T09:55:41.479825+0000","last_unstale":"2024-05-09T09:55:56.703760+0000","last_undegraded":"2024-05-09T09:55:56.703760+0000","last_fullsized":"2024-05-09T09:55:56.703760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017517+0000","last_change":"2024-05-09T09:55:10.499813+0000","last_active":"2024-05-09T09:55:58.017517+0000","last_peered":"2024-05-09T09:55:58.017517+0000","last_clean":"2024-05-09T09:55:58.017517+0000","last_became_active":"2024-05-09T09:55:10.499014+0000","last_became_peered":"2024-05-09T09:55:10.499014+0000","last_unstale":"2024-05-09T09:55:58.017517+0000","last_undegraded":"2024-05-09T09:55:58.017517+0000","last_fullsized":"2024-05-09T09:55:58.017517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:12.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"68'9","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015039+0000","last_change":"2024-05-09T09:55:43.099041+0000","last_active":"2024-05-09T09:55:58.015039+0000","last_peered":"2024-05-09T09:55:58.015039+0000","last_clean":"2024-05-09T09:55:58.015039+0000","last_became_active":"2024-05-09T09:55:41.507252+0000","last_became_peered":"2024-05-09T09:55:41.507252+0000","last_unstale":"2024-05-09T09:55:58.015039+0000","last_undegraded":"2024-05-09T09:55:58.015039+0000","last_fullsized":"2024-05-09T09:55:58.015039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401721+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:55:57.401721+0000","last_peered":"2024-05-09T09:55:57.401721+0000","last_clean":"2024-05-09T09:55:57.401721+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:55:57.401721+0000","last_undegraded":"2024-05-09T09:55:57.401721+0000","last_fullsized":"2024-05-09T09:55:57.401721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"73'16","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706715+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:55:56.706715+0000","last_peered":"2024-05-09T09:55:56.706715+0000","last_clean":"2024-05-09T09:55:56.706715+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:55:56.706715+0000","last_undegraded":"2024-05-09T09:55:56.706715+0000","last_fullsized":"2024-05-09T09:55:56.706715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017272+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:55:58.017272+0000","last_peered":"2024-05-09T09:55:58.017272+0000","last_clean":"2024-05-09T09:55:58.017272+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:55:58.017272+0000","last_undegraded":"2024-05-09T09:55:58.017272+0000","last_fullsized":"2024-05-09T09:55:58.017272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400280+0000","last_change":"2024-05-09T09:55:41.487851+0000","last_active":"2024-05-09T09:55:57.400280+0000","last_peered":"2024-05-09T09:55:57.400280+0000","last_clean":"2024-05-09T09:55:57.400280+0000","last_became_active":"2024-05-09T09:55:41.487060+0000","last_became_peered":"2024-05-09T09:55:41.487060+0000","last_unstale":"2024-05-09T09:55:57.400280+0000","last_undegraded":"2024-05-09T09:55:57.400280+0000","last_fullsized":"2024-05-09T09:55:57.400280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:54:51.000892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402309+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:55:57.402309+0000","last_peered":"2024-05-09T09:55:57.402309+0000","last_clean":"2024-05-09T09:55:57.402309+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:55:57.402309+0000","last_undegraded":"2024-05-09T09:55:57.402309+0000","last_fullsized":"2024-05-09T09:55:57.402309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'4","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702911+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:55:56.702911+0000","last_peered":"2024-05-09T09:55:56.702911+0000","last_clean":"2024-05-09T09:55:56.702911+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:55:56.702911+0000","last_undegraded":"2024-05-09T09:55:56.702911+0000","last_fullsized":"2024-05-09T09:55:56.702911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12294,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018013+0000","last_change":"2024-05-09T09:55:10.509010+0000","last_active":"2024-05-09T09:55:58.018013+0000","last_peered":"2024-05-09T09:55:58.018013+0000","last_clean":"2024-05-09T09:55:58.018013+0000","last_became_active":"2024-05-09T09:55:10.506778+0000","last_became_peered":"2024-05-09T09:55:10.506778+0000","last_unstale":"2024-05-09T09:55:58.018013+0000","last_undegraded":"2024-05-09T09:55:58.018013+0000","last_fullsized":"2024-05-09T09:55:58.018013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706557+0000","last_change":"2024-05-09T09:55:41.534680+0000","last_active":"2024-05-09T09:55:56.706557+0000","last_peered":"2024-05-09T09:55:56.706557+0000","last_clean":"2024-05-09T09:55:56.706557+0000","last_became_active":"2024-05-09T09:55:41.467079+0000","last_became_peered":"2024-05-09T09:55:41.467079+0000","last_unstale":"2024-05-09T09:55:56.706557+0000","last_undegraded":"2024-05-09T09:55:56.706557+0000","last_fullsized":"2024-05-09T09:55:56.706557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:22.934731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706204+0000","last_change":"2024-05-09T09:55:41.468769+0000","last_active":"2024-05-09T09:55:56.706204+0000","last_peered":"2024-05-09T09:55:56.706204+0000","last_clean":"2024-05-09T09:55:56.706204+0000","last_became_active":"2024-05-09T09:55:41.467929+0000","last_became_peered":"2024-05-09T09:55:41.467929+0000","last_unstale":"2024-05-09T09:55:56.706204+0000","last_undegraded":"2024-05-09T09:55:56.706204+0000","last_fullsized":"2024-05-09T09:55:56.706204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:02.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702279+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:55:56.702279+0000","last_peered":"2024-05-09T09:55:56.702279+0000","last_clean":"2024-05-09T09:55:56.702279+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:55:56.702279+0000","last_undegraded":"2024-05-09T09:55:56.702279+0000","last_fullsized":"2024-05-09T09:55:56.702279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705924+0000","last_change":"2024-05-09T09:55:10.483103+0000","last_active":"2024-05-09T09:55:56.705924+0000","last_peered":"2024-05-09T09:55:56.705924+0000","last_clean":"2024-05-09T09:55:56.705924+0000","last_became_active":"2024-05-09T09:55:10.482649+0000","last_became_peered":"2024-05-09T09:55:10.482649+0000","last_unstale":"2024-05-09T09:55:56.705924+0000","last_undegraded":"2024-05-09T09:55:56.705924+0000","last_fullsized":"2024-05-09T09:55:56.705924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'14","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014967+0000","last_change":"2024-05-09T09:55:45.036128+0000","last_active":"2024-05-09T09:55:58.014967+0000","last_peered":"2024-05-09T09:55:58.014967+0000","last_clean":"2024-05-09T09:55:58.014967+0000","last_became_active":"2024-05-09T09:55:41.508695+0000","last_became_peered":"2024-05-09T09:55:41.508695+0000","last_unstale":"2024-05-09T09:55:58.014967+0000","last_undegraded":"2024-05-09T09:55:58.014967+0000","last_fullsized":"2024-05-09T09:55:58.014967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":38936,"num_write":54,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018240+0000","last_change":"2024-05-09T09:55:10.510105+0000","last_active":"2024-05-09T09:55:58.018240+0000","last_peered":"2024-05-09T09:55:58.018240+0000","last_clean":"2024-05-09T09:55:58.018240+0000","last_became_active":"2024-05-09T09:55:10.508122+0000","last_became_peered":"2024-05-09T09:55:10.508122+0000","last_unstale":"2024-05-09T09:55:58.018240+0000","last_undegraded":"2024-05-09T09:55:58.018240+0000","last_fullsized":"2024-05-09T09:55:58.018240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"63'11","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511453+0000","last_change":"2024-05-09T09:55:43.116362+0000","last_active":"2024-05-09T09:55:57.511453+0000","last_peered":"2024-05-09T09:55:57.511453+0000","last_clean":"2024-05-09T09:55:57.511453+0000","last_became_active":"2024-05-09T09:55:41.506785+0000","last_became_peered":"2024-05-09T09:55:41.506785+0000","last_unstale":"2024-05-09T09:55:57.511453+0000","last_undegraded":"2024-05-09T09:55:57.511453+0000","last_fullsized":"2024-05-09T09:55:57.511453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:30.446781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'15","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.019317+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:55:58.019317+0000","last_peered":"2024-05-09T09:55:58.019317+0000","last_clean":"2024-05-09T09:55:58.019317+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:55:58.019317+0000","last_undegraded":"2024-05-09T09:55:58.019317+0000","last_fullsized":"2024-05-09T09:55:58.019317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705111+0000","last_change":"2024-05-09T09:55:42.211684+0000","last_active":"2024-05-09T09:55:56.705111+0000","last_peered":"2024-05-09T09:55:56.705111+0000","last_clean":"2024-05-09T09:55:56.705111+0000","last_became_active":"2024-05-09T09:55:41.492528+0000","last_became_peered":"2024-05-09T09:55:41.492528+0000","last_unstale":"2024-05-09T09:55:56.705111+0000","last_undegraded":"2024-05-09T09:55:56.705111+0000","last_fullsized":"2024-05-09T09:55:56.705111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:23.272525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018549+0000","last_change":"2024-05-09T09:55:10.510510+0000","last_active":"2024-05-09T09:55:58.018549+0000","last_peered":"2024-05-09T09:55:58.018549+0000","last_clean":"2024-05-09T09:55:58.018549+0000","last_became_active":"2024-05-09T09:55:10.508721+0000","last_became_peered":"2024-05-09T09:55:10.508721+0000","last_unstale":"2024-05-09T09:55:58.018549+0000","last_undegraded":"2024-05-09T09:55:58.018549+0000","last_fullsized":"2024-05-09T09:55:58.018549+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'7","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298120+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:55:57.298120+0000","last_peered":"2024-05-09T09:55:57.298120+0000","last_clean":"2024-05-09T09:55:57.298120+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:55:57.298120+0000","last_undegraded":"2024-05-09T09:55:57.298120+0000","last_fullsized":"2024-05-09T09:55:57.298120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401894+0000","last_change":"2024-05-09T09:55:10.508180+0000","last_active":"2024-05-09T09:55:57.401894+0000","last_peered":"2024-05-09T09:55:57.401894+0000","last_clean":"2024-05-09T09:55:57.401894+0000","last_became_active":"2024-05-09T09:55:10.507504+0000","last_became_peered":"2024-05-09T09:55:10.507504+0000","last_unstale":"2024-05-09T09:55:57.401894+0000","last_undegraded":"2024-05-09T09:55:57.401894+0000","last_fullsized":"2024-05-09T09:55:57.401894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:26.131778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"73'14","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018747+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:55:58.018747+0000","last_peered":"2024-05-09T09:55:58.018747+0000","last_clean":"2024-05-09T09:55:58.018747+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:55:58.018747+0000","last_undegraded":"2024-05-09T09:55:58.018747+0000","last_fullsized":"2024-05-09T09:55:58.018747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'18","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017797+0000","last_change":"2024-05-09T09:55:10.785031+0000","last_active":"2024-05-09T09:55:58.017797+0000","last_peered":"2024-05-09T09:55:58.017797+0000","last_clean":"2024-05-09T09:55:58.017797+0000","last_became_active":"2024-05-09T09:55:10.502644+0000","last_became_peered":"2024-05-09T09:55:10.502644+0000","last_unstale":"2024-05-09T09:55:58.017797+0000","last_undegraded":"2024-05-09T09:55:58.017797+0000","last_fullsized":"2024-05-09T09:55:58.017797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:14.036784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400855+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:55:57.400855+0000","last_peered":"2024-05-09T09:55:57.400855+0000","last_clean":"2024-05-09T09:55:57.400855+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:55:57.400855+0000","last_undegraded":"2024-05-09T09:55:57.400855+0000","last_fullsized":"2024-05-09T09:55:57.400855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"75'12","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015784+0000","last_change":"2024-05-09T09:55:44.175359+0000","last_active":"2024-05-09T09:55:58.015784+0000","last_peered":"2024-05-09T09:55:58.015784+0000","last_clean":"2024-05-09T09:55:58.015784+0000","last_became_active":"2024-05-09T09:55:41.507201+0000","last_became_peered":"2024-05-09T09:55:41.507201+0000","last_unstale":"2024-05-09T09:55:58.015784+0000","last_undegraded":"2024-05-09T09:55:58.015784+0000","last_fullsized":"2024-05-09T09:55:58.015784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:07.511876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016355+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:55:58.016355+0000","last_peered":"2024-05-09T09:55:58.016355+0000","last_clean":"2024-05-09T09:55:58.016355+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:55:58.016355+0000","last_undegraded":"2024-05-09T09:55:58.016355+0000","last_fullsized":"2024-05-09T09:55:58.016355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'27","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401423+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:55:57.401423+0000","last_peered":"2024-05-09T09:55:57.401423+0000","last_clean":"2024-05-09T09:55:57.401423+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:55:57.401423+0000","last_undegraded":"2024-05-09T09:55:57.401423+0000","last_fullsized":"2024-05-09T09:55:57.401423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704309+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:55:56.704309+0000","last_peered":"2024-05-09T09:55:56.704309+0000","last_clean":"2024-05-09T09:55:56.704309+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:55:56.704309+0000","last_undegraded":"2024-05-09T09:55:56.704309+0000","last_fullsized":"2024-05-09T09:55:56.704309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401424+0000","last_change":"2024-05-09T09:55:41.485193+0000","last_active":"2024-05-09T09:55:57.401424+0000","last_peered":"2024-05-09T09:55:57.401424+0000","last_clean":"2024-05-09T09:55:57.401424+0000","last_became_active":"2024-05-09T09:55:41.484312+0000","last_became_peered":"2024-05-09T09:55:41.484312+0000","last_unstale":"2024-05-09T09:55:57.401424+0000","last_undegraded":"2024-05-09T09:55:57.401424+0000","last_fullsized":"2024-05-09T09:55:57.401424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:59.737104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704125+0000","last_change":"2024-05-09T09:55:41.479720+0000","last_active":"2024-05-09T09:55:56.704125+0000","last_peered":"2024-05-09T09:55:56.704125+0000","last_clean":"2024-05-09T09:55:56.704125+0000","last_became_active":"2024-05-09T09:55:41.472133+0000","last_became_peered":"2024-05-09T09:55:41.472133+0000","last_unstale":"2024-05-09T09:55:56.704125+0000","last_undegraded":"2024-05-09T09:55:56.704125+0000","last_fullsized":"2024-05-09T09:55:56.704125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:55.564231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"64'4","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015251+0000","last_change":"2024-05-09T09:55:44.852684+0000","last_active":"2024-05-09T09:55:58.015251+0000","last_peered":"2024-05-09T09:55:58.015251+0000","last_clean":"2024-05-09T09:55:58.015251+0000","last_became_active":"2024-05-09T09:55:41.507751+0000","last_became_peered":"2024-05-09T09:55:41.507751+0000","last_unstale":"2024-05-09T09:55:58.015251+0000","last_undegraded":"2024-05-09T09:55:58.015251+0000","last_fullsized":"2024-05-09T09:55:58.015251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:13.201219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511904+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:55:57.511904+0000","last_peered":"2024-05-09T09:55:57.511904+0000","last_clean":"2024-05-09T09:55:57.511904+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:55:57.511904+0000","last_undegraded":"2024-05-09T09:55:57.511904+0000","last_fullsized":"2024-05-09T09:55:57.511904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"73'13","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013285+0000","last_change":"2024-05-09T09:55:11.749967+0000","last_active":"2024-05-09T09:55:58.013285+0000","last_peered":"2024-05-09T09:55:58.013285+0000","last_clean":"2024-05-09T09:55:58.013285+0000","last_became_active":"2024-05-09T09:55:10.522763+0000","last_became_peered":"2024-05-09T09:55:10.522763+0000","last_unstale":"2024-05-09T09:55:58.013285+0000","last_undegraded":"2024-05-09T09:55:58.013285+0000","last_fullsized":"2024-05-09T09:55:58.013285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:03.450608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013669+0000","last_change":"2024-05-09T09:55:10.505759+0000","last_active":"2024-05-09T09:55:58.013669+0000","last_peered":"2024-05-09T09:55:58.013669+0000","last_clean":"2024-05-09T09:55:58.013669+0000","last_became_active":"2024-05-09T09:55:10.504789+0000","last_became_peered":"2024-05-09T09:55:10.504789+0000","last_unstale":"2024-05-09T09:55:58.013669+0000","last_undegraded":"2024-05-09T09:55:58.013669+0000","last_fullsized":"2024-05-09T09:55:58.013669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:53.805557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298207+0000","last_change":"2024-05-09T09:55:41.506430+0000","last_active":"2024-05-09T09:55:57.298207+0000","last_peered":"2024-05-09T09:55:57.298207+0000","last_clean":"2024-05-09T09:55:57.298207+0000","last_became_active":"2024-05-09T09:55:41.505745+0000","last_became_peered":"2024-05-09T09:55:41.505745+0000","last_unstale":"2024-05-09T09:55:57.298207+0000","last_undegraded":"2024-05-09T09:55:57.298207+0000","last_fullsized":"2024-05-09T09:55:57.298207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:18.090362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017383+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:55:58.017383+0000","last_peered":"2024-05-09T09:55:58.017383+0000","last_clean":"2024-05-09T09:55:58.017383+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:55:58.017383+0000","last_undegraded":"2024-05-09T09:55:58.017383+0000","last_fullsized":"2024-05-09T09:55:58.017383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512208+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:55:57.512208+0000","last_peered":"2024-05-09T09:55:57.512208+0000","last_clean":"2024-05-09T09:55:57.512208+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:55:57.512208+0000","last_undegraded":"2024-05-09T09:55:57.512208+0000","last_fullsized":"2024-05-09T09:55:57.512208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"73'21","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016539+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:55:58.016539+0000","last_peered":"2024-05-09T09:55:58.016539+0000","last_clean":"2024-05-09T09:55:58.016539+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:55:58.016539+0000","last_undegraded":"2024-05-09T09:55:58.016539+0000","last_fullsized":"2024-05-09T09:55:58.016539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'15","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701053+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:55:56.701053+0000","last_peered":"2024-05-09T09:55:56.701053+0000","last_clean":"2024-05-09T09:55:56.701053+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:55:56.701053+0000","last_undegraded":"2024-05-09T09:55:56.701053+0000","last_fullsized":"2024-05-09T09:55:56.701053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706729+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:55:56.706729+0000","last_peered":"2024-05-09T09:55:56.706729+0000","last_clean":"2024-05-09T09:55:56.706729+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:55:56.706729+0000","last_undegraded":"2024-05-09T09:55:56.706729+0000","last_fullsized":"2024-05-09T09:55:56.706729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705393+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:55:56.705393+0000","last_peered":"2024-05-09T09:55:56.705393+0000","last_clean":"2024-05-09T09:55:56.705393+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:55:56.705393+0000","last_undegraded":"2024-05-09T09:55:56.705393+0000","last_fullsized":"2024-05-09T09:55:56.705393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'12","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402227+0000","last_change":"2024-05-09T09:55:11.694165+0000","last_active":"2024-05-09T09:55:57.402227+0000","last_peered":"2024-05-09T09:55:57.402227+0000","last_clean":"2024-05-09T09:55:57.402227+0000","last_became_active":"2024-05-09T09:55:10.521894+0000","last_became_peered":"2024-05-09T09:55:10.521894+0000","last_unstale":"2024-05-09T09:55:57.402227+0000","last_undegraded":"2024-05-09T09:55:57.402227+0000","last_fullsized":"2024-05-09T09:55:57.402227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:04.661085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38924,"num_write":32,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511206+0000","last_change":"2024-05-09T09:55:41.484220+0000","last_active":"2024-05-09T09:55:57.511206+0000","last_peered":"2024-05-09T09:55:57.511206+0000","last_clean":"2024-05-09T09:55:57.511206+0000","last_became_active":"2024-05-09T09:55:41.483828+0000","last_became_peered":"2024-05-09T09:55:41.483828+0000","last_unstale":"2024-05-09T09:55:57.511206+0000","last_undegraded":"2024-05-09T09:55:57.511206+0000","last_fullsized":"2024-05-09T09:55:57.511206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:12.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701503+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:55:56.701503+0000","last_peered":"2024-05-09T09:55:56.701503+0000","last_clean":"2024-05-09T09:55:56.701503+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:55:56.701503+0000","last_undegraded":"2024-05-09T09:55:56.701503+0000","last_fullsized":"2024-05-09T09:55:56.701503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13754,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":60,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511648+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:55:57.511648+0000","last_peered":"2024-05-09T09:55:57.511648+0000","last_clean":"2024-05-09T09:55:57.511648+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:55:57.511648+0000","last_undegraded":"2024-05-09T09:55:57.511648+0000","last_fullsized":"2024-05-09T09:55:57.511648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703562+0000","last_change":"2024-05-09T09:55:10.518479+0000","last_active":"2024-05-09T09:55:56.703562+0000","last_peered":"2024-05-09T09:55:56.703562+0000","last_clean":"2024-05-09T09:55:56.703562+0000","last_became_active":"2024-05-09T09:55:10.518109+0000","last_became_peered":"2024-05-09T09:55:10.518109+0000","last_unstale":"2024-05-09T09:55:56.703562+0000","last_undegraded":"2024-05-09T09:55:56.703562+0000","last_fullsized":"2024-05-09T09:55:56.703562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705558+0000","last_change":"2024-05-09T09:55:41.491823+0000","last_active":"2024-05-09T09:55:56.705558+0000","last_peered":"2024-05-09T09:55:56.705558+0000","last_clean":"2024-05-09T09:55:56.705558+0000","last_became_active":"2024-05-09T09:55:41.488846+0000","last_became_peered":"2024-05-09T09:55:41.488846+0000","last_unstale":"2024-05-09T09:55:56.705558+0000","last_undegraded":"2024-05-09T09:55:56.705558+0000","last_fullsized":"2024-05-09T09:55:56.705558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:00.130607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"73'11","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016975+0000","last_change":"2024-05-09T09:55:10.972117+0000","last_active":"2024-05-09T09:55:58.016975+0000","last_peered":"2024-05-09T09:55:58.016975+0000","last_clean":"2024-05-09T09:55:58.016975+0000","last_became_active":"2024-05-09T09:55:10.507132+0000","last_became_peered":"2024-05-09T09:55:10.507132+0000","last_unstale":"2024-05-09T09:55:58.016975+0000","last_undegraded":"2024-05-09T09:55:58.016975+0000","last_fullsized":"2024-05-09T09:55:58.016975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:59.211608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":22550,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512533+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:55:57.512533+0000","last_peered":"2024-05-09T09:55:57.512533+0000","last_clean":"2024-05-09T09:55:57.512533+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:55:57.512533+0000","last_undegraded":"2024-05-09T09:55:57.512533+0000","last_fullsized":"2024-05-09T09:55:57.512533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"78'20","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706140+0000","last_change":"2024-05-09T09:55:42.405072+0000","last_active":"2024-05-09T09:55:56.706140+0000","last_peered":"2024-05-09T09:55:56.706140+0000","last_clean":"2024-05-09T09:55:56.706140+0000","last_became_active":"2024-05-09T09:55:41.509467+0000","last_became_peered":"2024-05-09T09:55:41.509467+0000","last_unstale":"2024-05-09T09:55:56.706140+0000","last_undegraded":"2024-05-09T09:55:56.706140+0000","last_fullsized":"2024-05-09T09:55:56.706140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:31.891322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":28,"num_write":26,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":6936,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706227+0000","last_change":"2024-05-09T09:55:10.506676+0000","last_active":"2024-05-09T09:55:56.706227+0000","last_peered":"2024-05-09T09:55:56.706227+0000","last_clean":"2024-05-09T09:55:56.706227+0000","last_became_active":"2024-05-09T09:55:10.506376+0000","last_became_peered":"2024-05-09T09:55:10.506376+0000","last_unstale":"2024-05-09T09:55:56.706227+0000","last_undegraded":"2024-05-09T09:55:56.706227+0000","last_fullsized":"2024-05-09T09:55:56.706227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:18.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"63'2","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016084+0000","last_change":"2024-05-09T09:55:11.409285+0000","last_active":"2024-05-09T09:55:58.016084+0000","last_peered":"2024-05-09T09:55:58.016084+0000","last_clean":"2024-05-09T09:55:58.016084+0000","last_became_active":"2024-05-09T09:55:10.512509+0000","last_became_peered":"2024-05-09T09:55:10.512509+0000","last_unstale":"2024-05-09T09:55:58.016084+0000","last_undegraded":"2024-05-09T09:55:58.016084+0000","last_fullsized":"2024-05-09T09:55:58.016084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:08.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706333+0000","last_change":"2024-05-09T09:55:41.477052+0000","last_active":"2024-05-09T09:55:56.706333+0000","last_peered":"2024-05-09T09:55:56.706333+0000","last_clean":"2024-05-09T09:55:56.706333+0000","last_became_active":"2024-05-09T09:55:41.471497+0000","last_became_peered":"2024-05-09T09:55:41.471497+0000","last_unstale":"2024-05-09T09:55:56.706333+0000","last_undegraded":"2024-05-09T09:55:56.706333+0000","last_fullsized":"2024-05-09T09:55:56.706333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:59:59.078912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'10","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298753+0000","last_change":"2024-05-09T09:55:42.508840+0000","last_active":"2024-05-09T09:55:57.298753+0000","last_peered":"2024-05-09T09:55:57.298753+0000","last_clean":"2024-05-09T09:55:57.298753+0000","last_became_active":"2024-05-09T09:55:41.513259+0000","last_became_peered":"2024-05-09T09:55:41.513259+0000","last_unstale":"2024-05-09T09:55:57.298753+0000","last_undegraded":"2024-05-09T09:55:57.298753+0000","last_fullsized":"2024-05-09T09:55:57.298753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703127+0000","last_change":"2024-05-09T09:55:41.505012+0000","last_active":"2024-05-09T09:55:56.703127+0000","last_peered":"2024-05-09T09:55:56.703127+0000","last_clean":"2024-05-09T09:55:56.703127+0000","last_became_active":"2024-05-09T09:55:41.504609+0000","last_became_peered":"2024-05-09T09:55:41.504609+0000","last_unstale":"2024-05-09T09:55:56.703127+0000","last_undegraded":"2024-05-09T09:55:56.703127+0000","last_fullsized":"2024-05-09T09:55:56.703127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"73'24","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512979+0000","last_change":"2024-05-09T09:55:10.818400+0000","last_active":"2024-05-09T09:55:57.512979+0000","last_peered":"2024-05-09T09:55:57.512979+0000","last_clean":"2024-05-09T09:55:57.512979+0000","last_became_active":"2024-05-09T09:55:10.520615+0000","last_became_peered":"2024-05-09T09:55:10.520615+0000","last_unstale":"2024-05-09T09:55:57.512979+0000","last_undegraded":"2024-05-09T09:55:57.512979+0000","last_fullsized":"2024-05-09T09:55:57.512979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:32.213479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":3002,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'15","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513004+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:55:57.513004+0000","last_peered":"2024-05-09T09:55:57.513004+0000","last_clean":"2024-05-09T09:55:57.513004+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:55:57.513004+0000","last_undegraded":"2024-05-09T09:55:57.513004+0000","last_fullsized":"2024-05-09T09:55:57.513004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702414+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:55:56.702414+0000","last_peered":"2024-05-09T09:55:56.702414+0000","last_clean":"2024-05-09T09:55:56.702414+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:55:56.702414+0000","last_undegraded":"2024-05-09T09:55:56.702414+0000","last_fullsized":"2024-05-09T09:55:56.702414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706758+0000","last_change":"2024-05-09T09:55:42.572344+0000","last_active":"2024-05-09T09:55:56.706758+0000","last_peered":"2024-05-09T09:55:56.706758+0000","last_clean":"2024-05-09T09:55:56.706758+0000","last_became_active":"2024-05-09T09:55:41.517278+0000","last_became_peered":"2024-05-09T09:55:41.517278+0000","last_unstale":"2024-05-09T09:55:56.706758+0000","last_undegraded":"2024-05-09T09:55:56.706758+0000","last_fullsized":"2024-05-09T09:55:56.706758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'12","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704482+0000","last_change":"2024-05-09T09:55:42.204305+0000","last_active":"2024-05-09T09:55:56.704482+0000","last_peered":"2024-05-09T09:55:56.704482+0000","last_clean":"2024-05-09T09:55:56.704482+0000","last_became_active":"2024-05-09T09:55:41.481490+0000","last_became_peered":"2024-05-09T09:55:41.481490+0000","last_unstale":"2024-05-09T09:55:56.704482+0000","last_undegraded":"2024-05-09T09:55:56.704482+0000","last_fullsized":"2024-05-09T09:55:56.704482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402933+0000","last_change":"2024-05-09T09:55:41.651487+0000","last_active":"2024-05-09T09:55:57.402933+0000","last_peered":"2024-05-09T09:55:57.402933+0000","last_clean":"2024-05-09T09:55:57.402933+0000","last_became_active":"2024-05-09T09:55:41.495448+0000","last_became_peered":"2024-05-09T09:55:41.495448+0000","last_unstale":"2024-05-09T09:55:57.402933+0000","last_undegraded":"2024-05-09T09:55:57.402933+0000","last_fullsized":"2024-05-09T09:55:57.402933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:09.689288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017854+0000","last_change":"2024-05-09T09:55:11.115278+0000","last_active":"2024-05-09T09:55:58.017854+0000","last_peered":"2024-05-09T09:55:58.017854+0000","last_clean":"2024-05-09T09:55:58.017854+0000","last_became_active":"2024-05-09T09:55:10.512273+0000","last_became_peered":"2024-05-09T09:55:10.512273+0000","last_unstale":"2024-05-09T09:55:58.017854+0000","last_undegraded":"2024-05-09T09:55:58.017854+0000","last_fullsized":"2024-05-09T09:55:58.017854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:23:44.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'15","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298835+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:55:57.298835+0000","last_peered":"2024-05-09T09:55:57.298835+0000","last_clean":"2024-05-09T09:55:57.298835+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:55:57.298835+0000","last_undegraded":"2024-05-09T09:55:57.298835+0000","last_fullsized":"2024-05-09T09:55:57.298835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705087+0000","last_change":"2024-05-09T09:55:41.475763+0000","last_active":"2024-05-09T09:55:56.705087+0000","last_peered":"2024-05-09T09:55:56.705087+0000","last_clean":"2024-05-09T09:55:56.705087+0000","last_became_active":"2024-05-09T09:55:41.474020+0000","last_became_peered":"2024-05-09T09:55:41.474020+0000","last_unstale":"2024-05-09T09:55:56.705087+0000","last_undegraded":"2024-05-09T09:55:56.705087+0000","last_fullsized":"2024-05-09T09:55:56.705087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:59.415817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"75'42","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703965+0000","last_change":"2024-05-09T09:55:11.077756+0000","last_active":"2024-05-09T09:55:56.703965+0000","last_peered":"2024-05-09T09:55:56.703965+0000","last_clean":"2024-05-09T09:55:56.703965+0000","last_became_active":"2024-05-09T09:55:10.516407+0000","last_became_peered":"2024-05-09T09:55:10.516407+0000","last_unstale":"2024-05-09T09:55:56.703965+0000","last_undegraded":"2024-05-09T09:55:56.703965+0000","last_fullsized":"2024-05-09T09:55:56.703965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:29.572431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'7","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015602+0000","last_change":"2024-05-09T09:55:11.190571+0000","last_active":"2024-05-09T09:55:58.015602+0000","last_peered":"2024-05-09T09:55:58.015602+0000","last_clean":"2024-05-09T09:55:58.015602+0000","last_became_active":"2024-05-09T09:55:10.516633+0000","last_became_peered":"2024-05-09T09:55:10.516633+0000","last_unstale":"2024-05-09T09:55:58.015602+0000","last_undegraded":"2024-05-09T09:55:58.015602+0000","last_fullsized":"2024-05-09T09:55:58.015602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:56.816319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706539+0000","last_change":"2024-05-09T09:55:41.480580+0000","last_active":"2024-05-09T09:55:56.706539+0000","last_peered":"2024-05-09T09:55:56.706539+0000","last_clean":"2024-05-09T09:55:56.706539+0000","last_became_active":"2024-05-09T09:55:41.479634+0000","last_became_peered":"2024-05-09T09:55:41.479634+0000","last_unstale":"2024-05-09T09:55:56.706539+0000","last_undegraded":"2024-05-09T09:55:56.706539+0000","last_fullsized":"2024-05-09T09:55:56.706539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:12.037871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401416+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:55:57.401416+0000","last_peered":"2024-05-09T09:55:57.401416+0000","last_clean":"2024-05-09T09:55:57.401416+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:55:57.401416+0000","last_undegraded":"2024-05-09T09:55:57.401416+0000","last_fullsized":"2024-05-09T09:55:57.401416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298448+0000","last_change":"2024-05-09T09:55:10.503163+0000","last_active":"2024-05-09T09:55:57.298448+0000","last_peered":"2024-05-09T09:55:57.298448+0000","last_clean":"2024-05-09T09:55:57.298448+0000","last_became_active":"2024-05-09T09:55:10.501658+0000","last_became_peered":"2024-05-09T09:55:10.501658+0000","last_unstale":"2024-05-09T09:55:57.298448+0000","last_undegraded":"2024-05-09T09:55:57.298448+0000","last_fullsized":"2024-05-09T09:55:57.298448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:16.963610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704206+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:55:56.704206+0000","last_peered":"2024-05-09T09:55:56.704206+0000","last_clean":"2024-05-09T09:55:56.704206+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:55:56.704206+0000","last_undegraded":"2024-05-09T09:55:56.704206+0000","last_fullsized":"2024-05-09T09:55:56.704206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299020+0000","last_change":"2024-05-09T09:55:41.514105+0000","last_active":"2024-05-09T09:55:57.299020+0000","last_peered":"2024-05-09T09:55:57.299020+0000","last_clean":"2024-05-09T09:55:57.299020+0000","last_became_active":"2024-05-09T09:55:41.513454+0000","last_became_peered":"2024-05-09T09:55:41.513454+0000","last_unstale":"2024-05-09T09:55:57.299020+0000","last_undegraded":"2024-05-09T09:55:57.299020+0000","last_fullsized":"2024-05-09T09:55:57.299020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:12.201246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014983+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:55:58.014983+0000","last_peered":"2024-05-09T09:55:58.014983+0000","last_clean":"2024-05-09T09:55:58.014983+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:55:58.014983+0000","last_undegraded":"2024-05-09T09:55:58.014983+0000","last_fullsized":"2024-05-09T09:55:58.014983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401371+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:55:57.401371+0000","last_peered":"2024-05-09T09:55:57.401371+0000","last_clean":"2024-05-09T09:55:57.401371+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:55:57.401371+0000","last_undegraded":"2024-05-09T09:55:57.401371+0000","last_fullsized":"2024-05-09T09:55:57.401371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'10","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013595+0000","last_change":"2024-05-09T09:55:10.921973+0000","last_active":"2024-05-09T09:55:58.013595+0000","last_peered":"2024-05-09T09:55:58.013595+0000","last_clean":"2024-05-09T09:55:58.013595+0000","last_became_active":"2024-05-09T09:55:10.505428+0000","last_became_peered":"2024-05-09T09:55:10.505428+0000","last_unstale":"2024-05-09T09:55:58.013595+0000","last_undegraded":"2024-05-09T09:55:58.013595+0000","last_fullsized":"2024-05-09T09:55:58.013595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:11.081894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017491+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:55:58.017491+0000","last_peered":"2024-05-09T09:55:58.017491+0000","last_clean":"2024-05-09T09:55:58.017491+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:55:58.017491+0000","last_undegraded":"2024-05-09T09:55:58.017491+0000","last_fullsized":"2024-05-09T09:55:58.017491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'36","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402785+0000","last_change":"2024-05-09T09:55:11.706091+0000","last_active":"2024-05-09T09:55:57.402785+0000","last_peered":"2024-05-09T09:55:57.402785+0000","last_clean":"2024-05-09T09:55:57.402785+0000","last_became_active":"2024-05-09T09:55:10.522989+0000","last_became_peered":"2024-05-09T09:55:10.522989+0000","last_unstale":"2024-05-09T09:55:57.402785+0000","last_undegraded":"2024-05-09T09:55:57.402785+0000","last_fullsized":"2024-05-09T09:55:57.402785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:21.617588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":11272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706558+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:55:56.706558+0000","last_peered":"2024-05-09T09:55:56.706558+0000","last_clean":"2024-05-09T09:55:56.706558+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:55:56.706558+0000","last_undegraded":"2024-05-09T09:55:56.706558+0000","last_fullsized":"2024-05-09T09:55:56.706558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297460+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:55:57.297460+0000","last_peered":"2024-05-09T09:55:57.297460+0000","last_clean":"2024-05-09T09:55:57.297460+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:55:57.297460+0000","last_undegraded":"2024-05-09T09:55:57.297460+0000","last_fullsized":"2024-05-09T09:55:57.297460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706199+0000","last_change":"2024-05-09T09:53:54.476843+0000","last_active":"2024-05-09T09:55:56.706199+0000","last_peered":"2024-05-09T09:55:56.706199+0000","last_clean":"2024-05-09T09:55:56.706199+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:55:56.706199+0000","last_undegraded":"2024-05-09T09:55:56.706199+0000","last_fullsized":"2024-05-09T09:55:56.706199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:48.486905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015011+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:55:58.015011+0000","last_peered":"2024-05-09T09:55:58.015011+0000","last_clean":"2024-05-09T09:55:58.015011+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:55:58.015011+0000","last_undegraded":"2024-05-09T09:55:58.015011+0000","last_fullsized":"2024-05-09T09:55:58.015011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701698+0000","last_change":"2024-05-09T09:55:42.599407+0000","last_active":"2024-05-09T09:55:56.701698+0000","last_peered":"2024-05-09T09:55:56.701698+0000","last_clean":"2024-05-09T09:55:56.701698+0000","last_became_active":"2024-05-09T09:55:41.489210+0000","last_became_peered":"2024-05-09T09:55:41.489210+0000","last_unstale":"2024-05-09T09:55:56.701698+0000","last_undegraded":"2024-05-09T09:55:56.701698+0000","last_fullsized":"2024-05-09T09:55:56.701698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:36:38.674440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":7,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402446+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:55:57.402446+0000","last_peered":"2024-05-09T09:55:57.402446+0000","last_clean":"2024-05-09T09:55:57.402446+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:55:57.402446+0000","last_undegraded":"2024-05-09T09:55:57.402446+0000","last_fullsized":"2024-05-09T09:55:57.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'60","reported_seq":266,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703266+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:55:56.703266+0000","last_peered":"2024-05-09T09:55:56.703266+0000","last_clean":"2024-05-09T09:55:56.703266+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:55:56.703266+0000","last_undegraded":"2024-05-09T09:55:56.703266+0000","last_fullsized":"2024-05-09T09:55:56.703266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26264,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":86,"num_read_kb":110,"num_write":58,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018988+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:55:58.018988+0000","last_peered":"2024-05-09T09:55:58.018988+0000","last_clean":"2024-05-09T09:55:58.018988+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:55:58.018988+0000","last_undegraded":"2024-05-09T09:55:58.018988+0000","last_fullsized":"2024-05-09T09:55:58.018988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704712+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:55:56.704712+0000","last_peered":"2024-05-09T09:55:56.704712+0000","last_clean":"2024-05-09T09:55:56.704712+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:55:56.704712+0000","last_undegraded":"2024-05-09T09:55:56.704712+0000","last_fullsized":"2024-05-09T09:55:56.704712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'46","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704619+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:55:56.704619+0000","last_peered":"2024-05-09T09:55:56.704619+0000","last_clean":"2024-05-09T09:55:56.704619+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:55:56.704619+0000","last_undegraded":"2024-05-09T09:55:56.704619+0000","last_fullsized":"2024-05-09T09:55:56.704619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512113+0000","last_change":"2024-05-09T09:55:10.500785+0000","last_active":"2024-05-09T09:55:57.512113+0000","last_peered":"2024-05-09T09:55:57.512113+0000","last_clean":"2024-05-09T09:55:57.512113+0000","last_became_active":"2024-05-09T09:55:10.500197+0000","last_became_peered":"2024-05-09T09:55:10.500197+0000","last_unstale":"2024-05-09T09:55:57.512113+0000","last_undegraded":"2024-05-09T09:55:57.512113+0000","last_fullsized":"2024-05-09T09:55:57.512113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:17.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700597+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:55:56.700597+0000","last_peered":"2024-05-09T09:55:56.700597+0000","last_clean":"2024-05-09T09:55:56.700597+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:55:56.700597+0000","last_undegraded":"2024-05-09T09:55:56.700597+0000","last_fullsized":"2024-05-09T09:55:56.700597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513015+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:55:57.513015+0000","last_peered":"2024-05-09T09:55:57.513015+0000","last_clean":"2024-05-09T09:55:57.513015+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:55:57.513015+0000","last_undegraded":"2024-05-09T09:55:57.513015+0000","last_fullsized":"2024-05-09T09:55:57.513015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018568+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:55:58.018568+0000","last_peered":"2024-05-09T09:55:58.018568+0000","last_clean":"2024-05-09T09:55:58.018568+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:55:58.018568+0000","last_undegraded":"2024-05-09T09:55:58.018568+0000","last_fullsized":"2024-05-09T09:55:58.018568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704334+0000","last_change":"2024-05-09T09:55:41.486659+0000","last_active":"2024-05-09T09:55:56.704334+0000","last_peered":"2024-05-09T09:55:56.704334+0000","last_clean":"2024-05-09T09:55:56.704334+0000","last_became_active":"2024-05-09T09:55:41.486383+0000","last_became_peered":"2024-05-09T09:55:41.486383+0000","last_unstale":"2024-05-09T09:55:56.704334+0000","last_undegraded":"2024-05-09T09:55:56.704334+0000","last_fullsized":"2024-05-09T09:55:56.704334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:13.922715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"75'2","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013230+0000","last_change":"2024-05-09T09:55:44.856823+0000","last_active":"2024-05-09T09:55:58.013230+0000","last_peered":"2024-05-09T09:55:58.013230+0000","last_clean":"2024-05-09T09:55:58.013230+0000","last_became_active":"2024-05-09T09:55:41.512553+0000","last_became_peered":"2024-05-09T09:55:41.512553+0000","last_unstale":"2024-05-09T09:55:58.013230+0000","last_undegraded":"2024-05-09T09:55:58.013230+0000","last_fullsized":"2024-05-09T09:55:58.013230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401767+0000","last_change":"2024-05-09T09:54:55.401865+0000","last_active":"2024-05-09T09:55:57.401767+0000","last_peered":"2024-05-09T09:55:57.401767+0000","last_clean":"2024-05-09T09:55:57.401767+0000","last_became_active":"2024-05-09T09:54:55.401038+0000","last_became_peered":"2024-05-09T09:54:55.401038+0000","last_unstale":"2024-05-09T09:55:57.401767+0000","last_undegraded":"2024-05-09T09:55:57.401767+0000","last_fullsized":"2024-05-09T09:55:57.401767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:01.972187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399656+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:55:57.399656+0000","last_peered":"2024-05-09T09:55:57.399656+0000","last_clean":"2024-05-09T09:55:57.399656+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:55:57.399656+0000","last_undegraded":"2024-05-09T09:55:57.399656+0000","last_fullsized":"2024-05-09T09:55:57.399656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705226+0000","last_change":"2024-05-09T09:55:41.719143+0000","last_active":"2024-05-09T09:55:56.705226+0000","last_peered":"2024-05-09T09:55:56.705226+0000","last_clean":"2024-05-09T09:55:56.705226+0000","last_became_active":"2024-05-09T09:55:41.469663+0000","last_became_peered":"2024-05-09T09:55:41.469663+0000","last_unstale":"2024-05-09T09:55:56.705226+0000","last_undegraded":"2024-05-09T09:55:56.705226+0000","last_fullsized":"2024-05-09T09:55:56.705226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:45.753913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705749+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:55:56.705749+0000","last_peered":"2024-05-09T09:55:56.705749+0000","last_clean":"2024-05-09T09:55:56.705749+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:55:56.705749+0000","last_undegraded":"2024-05-09T09:55:56.705749+0000","last_fullsized":"2024-05-09T09:55:56.705749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015389+0000","last_change":"2024-05-09T09:55:42.823551+0000","last_active":"2024-05-09T09:55:58.015389+0000","last_peered":"2024-05-09T09:55:58.015389+0000","last_clean":"2024-05-09T09:55:58.015389+0000","last_became_active":"2024-05-09T09:55:41.504368+0000","last_became_peered":"2024-05-09T09:55:41.504368+0000","last_unstale":"2024-05-09T09:55:58.015389+0000","last_undegraded":"2024-05-09T09:55:58.015389+0000","last_fullsized":"2024-05-09T09:55:58.015389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:38.841317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299096+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:55:57.299096+0000","last_peered":"2024-05-09T09:55:57.299096+0000","last_clean":"2024-05-09T09:55:57.299096+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:55:57.299096+0000","last_undegraded":"2024-05-09T09:55:57.299096+0000","last_fullsized":"2024-05-09T09:55:57.299096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400161+0000","last_change":"2024-05-09T09:55:10.495545+0000","last_active":"2024-05-09T09:55:57.400161+0000","last_peered":"2024-05-09T09:55:57.400161+0000","last_clean":"2024-05-09T09:55:57.400161+0000","last_became_active":"2024-05-09T09:55:10.494741+0000","last_became_peered":"2024-05-09T09:55:10.494741+0000","last_unstale":"2024-05-09T09:55:57.400161+0000","last_undegraded":"2024-05-09T09:55:57.400161+0000","last_fullsized":"2024-05-09T09:55:57.400161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:36.220917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703539+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:55:56.703539+0000","last_peered":"2024-05-09T09:55:56.703539+0000","last_clean":"2024-05-09T09:55:56.703539+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:55:56.703539+0000","last_undegraded":"2024-05-09T09:55:56.703539+0000","last_fullsized":"2024-05-09T09:55:56.703539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'13","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402554+0000","last_change":"2024-05-09T09:55:10.791937+0000","last_active":"2024-05-09T09:55:57.402554+0000","last_peered":"2024-05-09T09:55:57.402554+0000","last_clean":"2024-05-09T09:55:57.402554+0000","last_became_active":"2024-05-09T09:55:10.494626+0000","last_became_peered":"2024-05-09T09:55:10.494626+0000","last_unstale":"2024-05-09T09:55:57.402554+0000","last_undegraded":"2024-05-09T09:55:57.402554+0000","last_fullsized":"2024-05-09T09:55:57.402554+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:06:49.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702746+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:55:56.702746+0000","last_peered":"2024-05-09T09:55:56.702746+0000","last_clean":"2024-05-09T09:55:56.702746+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:55:56.702746+0000","last_undegraded":"2024-05-09T09:55:56.702746+0000","last_fullsized":"2024-05-09T09:55:56.702746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704736+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:55:56.704736+0000","last_peered":"2024-05-09T09:55:56.704736+0000","last_clean":"2024-05-09T09:55:56.704736+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:55:56.704736+0000","last_undegraded":"2024-05-09T09:55:56.704736+0000","last_fullsized":"2024-05-09T09:55:56.704736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'32","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700571+0000","last_change":"2024-05-09T09:55:10.807327+0000","last_active":"2024-05-09T09:55:56.700571+0000","last_peered":"2024-05-09T09:55:56.700571+0000","last_clean":"2024-05-09T09:55:56.700571+0000","last_became_active":"2024-05-09T09:55:10.495540+0000","last_became_peered":"2024-05-09T09:55:10.495540+0000","last_unstale":"2024-05-09T09:55:56.700571+0000","last_undegraded":"2024-05-09T09:55:56.700571+0000","last_fullsized":"2024-05-09T09:55:56.700571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:01.735473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":3221,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704004+0000","last_change":"2024-05-09T09:55:41.499842+0000","last_active":"2024-05-09T09:55:56.704004+0000","last_peered":"2024-05-09T09:55:56.704004+0000","last_clean":"2024-05-09T09:55:56.704004+0000","last_became_active":"2024-05-09T09:55:41.496466+0000","last_became_peered":"2024-05-09T09:55:41.496466+0000","last_unstale":"2024-05-09T09:55:56.704004+0000","last_undegraded":"2024-05-09T09:55:56.704004+0000","last_fullsized":"2024-05-09T09:55:56.704004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:35.612226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706873+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:55:56.706873+0000","last_peered":"2024-05-09T09:55:56.706873+0000","last_clean":"2024-05-09T09:55:56.706873+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:55:56.706873+0000","last_undegraded":"2024-05-09T09:55:56.706873+0000","last_fullsized":"2024-05-09T09:55:56.706873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705288+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:55:56.705288+0000","last_peered":"2024-05-09T09:55:56.705288+0000","last_clean":"2024-05-09T09:55:56.705288+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:55:56.705288+0000","last_undegraded":"2024-05-09T09:55:56.705288+0000","last_fullsized":"2024-05-09T09:55:56.705288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702837+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:55:56.702837+0000","last_peered":"2024-05-09T09:55:56.702837+0000","last_clean":"2024-05-09T09:55:56.702837+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:55:56.702837+0000","last_undegraded":"2024-05-09T09:55:56.702837+0000","last_fullsized":"2024-05-09T09:55:56.702837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":22546,"num_write":39,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015491+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:55:58.015491+0000","last_peered":"2024-05-09T09:55:58.015491+0000","last_clean":"2024-05-09T09:55:58.015491+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:55:58.015491+0000","last_undegraded":"2024-05-09T09:55:58.015491+0000","last_fullsized":"2024-05-09T09:55:58.015491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298282+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:55:57.298282+0000","last_peered":"2024-05-09T09:55:57.298282+0000","last_clean":"2024-05-09T09:55:57.298282+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:55:57.298282+0000","last_undegraded":"2024-05-09T09:55:57.298282+0000","last_fullsized":"2024-05-09T09:55:57.298282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702821+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:55:56.702821+0000","last_peered":"2024-05-09T09:55:56.702821+0000","last_clean":"2024-05-09T09:55:56.702821+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:55:56.702821+0000","last_undegraded":"2024-05-09T09:55:56.702821+0000","last_fullsized":"2024-05-09T09:55:56.702821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'15","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400649+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:55:57.400649+0000","last_peered":"2024-05-09T09:55:57.400649+0000","last_clean":"2024-05-09T09:55:57.400649+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:55:57.400649+0000","last_undegraded":"2024-05-09T09:55:57.400649+0000","last_fullsized":"2024-05-09T09:55:57.400649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018320+0000","last_change":"2024-05-09T09:55:10.517397+0000","last_active":"2024-05-09T09:55:58.018320+0000","last_peered":"2024-05-09T09:55:58.018320+0000","last_clean":"2024-05-09T09:55:58.018320+0000","last_became_active":"2024-05-09T09:55:10.515588+0000","last_became_peered":"2024-05-09T09:55:10.515588+0000","last_unstale":"2024-05-09T09:55:58.018320+0000","last_undegraded":"2024-05-09T09:55:58.018320+0000","last_fullsized":"2024-05-09T09:55:58.018320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:07.130003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"75'44","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015984+0000","last_change":"2024-05-09T09:55:11.515278+0000","last_active":"2024-05-09T09:55:58.015984+0000","last_peered":"2024-05-09T09:55:58.015984+0000","last_clean":"2024-05-09T09:55:58.015984+0000","last_became_active":"2024-05-09T09:55:10.518766+0000","last_became_peered":"2024-05-09T09:55:10.518766+0000","last_unstale":"2024-05-09T09:55:58.015984+0000","last_undegraded":"2024-05-09T09:55:58.015984+0000","last_fullsized":"2024-05-09T09:55:58.015984+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:19.443320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":112,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'13","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018454+0000","last_change":"2024-05-09T09:55:11.060481+0000","last_active":"2024-05-09T09:55:58.018454+0000","last_peered":"2024-05-09T09:55:58.018454+0000","last_clean":"2024-05-09T09:55:58.018454+0000","last_became_active":"2024-05-09T09:55:10.509265+0000","last_became_peered":"2024-05-09T09:55:10.509265+0000","last_unstale":"2024-05-09T09:55:58.018454+0000","last_undegraded":"2024-05-09T09:55:58.018454+0000","last_fullsized":"2024-05-09T09:55:58.018454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:58:29.838618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":16398,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704209+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:55:56.704209+0000","last_peered":"2024-05-09T09:55:56.704209+0000","last_clean":"2024-05-09T09:55:56.704209+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:55:56.704209+0000","last_undegraded":"2024-05-09T09:55:56.704209+0000","last_fullsized":"2024-05-09T09:55:56.704209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704461+0000","last_change":"2024-05-09T09:55:41.502710+0000","last_active":"2024-05-09T09:55:56.704461+0000","last_peered":"2024-05-09T09:55:56.704461+0000","last_clean":"2024-05-09T09:55:56.704461+0000","last_became_active":"2024-05-09T09:55:41.498766+0000","last_became_peered":"2024-05-09T09:55:41.498766+0000","last_unstale":"2024-05-09T09:55:56.704461+0000","last_undegraded":"2024-05-09T09:55:56.704461+0000","last_fullsized":"2024-05-09T09:55:56.704461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:11.800372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705353+0000","last_change":"2024-05-09T09:55:42.422831+0000","last_active":"2024-05-09T09:55:56.705353+0000","last_peered":"2024-05-09T09:55:56.705353+0000","last_clean":"2024-05-09T09:55:56.705353+0000","last_became_active":"2024-05-09T09:55:41.513003+0000","last_became_peered":"2024-05-09T09:55:41.513003+0000","last_unstale":"2024-05-09T09:55:56.705353+0000","last_undegraded":"2024-05-09T09:55:56.705353+0000","last_fullsized":"2024-05-09T09:55:56.705353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:07.499148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'18","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016568+0000","last_change":"2024-05-09T09:55:10.808760+0000","last_active":"2024-05-09T09:55:58.016568+0000","last_peered":"2024-05-09T09:55:58.016568+0000","last_clean":"2024-05-09T09:55:58.016568+0000","last_became_active":"2024-05-09T09:55:10.505477+0000","last_became_peered":"2024-05-09T09:55:10.505477+0000","last_unstale":"2024-05-09T09:55:58.016568+0000","last_undegraded":"2024-05-09T09:55:58.016568+0000","last_fullsized":"2024-05-09T09:55:58.016568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:21.462968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704510+0000","last_change":"2024-05-09T09:55:10.495913+0000","last_active":"2024-05-09T09:55:56.704510+0000","last_peered":"2024-05-09T09:55:56.704510+0000","last_clean":"2024-05-09T09:55:56.704510+0000","last_became_active":"2024-05-09T09:55:10.494445+0000","last_became_peered":"2024-05-09T09:55:10.494445+0000","last_unstale":"2024-05-09T09:55:56.704510+0000","last_undegraded":"2024-05-09T09:55:56.704510+0000","last_fullsized":"2024-05-09T09:55:56.704510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:58.669871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'10","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704782+0000","last_change":"2024-05-09T09:55:42.207577+0000","last_active":"2024-05-09T09:55:56.704782+0000","last_peered":"2024-05-09T09:55:56.704782+0000","last_clean":"2024-05-09T09:55:56.704782+0000","last_became_active":"2024-05-09T09:55:41.480316+0000","last_became_peered":"2024-05-09T09:55:41.480316+0000","last_unstale":"2024-05-09T09:55:56.704782+0000","last_undegraded":"2024-05-09T09:55:56.704782+0000","last_fullsized":"2024-05-09T09:55:56.704782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705886+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:55:56.705886+0000","last_peered":"2024-05-09T09:55:56.705886+0000","last_clean":"2024-05-09T09:55:56.705886+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:55:56.705886+0000","last_undegraded":"2024-05-09T09:55:56.705886+0000","last_fullsized":"2024-05-09T09:55:56.705886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299647+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:55:57.299647+0000","last_peered":"2024-05-09T09:55:57.299647+0000","last_clean":"2024-05-09T09:55:57.299647+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:55:57.299647+0000","last_undegraded":"2024-05-09T09:55:57.299647+0000","last_fullsized":"2024-05-09T09:55:57.299647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015902+0000","last_change":"2024-05-09T09:55:10.517926+0000","last_active":"2024-05-09T09:55:58.015902+0000","last_peered":"2024-05-09T09:55:58.015902+0000","last_clean":"2024-05-09T09:55:58.015902+0000","last_became_active":"2024-05-09T09:55:10.505544+0000","last_became_peered":"2024-05-09T09:55:10.505544+0000","last_unstale":"2024-05-09T09:55:58.015902+0000","last_undegraded":"2024-05-09T09:55:58.015902+0000","last_fullsized":"2024-05-09T09:55:58.015902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:13.161392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'38","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016660+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:55:58.016660+0000","last_peered":"2024-05-09T09:55:58.016660+0000","last_clean":"2024-05-09T09:55:58.016660+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:55:58.016660+0000","last_undegraded":"2024-05-09T09:55:58.016660+0000","last_fullsized":"2024-05-09T09:55:58.016660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":51,"num_write":36,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013580+0000","last_change":"2024-05-09T09:55:10.498516+0000","last_active":"2024-05-09T09:55:58.013580+0000","last_peered":"2024-05-09T09:55:58.013580+0000","last_clean":"2024-05-09T09:55:58.013580+0000","last_became_active":"2024-05-09T09:55:10.498080+0000","last_became_peered":"2024-05-09T09:55:10.498080+0000","last_unstale":"2024-05-09T09:55:58.013580+0000","last_undegraded":"2024-05-09T09:55:58.013580+0000","last_fullsized":"2024-05-09T09:55:58.013580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:21.659232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'2","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401538+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:55:57.401538+0000","last_peered":"2024-05-09T09:55:57.401538+0000","last_clean":"2024-05-09T09:55:57.401538+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:55:57.401538+0000","last_undegraded":"2024-05-09T09:55:57.401538+0000","last_fullsized":"2024-05-09T09:55:57.401538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706114+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:55:56.706114+0000","last_peered":"2024-05-09T09:55:56.706114+0000","last_clean":"2024-05-09T09:55:56.706114+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:55:56.706114+0000","last_undegraded":"2024-05-09T09:55:56.706114+0000","last_fullsized":"2024-05-09T09:55:56.706114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704880+0000","last_change":"2024-05-09T09:55:42.429944+0000","last_active":"2024-05-09T09:55:56.704880+0000","last_peered":"2024-05-09T09:55:56.704880+0000","last_clean":"2024-05-09T09:55:56.704880+0000","last_became_active":"2024-05-09T09:55:41.516290+0000","last_became_peered":"2024-05-09T09:55:41.516290+0000","last_unstale":"2024-05-09T09:55:56.704880+0000","last_undegraded":"2024-05-09T09:55:56.704880+0000","last_fullsized":"2024-05-09T09:55:56.704880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:59.070546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706067+0000","last_change":"2024-05-09T09:55:42.380229+0000","last_active":"2024-05-09T09:55:56.706067+0000","last_peered":"2024-05-09T09:55:56.706067+0000","last_clean":"2024-05-09T09:55:56.706067+0000","last_became_active":"2024-05-09T09:55:41.489973+0000","last_became_peered":"2024-05-09T09:55:41.489973+0000","last_unstale":"2024-05-09T09:55:56.706067+0000","last_undegraded":"2024-05-09T09:55:56.706067+0000","last_fullsized":"2024-05-09T09:55:56.706067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":30736,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703216+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:55:56.703216+0000","last_peered":"2024-05-09T09:55:56.703216+0000","last_clean":"2024-05-09T09:55:56.703216+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:55:56.703216+0000","last_undegraded":"2024-05-09T09:55:56.703216+0000","last_fullsized":"2024-05-09T09:55:56.703216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"73'19","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013249+0000","last_change":"2024-05-09T09:55:10.932387+0000","last_active":"2024-05-09T09:55:58.013249+0000","last_peered":"2024-05-09T09:55:58.013249+0000","last_clean":"2024-05-09T09:55:58.013249+0000","last_became_active":"2024-05-09T09:55:10.507307+0000","last_became_peered":"2024-05-09T09:55:10.507307+0000","last_unstale":"2024-05-09T09:55:58.013249+0000","last_undegraded":"2024-05-09T09:55:58.013249+0000","last_fullsized":"2024-05-09T09:55:58.013249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:44.904375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":29,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016206+0000","last_change":"2024-05-09T09:55:10.519133+0000","last_active":"2024-05-09T09:55:58.016206+0000","last_peered":"2024-05-09T09:55:58.016206+0000","last_clean":"2024-05-09T09:55:58.016206+0000","last_became_active":"2024-05-09T09:55:10.518305+0000","last_became_peered":"2024-05-09T09:55:10.518305+0000","last_unstale":"2024-05-09T09:55:58.016206+0000","last_undegraded":"2024-05-09T09:55:58.016206+0000","last_fullsized":"2024-05-09T09:55:58.016206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:56.110070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018014+0000","last_change":"2024-05-09T09:55:10.505287+0000","last_active":"2024-05-09T09:55:58.018014+0000","last_peered":"2024-05-09T09:55:58.018014+0000","last_clean":"2024-05-09T09:55:58.018014+0000","last_became_active":"2024-05-09T09:55:10.504822+0000","last_became_peered":"2024-05-09T09:55:10.504822+0000","last_unstale":"2024-05-09T09:55:58.018014+0000","last_undegraded":"2024-05-09T09:55:58.018014+0000","last_fullsized":"2024-05-09T09:55:58.018014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:26.980095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016322+0000","last_change":"2024-05-09T09:54:55.399423+0000","last_active":"2024-05-09T09:55:58.016322+0000","last_peered":"2024-05-09T09:55:58.016322+0000","last_clean":"2024-05-09T09:55:58.016322+0000","last_became_active":"2024-05-09T09:54:55.398970+0000","last_became_peered":"2024-05-09T09:54:55.398970+0000","last_unstale":"2024-05-09T09:55:58.016322+0000","last_undegraded":"2024-05-09T09:55:58.016322+0000","last_fullsized":"2024-05-09T09:55:58.016322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"75'10","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017670+0000","last_change":"2024-05-09T09:55:10.626412+0000","last_active":"2024-05-09T09:55:58.017670+0000","last_peered":"2024-05-09T09:55:58.017670+0000","last_clean":"2024-05-09T09:55:58.017670+0000","last_became_active":"2024-05-09T09:55:10.499847+0000","last_became_peered":"2024-05-09T09:55:10.499847+0000","last_unstale":"2024-05-09T09:55:58.017670+0000","last_undegraded":"2024-05-09T09:55:58.017670+0000","last_fullsized":"2024-05-09T09:55:58.017670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016797+0000","last_change":"2024-05-09T09:55:10.508325+0000","last_active":"2024-05-09T09:55:58.016797+0000","last_peered":"2024-05-09T09:55:58.016797+0000","last_clean":"2024-05-09T09:55:58.016797+0000","last_became_active":"2024-05-09T09:55:10.506831+0000","last_became_peered":"2024-05-09T09:55:10.506831+0000","last_unstale":"2024-05-09T09:55:58.016797+0000","last_undegraded":"2024-05-09T09:55:58.016797+0000","last_fullsized":"2024-05-09T09:55:58.016797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:03.449411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700895+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:55:56.700895+0000","last_peered":"2024-05-09T09:55:56.700895+0000","last_clean":"2024-05-09T09:55:56.700895+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:55:56.700895+0000","last_undegraded":"2024-05-09T09:55:56.700895+0000","last_fullsized":"2024-05-09T09:55:56.700895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017129+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:55:58.017129+0000","last_peered":"2024-05-09T09:55:58.017129+0000","last_clean":"2024-05-09T09:55:58.017129+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:55:58.017129+0000","last_undegraded":"2024-05-09T09:55:58.017129+0000","last_fullsized":"2024-05-09T09:55:58.017129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700775+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:55:56.700775+0000","last_peered":"2024-05-09T09:55:56.700775+0000","last_clean":"2024-05-09T09:55:56.700775+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:55:56.700775+0000","last_undegraded":"2024-05-09T09:55:56.700775+0000","last_fullsized":"2024-05-09T09:55:56.700775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013446+0000","last_change":"2024-05-09T09:55:10.514293+0000","last_active":"2024-05-09T09:55:58.013446+0000","last_peered":"2024-05-09T09:55:58.013446+0000","last_clean":"2024-05-09T09:55:58.013446+0000","last_became_active":"2024-05-09T09:55:10.513915+0000","last_became_peered":"2024-05-09T09:55:10.513915+0000","last_unstale":"2024-05-09T09:55:58.013446+0000","last_undegraded":"2024-05-09T09:55:58.013446+0000","last_fullsized":"2024-05-09T09:55:58.013446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:03.485055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"66'9","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402201+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:55:57.402201+0000","last_peered":"2024-05-09T09:55:57.402201+0000","last_clean":"2024-05-09T09:55:57.402201+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:55:57.402201+0000","last_undegraded":"2024-05-09T09:55:57.402201+0000","last_fullsized":"2024-05-09T09:55:57.402201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015455+0000","last_change":"2024-05-09T09:55:42.066725+0000","last_active":"2024-05-09T09:55:58.015455+0000","last_peered":"2024-05-09T09:55:58.015455+0000","last_clean":"2024-05-09T09:55:58.015455+0000","last_became_active":"2024-05-09T09:55:41.506927+0000","last_became_peered":"2024-05-09T09:55:41.506927+0000","last_unstale":"2024-05-09T09:55:58.015455+0000","last_undegraded":"2024-05-09T09:55:58.015455+0000","last_fullsized":"2024-05-09T09:55:58.015455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'21","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016885+0000","last_change":"2024-05-09T09:55:11.122289+0000","last_active":"2024-05-09T09:55:58.016885+0000","last_peered":"2024-05-09T09:55:58.016885+0000","last_clean":"2024-05-09T09:55:58.016885+0000","last_became_active":"2024-05-09T09:55:10.507511+0000","last_became_peered":"2024-05-09T09:55:10.507511+0000","last_unstale":"2024-05-09T09:55:58.016885+0000","last_undegraded":"2024-05-09T09:55:58.016885+0000","last_fullsized":"2024-05-09T09:55:58.016885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:29.227840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12481,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":39,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297997+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:55:57.297997+0000","last_peered":"2024-05-09T09:55:57.297997+0000","last_clean":"2024-05-09T09:55:57.297997+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:55:57.297997+0000","last_undegraded":"2024-05-09T09:55:57.297997+0000","last_fullsized":"2024-05-09T09:55:57.297997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401098+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:55:57.401098+0000","last_peered":"2024-05-09T09:55:57.401098+0000","last_clean":"2024-05-09T09:55:57.401098+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:55:57.401098+0000","last_undegraded":"2024-05-09T09:55:57.401098+0000","last_fullsized":"2024-05-09T09:55:57.401098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'38","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015759+0000","last_change":"2024-05-09T09:55:11.526822+0000","last_active":"2024-05-09T09:55:58.015759+0000","last_peered":"2024-05-09T09:55:58.015759+0000","last_clean":"2024-05-09T09:55:58.015759+0000","last_became_active":"2024-05-09T09:55:10.520941+0000","last_became_peered":"2024-05-09T09:55:10.520941+0000","last_unstale":"2024-05-09T09:55:58.015759+0000","last_undegraded":"2024-05-09T09:55:58.015759+0000","last_fullsized":"2024-05-09T09:55:58.015759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:25.981081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706483+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:55:56.706483+0000","last_peered":"2024-05-09T09:55:56.706483+0000","last_clean":"2024-05-09T09:55:56.706483+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:55:56.706483+0000","last_undegraded":"2024-05-09T09:55:56.706483+0000","last_fullsized":"2024-05-09T09:55:56.706483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298179+0000","last_change":"2024-05-09T09:55:41.515909+0000","last_active":"2024-05-09T09:55:57.298179+0000","last_peered":"2024-05-09T09:55:57.298179+0000","last_clean":"2024-05-09T09:55:57.298179+0000","last_became_active":"2024-05-09T09:55:41.514849+0000","last_became_peered":"2024-05-09T09:55:41.514849+0000","last_unstale":"2024-05-09T09:55:57.298179+0000","last_undegraded":"2024-05-09T09:55:57.298179+0000","last_fullsized":"2024-05-09T09:55:57.298179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:02.137573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"73'15","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016535+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:55:58.016535+0000","last_peered":"2024-05-09T09:55:58.016535+0000","last_clean":"2024-05-09T09:55:58.016535+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:55:58.016535+0000","last_undegraded":"2024-05-09T09:55:58.016535+0000","last_fullsized":"2024-05-09T09:55:58.016535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703964+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:55:56.703964+0000","last_peered":"2024-05-09T09:55:56.703964+0000","last_clean":"2024-05-09T09:55:56.703964+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:55:56.703964+0000","last_undegraded":"2024-05-09T09:55:56.703964+0000","last_fullsized":"2024-05-09T09:55:56.703964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299559+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:55:57.299559+0000","last_peered":"2024-05-09T09:55:57.299559+0000","last_clean":"2024-05-09T09:55:57.299559+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:55:57.299559+0000","last_undegraded":"2024-05-09T09:55:57.299559+0000","last_fullsized":"2024-05-09T09:55:57.299559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"67'11","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511830+0000","last_change":"2024-05-09T09:55:55.809479+0000","last_active":"2024-05-09T09:55:57.511830+0000","last_peered":"2024-05-09T09:55:57.511830+0000","last_clean":"2024-05-09T09:55:57.511830+0000","last_became_active":"2024-05-09T09:55:55.677234+0000","last_became_peered":"2024-05-09T09:55:55.677234+0000","last_unstale":"2024-05-09T09:55:57.511830+0000","last_undegraded":"2024-05-09T09:55:57.511830+0000","last_fullsized":"2024-05-09T09:55:57.511830+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:44.116858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706475+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:55:56.706475+0000","last_peered":"2024-05-09T09:55:56.706475+0000","last_clean":"2024-05-09T09:55:56.706475+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:55:56.706475+0000","last_undegraded":"2024-05-09T09:55:56.706475+0000","last_fullsized":"2024-05-09T09:55:56.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"73'26","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704104+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:55:56.704104+0000","last_peered":"2024-05-09T09:55:56.704104+0000","last_clean":"2024-05-09T09:55:56.704104+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:55:56.704104+0000","last_undegraded":"2024-05-09T09:55:56.704104+0000","last_fullsized":"2024-05-09T09:55:56.704104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401447+0000","last_change":"2024-05-09T09:55:10.495749+0000","last_active":"2024-05-09T09:55:57.401447+0000","last_peered":"2024-05-09T09:55:57.401447+0000","last_clean":"2024-05-09T09:55:57.401447+0000","last_became_active":"2024-05-09T09:55:10.494186+0000","last_became_peered":"2024-05-09T09:55:10.494186+0000","last_unstale":"2024-05-09T09:55:57.401447+0000","last_undegraded":"2024-05-09T09:55:57.401447+0000","last_fullsized":"2024-05-09T09:55:57.401447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:53:44.097211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016703+0000","last_change":"2024-05-09T09:55:10.505728+0000","last_active":"2024-05-09T09:55:58.016703+0000","last_peered":"2024-05-09T09:55:58.016703+0000","last_clean":"2024-05-09T09:55:58.016703+0000","last_became_active":"2024-05-09T09:55:10.504907+0000","last_became_peered":"2024-05-09T09:55:10.504907+0000","last_unstale":"2024-05-09T09:55:58.016703+0000","last_undegraded":"2024-05-09T09:55:58.016703+0000","last_fullsized":"2024-05-09T09:55:58.016703+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:34.895344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706201+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:55:56.706201+0000","last_peered":"2024-05-09T09:55:56.706201+0000","last_clean":"2024-05-09T09:55:56.706201+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:55:56.706201+0000","last_undegraded":"2024-05-09T09:55:56.706201+0000","last_fullsized":"2024-05-09T09:55:56.706201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"67'3","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701843+0000","last_change":"2024-05-09T09:55:10.559316+0000","last_active":"2024-05-09T09:55:56.701843+0000","last_peered":"2024-05-09T09:55:56.701843+0000","last_clean":"2024-05-09T09:55:56.701843+0000","last_became_active":"2024-05-09T09:55:10.497596+0000","last_became_peered":"2024-05-09T09:55:10.497596+0000","last_unstale":"2024-05-09T09:55:56.701843+0000","last_undegraded":"2024-05-09T09:55:56.701843+0000","last_fullsized":"2024-05-09T09:55:56.701843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299240+0000","last_change":"2024-05-09T09:55:41.513826+0000","last_active":"2024-05-09T09:55:57.299240+0000","last_peered":"2024-05-09T09:55:57.299240+0000","last_clean":"2024-05-09T09:55:57.299240+0000","last_became_active":"2024-05-09T09:55:41.513248+0000","last_became_peered":"2024-05-09T09:55:41.513248+0000","last_unstale":"2024-05-09T09:55:57.299240+0000","last_undegraded":"2024-05-09T09:55:57.299240+0000","last_fullsized":"2024-05-09T09:55:57.299240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:15.704381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"73'27","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017080+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:55:58.017080+0000","last_peered":"2024-05-09T09:55:58.017080+0000","last_clean":"2024-05-09T09:55:58.017080+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:55:58.017080+0000","last_undegraded":"2024-05-09T09:55:58.017080+0000","last_fullsized":"2024-05-09T09:55:58.017080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8545,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":54,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703868+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:55:56.703868+0000","last_peered":"2024-05-09T09:55:56.703868+0000","last_clean":"2024-05-09T09:55:56.703868+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:55:56.703868+0000","last_undegraded":"2024-05-09T09:55:56.703868+0000","last_fullsized":"2024-05-09T09:55:56.703868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"63'4","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297673+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:55:57.297673+0000","last_peered":"2024-05-09T09:55:57.297673+0000","last_clean":"2024-05-09T09:55:57.297673+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:55:57.297673+0000","last_undegraded":"2024-05-09T09:55:57.297673+0000","last_fullsized":"2024-05-09T09:55:57.297673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017690+0000","last_change":"2024-05-09T09:55:10.500134+0000","last_active":"2024-05-09T09:55:58.017690+0000","last_peered":"2024-05-09T09:55:58.017690+0000","last_clean":"2024-05-09T09:55:58.017690+0000","last_became_active":"2024-05-09T09:55:10.499690+0000","last_became_peered":"2024-05-09T09:55:10.499690+0000","last_unstale":"2024-05-09T09:55:58.017690+0000","last_undegraded":"2024-05-09T09:55:58.017690+0000","last_fullsized":"2024-05-09T09:55:58.017690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"66'13","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704696+0000","last_change":"2024-05-09T09:55:42.033924+0000","last_active":"2024-05-09T09:55:56.704696+0000","last_peered":"2024-05-09T09:55:56.704696+0000","last_clean":"2024-05-09T09:55:56.704696+0000","last_became_active":"2024-05-09T09:55:41.481073+0000","last_became_peered":"2024-05-09T09:55:41.481073+0000","last_unstale":"2024-05-09T09:55:56.704696+0000","last_undegraded":"2024-05-09T09:55:56.704696+0000","last_fullsized":"2024-05-09T09:55:56.704696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:48.598565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":45062,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706054+0000","last_change":"2024-05-09T09:55:41.513074+0000","last_active":"2024-05-09T09:55:56.706054+0000","last_peered":"2024-05-09T09:55:56.706054+0000","last_clean":"2024-05-09T09:55:56.706054+0000","last_became_active":"2024-05-09T09:55:41.512431+0000","last_became_peered":"2024-05-09T09:55:41.512431+0000","last_unstale":"2024-05-09T09:55:56.706054+0000","last_undegraded":"2024-05-09T09:55:56.706054+0000","last_fullsized":"2024-05-09T09:55:56.706054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:14.565690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"73'20","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018290+0000","last_change":"2024-05-09T09:55:11.526104+0000","last_active":"2024-05-09T09:55:58.018290+0000","last_peered":"2024-05-09T09:55:58.018290+0000","last_clean":"2024-05-09T09:55:58.018290+0000","last_became_active":"2024-05-09T09:55:10.517760+0000","last_became_peered":"2024-05-09T09:55:10.517760+0000","last_unstale":"2024-05-09T09:55:58.018290+0000","last_undegraded":"2024-05-09T09:55:58.018290+0000","last_fullsized":"2024-05-09T09:55:58.018290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:24.084847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":34,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703148+0000","last_change":"2024-05-09T09:55:10.485758+0000","last_active":"2024-05-09T09:55:56.703148+0000","last_peered":"2024-05-09T09:55:56.703148+0000","last_clean":"2024-05-09T09:55:56.703148+0000","last_became_active":"2024-05-09T09:55:10.485167+0000","last_became_peered":"2024-05-09T09:55:10.485167+0000","last_unstale":"2024-05-09T09:55:56.703148+0000","last_undegraded":"2024-05-09T09:55:56.703148+0000","last_fullsized":"2024-05-09T09:55:56.703148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:16.070700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400396+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:55:57.400396+0000","last_peered":"2024-05-09T09:55:57.400396+0000","last_clean":"2024-05-09T09:55:57.400396+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:55:57.400396+0000","last_undegraded":"2024-05-09T09:55:57.400396+0000","last_fullsized":"2024-05-09T09:55:57.400396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511241+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:55:57.511241+0000","last_peered":"2024-05-09T09:55:57.511241+0000","last_clean":"2024-05-09T09:55:57.511241+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:55:57.511241+0000","last_undegraded":"2024-05-09T09:55:57.511241+0000","last_fullsized":"2024-05-09T09:55:57.511241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'10","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704163+0000","last_change":"2024-05-09T09:55:41.638527+0000","last_active":"2024-05-09T09:55:56.704163+0000","last_peered":"2024-05-09T09:55:56.704163+0000","last_clean":"2024-05-09T09:55:56.704163+0000","last_became_active":"2024-05-09T09:55:41.470350+0000","last_became_peered":"2024-05-09T09:55:41.470350+0000","last_unstale":"2024-05-09T09:55:56.704163+0000","last_undegraded":"2024-05-09T09:55:56.704163+0000","last_fullsized":"2024-05-09T09:55:56.704163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:55:41.504749+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:55:41.504290+0000","last_became_peered":"2024-05-09T09:55:41.504290+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706444+0000","last_change":"2024-05-09T09:55:42.568315+0000","last_active":"2024-05-09T09:55:56.706444+0000","last_peered":"2024-05-09T09:55:56.706444+0000","last_clean":"2024-05-09T09:55:56.706444+0000","last_became_active":"2024-05-09T09:55:41.517072+0000","last_became_peered":"2024-05-09T09:55:41.517072+0000","last_unstale":"2024-05-09T09:55:56.706444+0000","last_undegraded":"2024-05-09T09:55:56.706444+0000","last_fullsized":"2024-05-09T09:55:56.706444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:54.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'20","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299420+0000","last_change":"2024-05-09T09:55:44.549663+0000","last_active":"2024-05-09T09:55:57.299420+0000","last_peered":"2024-05-09T09:55:57.299420+0000","last_clean":"2024-05-09T09:55:57.299420+0000","last_became_active":"2024-05-09T09:55:41.514399+0000","last_became_peered":"2024-05-09T09:55:41.514399+0000","last_unstale":"2024-05-09T09:55:57.299420+0000","last_undegraded":"2024-05-09T09:55:57.299420+0000","last_fullsized":"2024-05-09T09:55:57.299420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:46.578164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"63'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015795+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:55:58.015795+0000","last_peered":"2024-05-09T09:55:58.015795+0000","last_clean":"2024-05-09T09:55:58.015795+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:55:58.015795+0000","last_undegraded":"2024-05-09T09:55:58.015795+0000","last_fullsized":"2024-05-09T09:55:58.015795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704832+0000","last_change":"2024-05-09T09:55:41.514279+0000","last_active":"2024-05-09T09:55:56.704832+0000","last_peered":"2024-05-09T09:55:56.704832+0000","last_clean":"2024-05-09T09:55:56.704832+0000","last_became_active":"2024-05-09T09:55:41.513724+0000","last_became_peered":"2024-05-09T09:55:41.513724+0000","last_unstale":"2024-05-09T09:55:56.704832+0000","last_undegraded":"2024-05-09T09:55:56.704832+0000","last_fullsized":"2024-05-09T09:55:56.704832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:53.879426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511499+0000","last_change":"2024-05-09T09:55:42.243360+0000","last_active":"2024-05-09T09:55:57.511499+0000","last_peered":"2024-05-09T09:55:57.511499+0000","last_clean":"2024-05-09T09:55:57.511499+0000","last_became_active":"2024-05-09T09:55:41.495012+0000","last_became_peered":"2024-05-09T09:55:41.495012+0000","last_unstale":"2024-05-09T09:55:57.511499+0000","last_undegraded":"2024-05-09T09:55:57.511499+0000","last_fullsized":"2024-05-09T09:55:57.511499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:55:30.669989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014988+0000","last_change":"2024-05-09T09:55:41.508232+0000","last_active":"2024-05-09T09:55:58.014988+0000","last_peered":"2024-05-09T09:55:58.014988+0000","last_clean":"2024-05-09T09:55:58.014988+0000","last_became_active":"2024-05-09T09:55:41.506905+0000","last_became_peered":"2024-05-09T09:55:41.506905+0000","last_unstale":"2024-05-09T09:55:58.014988+0000","last_undegraded":"2024-05-09T09:55:58.014988+0000","last_fullsized":"2024-05-09T09:55:58.014988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"73'24","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400581+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:55:57.400581+0000","last_peered":"2024-05-09T09:55:57.400581+0000","last_clean":"2024-05-09T09:55:57.400581+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:55:57.400581+0000","last_undegraded":"2024-05-09T09:55:57.400581+0000","last_fullsized":"2024-05-09T09:55:57.400581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701605+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:55:56.701605+0000","last_peered":"2024-05-09T09:55:56.701605+0000","last_clean":"2024-05-09T09:55:56.701605+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:55:56.701605+0000","last_undegraded":"2024-05-09T09:55:56.701605+0000","last_fullsized":"2024-05-09T09:55:56.701605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015572+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:55:58.015572+0000","last_peered":"2024-05-09T09:55:58.015572+0000","last_clean":"2024-05-09T09:55:58.015572+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:55:58.015572+0000","last_undegraded":"2024-05-09T09:55:58.015572+0000","last_fullsized":"2024-05-09T09:55:58.015572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705208+0000","last_change":"2024-05-09T09:55:41.513633+0000","last_active":"2024-05-09T09:55:56.705208+0000","last_peered":"2024-05-09T09:55:56.705208+0000","last_clean":"2024-05-09T09:55:56.705208+0000","last_became_active":"2024-05-09T09:55:41.512176+0000","last_became_peered":"2024-05-09T09:55:41.512176+0000","last_unstale":"2024-05-09T09:55:56.705208+0000","last_undegraded":"2024-05-09T09:55:56.705208+0000","last_fullsized":"2024-05-09T09:55:56.705208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"68'9","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402348+0000","last_change":"2024-05-09T09:55:42.801375+0000","last_active":"2024-05-09T09:55:57.402348+0000","last_peered":"2024-05-09T09:55:57.402348+0000","last_clean":"2024-05-09T09:55:57.402348+0000","last_became_active":"2024-05-09T09:55:41.495260+0000","last_became_peered":"2024-05-09T09:55:41.495260+0000","last_unstale":"2024-05-09T09:55:57.402348+0000","last_undegraded":"2024-05-09T09:55:57.402348+0000","last_fullsized":"2024-05-09T09:55:57.402348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:20.725921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401363+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:55:57.401363+0000","last_peered":"2024-05-09T09:55:57.401363+0000","last_clean":"2024-05-09T09:55:57.401363+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:55:57.401363+0000","last_undegraded":"2024-05-09T09:55:57.401363+0000","last_fullsized":"2024-05-09T09:55:57.401363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"73'13","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701493+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:55:56.701493+0000","last_peered":"2024-05-09T09:55:56.701493+0000","last_clean":"2024-05-09T09:55:56.701493+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:55:56.701493+0000","last_undegraded":"2024-05-09T09:55:56.701493+0000","last_fullsized":"2024-05-09T09:55:56.701493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297877+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:55:57.297877+0000","last_peered":"2024-05-09T09:55:57.297877+0000","last_clean":"2024-05-09T09:55:57.297877+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:55:57.297877+0000","last_undegraded":"2024-05-09T09:55:57.297877+0000","last_fullsized":"2024-05-09T09:55:57.297877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017891+0000","last_change":"2024-05-09T09:55:10.502456+0000","last_active":"2024-05-09T09:55:58.017891+0000","last_peered":"2024-05-09T09:55:58.017891+0000","last_clean":"2024-05-09T09:55:58.017891+0000","last_became_active":"2024-05-09T09:55:10.502015+0000","last_became_peered":"2024-05-09T09:55:10.502015+0000","last_unstale":"2024-05-09T09:55:58.017891+0000","last_undegraded":"2024-05-09T09:55:58.017891+0000","last_fullsized":"2024-05-09T09:55:58.017891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:01.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"75'46","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016669+0000","last_change":"2024-05-09T09:55:10.787056+0000","last_active":"2024-05-09T09:55:58.016669+0000","last_peered":"2024-05-09T09:55:58.016669+0000","last_clean":"2024-05-09T09:55:58.016669+0000","last_became_active":"2024-05-09T09:55:10.503704+0000","last_became_peered":"2024-05-09T09:55:10.503704+0000","last_unstale":"2024-05-09T09:55:58.016669+0000","last_undegraded":"2024-05-09T09:55:58.016669+0000","last_fullsized":"2024-05-09T09:55:58.016669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:07.882920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'4","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017899+0000","last_change":"2024-05-09T09:55:11.105873+0000","last_active":"2024-05-09T09:55:58.017899+0000","last_peered":"2024-05-09T09:55:58.017899+0000","last_clean":"2024-05-09T09:55:58.017899+0000","last_became_active":"2024-05-09T09:55:10.511777+0000","last_became_peered":"2024-05-09T09:55:10.511777+0000","last_unstale":"2024-05-09T09:55:58.017899+0000","last_undegraded":"2024-05-09T09:55:58.017899+0000","last_fullsized":"2024-05-09T09:55:58.017899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:49.719909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704012+0000","last_change":"2024-05-09T09:55:41.504930+0000","last_active":"2024-05-09T09:55:56.704012+0000","last_peered":"2024-05-09T09:55:56.704012+0000","last_clean":"2024-05-09T09:55:56.704012+0000","last_became_active":"2024-05-09T09:55:41.503996+0000","last_became_peered":"2024-05-09T09:55:41.503996+0000","last_unstale":"2024-05-09T09:55:56.704012+0000","last_undegraded":"2024-05-09T09:55:56.704012+0000","last_fullsized":"2024-05-09T09:55:56.704012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:17.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"73'12","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013352+0000","last_change":"2024-05-09T09:55:11.754129+0000","last_active":"2024-05-09T09:55:58.013352+0000","last_peered":"2024-05-09T09:55:58.013352+0000","last_clean":"2024-05-09T09:55:58.013352+0000","last_became_active":"2024-05-09T09:55:10.525384+0000","last_became_peered":"2024-05-09T09:55:10.525384+0000","last_unstale":"2024-05-09T09:55:58.013352+0000","last_undegraded":"2024-05-09T09:55:58.013352+0000","last_fullsized":"2024-05-09T09:55:58.013352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:56.439887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":18,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704813+0000","last_change":"2024-05-09T09:55:41.503227+0000","last_active":"2024-05-09T09:55:56.704813+0000","last_peered":"2024-05-09T09:55:56.704813+0000","last_clean":"2024-05-09T09:55:56.704813+0000","last_became_active":"2024-05-09T09:55:41.502389+0000","last_became_peered":"2024-05-09T09:55:41.502389+0000","last_unstale":"2024-05-09T09:55:56.704813+0000","last_undegraded":"2024-05-09T09:55:56.704813+0000","last_fullsized":"2024-05-09T09:55:56.704813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:58.478317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015740+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:55:58.015740+0000","last_peered":"2024-05-09T09:55:58.015740+0000","last_clean":"2024-05-09T09:55:58.015740+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:55:58.015740+0000","last_undegraded":"2024-05-09T09:55:58.015740+0000","last_fullsized":"2024-05-09T09:55:58.015740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703739+0000","last_change":"2024-05-09T09:55:41.504669+0000","last_active":"2024-05-09T09:55:56.703739+0000","last_peered":"2024-05-09T09:55:56.703739+0000","last_clean":"2024-05-09T09:55:56.703739+0000","last_became_active":"2024-05-09T09:55:41.503132+0000","last_became_peered":"2024-05-09T09:55:41.503132+0000","last_unstale":"2024-05-09T09:55:56.703739+0000","last_undegraded":"2024-05-09T09:55:56.703739+0000","last_fullsized":"2024-05-09T09:55:56.703739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:40.768463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706462+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:55:56.706462+0000","last_peered":"2024-05-09T09:55:56.706462+0000","last_clean":"2024-05-09T09:55:56.706462+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:55:56.706462+0000","last_undegraded":"2024-05-09T09:55:56.706462+0000","last_fullsized":"2024-05-09T09:55:56.706462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":36882,"num_write":42,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702636+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:55:56.702636+0000","last_peered":"2024-05-09T09:55:56.702636+0000","last_clean":"2024-05-09T09:55:56.702636+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:55:56.702636+0000","last_undegraded":"2024-05-09T09:55:56.702636+0000","last_fullsized":"2024-05-09T09:55:56.702636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"73'15","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704375+0000","last_change":"2024-05-09T09:55:41.528075+0000","last_active":"2024-05-09T09:55:56.704375+0000","last_peered":"2024-05-09T09:55:56.704375+0000","last_clean":"2024-05-09T09:55:56.704375+0000","last_became_active":"2024-05-09T09:55:41.453982+0000","last_became_peered":"2024-05-09T09:55:41.453982+0000","last_unstale":"2024-05-09T09:55:56.704375+0000","last_undegraded":"2024-05-09T09:55:56.704375+0000","last_fullsized":"2024-05-09T09:55:56.704375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:30.849980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703788+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:55:56.703788+0000","last_peered":"2024-05-09T09:55:56.703788+0000","last_clean":"2024-05-09T09:55:56.703788+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:55:56.703788+0000","last_undegraded":"2024-05-09T09:55:56.703788+0000","last_fullsized":"2024-05-09T09:55:56.703788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705754+0000","last_change":"2024-05-09T09:55:41.488023+0000","last_active":"2024-05-09T09:55:56.705754+0000","last_peered":"2024-05-09T09:55:56.705754+0000","last_clean":"2024-05-09T09:55:56.705754+0000","last_became_active":"2024-05-09T09:55:41.478429+0000","last_became_peered":"2024-05-09T09:55:41.478429+0000","last_unstale":"2024-05-09T09:55:56.705754+0000","last_undegraded":"2024-05-09T09:55:56.705754+0000","last_fullsized":"2024-05-09T09:55:56.705754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:21.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703865+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:55:56.703865+0000","last_peered":"2024-05-09T09:55:56.703865+0000","last_clean":"2024-05-09T09:55:56.703865+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:55:56.703865+0000","last_undegraded":"2024-05-09T09:55:56.703865+0000","last_fullsized":"2024-05-09T09:55:56.703865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":76,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298338+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:55:57.298338+0000","last_peered":"2024-05-09T09:55:57.298338+0000","last_clean":"2024-05-09T09:55:57.298338+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:55:57.298338+0000","last_undegraded":"2024-05-09T09:55:57.298338+0000","last_fullsized":"2024-05-09T09:55:57.298338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'16","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511896+0000","last_change":"2024-05-09T09:53:54.474568+0000","last_active":"2024-05-09T09:55:57.511896+0000","last_peered":"2024-05-09T09:55:57.511896+0000","last_clean":"2024-05-09T09:55:57.511896+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:55:57.511896+0000","last_undegraded":"2024-05-09T09:55:57.511896+0000","last_fullsized":"2024-05-09T09:55:57.511896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:31.979515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":38936,"num_write":56,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401833+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:55:57.401833+0000","last_peered":"2024-05-09T09:55:57.401833+0000","last_clean":"2024-05-09T09:55:57.401833+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:55:57.401833+0000","last_undegraded":"2024-05-09T09:55:57.401833+0000","last_fullsized":"2024-05-09T09:55:57.401833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401072+0000","last_change":"2024-05-09T09:55:11.421625+0000","last_active":"2024-05-09T09:55:57.401072+0000","last_peered":"2024-05-09T09:55:57.401072+0000","last_clean":"2024-05-09T09:55:57.401072+0000","last_became_active":"2024-05-09T09:55:10.518812+0000","last_became_peered":"2024-05-09T09:55:10.518812+0000","last_unstale":"2024-05-09T09:55:57.401072+0000","last_undegraded":"2024-05-09T09:55:57.401072+0000","last_fullsized":"2024-05-09T09:55:57.401072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:01.935968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":30726,"num_write":20,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703042+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:55:56.703042+0000","last_peered":"2024-05-09T09:55:56.703042+0000","last_clean":"2024-05-09T09:55:56.703042+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:55:56.703042+0000","last_undegraded":"2024-05-09T09:55:56.703042+0000","last_fullsized":"2024-05-09T09:55:56.703042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704515+0000","last_change":"2024-05-09T09:55:11.272479+0000","last_active":"2024-05-09T09:55:56.704515+0000","last_peered":"2024-05-09T09:55:56.704515+0000","last_clean":"2024-05-09T09:55:56.704515+0000","last_became_active":"2024-05-09T09:55:10.507500+0000","last_became_peered":"2024-05-09T09:55:10.507500+0000","last_unstale":"2024-05-09T09:55:56.704515+0000","last_undegraded":"2024-05-09T09:55:56.704515+0000","last_fullsized":"2024-05-09T09:55:56.704515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:01.473207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013452+0000","last_change":"2024-05-09T09:55:10.524923+0000","last_active":"2024-05-09T09:55:58.013452+0000","last_peered":"2024-05-09T09:55:58.013452+0000","last_clean":"2024-05-09T09:55:58.013452+0000","last_became_active":"2024-05-09T09:55:10.523552+0000","last_became_peered":"2024-05-09T09:55:10.523552+0000","last_unstale":"2024-05-09T09:55:58.013452+0000","last_undegraded":"2024-05-09T09:55:58.013452+0000","last_fullsized":"2024-05-09T09:55:58.013452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:43.486340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'15","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013377+0000","last_change":"2024-05-09T09:55:42.061427+0000","last_active":"2024-05-09T09:55:58.013377+0000","last_peered":"2024-05-09T09:55:58.013377+0000","last_clean":"2024-05-09T09:55:58.013377+0000","last_became_active":"2024-05-09T09:55:41.504165+0000","last_became_peered":"2024-05-09T09:55:41.504165+0000","last_unstale":"2024-05-09T09:55:58.013377+0000","last_undegraded":"2024-05-09T09:55:58.013377+0000","last_fullsized":"2024-05-09T09:55:58.013377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:23.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":13,"num_read_kb":12298,"num_write":35,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":113246208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704514+0000","last_change":"2024-05-09T09:55:41.501384+0000","last_active":"2024-05-09T09:55:56.704514+0000","last_peered":"2024-05-09T09:55:56.704514+0000","last_clean":"2024-05-09T09:55:56.704514+0000","last_became_active":"2024-05-09T09:55:41.500371+0000","last_became_peered":"2024-05-09T09:55:41.500371+0000","last_unstale":"2024-05-09T09:55:56.704514+0000","last_undegraded":"2024-05-09T09:55:56.704514+0000","last_fullsized":"2024-05-09T09:55:56.704514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:40.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'20","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703337+0000","last_change":"2024-05-09T09:55:10.940790+0000","last_active":"2024-05-09T09:55:56.703337+0000","last_peered":"2024-05-09T09:55:56.703337+0000","last_clean":"2024-05-09T09:55:56.703337+0000","last_became_active":"2024-05-09T09:55:10.497720+0000","last_became_peered":"2024-05-09T09:55:10.497720+0000","last_unstale":"2024-05-09T09:55:56.703337+0000","last_undegraded":"2024-05-09T09:55:56.703337+0000","last_fullsized":"2024-05-09T09:55:56.703337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":40,"num_read_kb":51230,"num_write":70,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013352+0000","last_change":"2024-05-09T09:55:10.522327+0000","last_active":"2024-05-09T09:55:58.013352+0000","last_peered":"2024-05-09T09:55:58.013352+0000","last_clean":"2024-05-09T09:55:58.013352+0000","last_became_active":"2024-05-09T09:55:10.520654+0000","last_became_peered":"2024-05-09T09:55:10.520654+0000","last_unstale":"2024-05-09T09:55:58.013352+0000","last_undegraded":"2024-05-09T09:55:58.013352+0000","last_fullsized":"2024-05-09T09:55:58.013352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299280+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:55:57.299280+0000","last_peered":"2024-05-09T09:55:57.299280+0000","last_clean":"2024-05-09T09:55:57.299280+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:55:57.299280+0000","last_undegraded":"2024-05-09T09:55:57.299280+0000","last_fullsized":"2024-05-09T09:55:57.299280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297786+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:55:57.297786+0000","last_peered":"2024-05-09T09:55:57.297786+0000","last_clean":"2024-05-09T09:55:57.297786+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:55:57.297786+0000","last_undegraded":"2024-05-09T09:55:57.297786+0000","last_fullsized":"2024-05-09T09:55:57.297786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"67'7","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013217+0000","last_change":"2024-05-09T09:55:43.542093+0000","last_active":"2024-05-09T09:55:58.013217+0000","last_peered":"2024-05-09T09:55:58.013217+0000","last_clean":"2024-05-09T09:55:58.013217+0000","last_became_active":"2024-05-09T09:55:41.504555+0000","last_became_peered":"2024-05-09T09:55:41.504555+0000","last_unstale":"2024-05-09T09:55:58.013217+0000","last_undegraded":"2024-05-09T09:55:58.013217+0000","last_fullsized":"2024-05-09T09:55:58.013217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:48:05.626495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"75'34","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706338+0000","last_change":"2024-05-09T09:55:11.694902+0000","last_active":"2024-05-09T09:55:56.706338+0000","last_peered":"2024-05-09T09:55:56.706338+0000","last_clean":"2024-05-09T09:55:56.706338+0000","last_became_active":"2024-05-09T09:55:10.515872+0000","last_became_peered":"2024-05-09T09:55:10.515872+0000","last_unstale":"2024-05-09T09:55:56.706338+0000","last_undegraded":"2024-05-09T09:55:56.706338+0000","last_fullsized":"2024-05-09T09:55:56.706338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"67'8","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401104+0000","last_change":"2024-05-09T09:55:11.200964+0000","last_active":"2024-05-09T09:55:57.401104+0000","last_peered":"2024-05-09T09:55:57.401104+0000","last_clean":"2024-05-09T09:55:57.401104+0000","last_became_active":"2024-05-09T09:55:10.506370+0000","last_became_peered":"2024-05-09T09:55:10.506370+0000","last_unstale":"2024-05-09T09:55:57.401104+0000","last_undegraded":"2024-05-09T09:55:57.401104+0000","last_fullsized":"2024-05-09T09:55:57.401104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:45.803361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":16388,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706695+0000","last_change":"2024-05-09T09:55:41.494250+0000","last_active":"2024-05-09T09:55:56.706695+0000","last_peered":"2024-05-09T09:55:56.706695+0000","last_clean":"2024-05-09T09:55:56.706695+0000","last_became_active":"2024-05-09T09:55:41.492423+0000","last_became_peered":"2024-05-09T09:55:41.492423+0000","last_unstale":"2024-05-09T09:55:56.706695+0000","last_undegraded":"2024-05-09T09:55:56.706695+0000","last_fullsized":"2024-05-09T09:55:56.706695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'9","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.012993+0000","last_change":"2024-05-09T09:55:44.733118+0000","last_active":"2024-05-09T09:55:58.012993+0000","last_peered":"2024-05-09T09:55:58.012993+0000","last_clean":"2024-05-09T09:55:58.012993+0000","last_became_active":"2024-05-09T09:55:41.505078+0000","last_became_peered":"2024-05-09T09:55:41.505078+0000","last_unstale":"2024-05-09T09:55:58.012993+0000","last_undegraded":"2024-05-09T09:55:58.012993+0000","last_fullsized":"2024-05-09T09:55:58.012993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:36.404862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512634+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:55:57.512634+0000","last_peered":"2024-05-09T09:55:57.512634+0000","last_clean":"2024-05-09T09:55:57.512634+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:55:57.512634+0000","last_undegraded":"2024-05-09T09:55:57.512634+0000","last_fullsized":"2024-05-09T09:55:57.512634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'18","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401073+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:55:57.401073+0000","last_peered":"2024-05-09T09:55:57.401073+0000","last_clean":"2024-05-09T09:55:57.401073+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:55:57.401073+0000","last_undegraded":"2024-05-09T09:55:57.401073+0000","last_fullsized":"2024-05-09T09:55:57.401073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":63494,"num_write":28,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'34","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705523+0000","last_change":"2024-05-09T09:55:42.435861+0000","last_active":"2024-05-09T09:55:56.705523+0000","last_peered":"2024-05-09T09:55:56.705523+0000","last_clean":"2024-05-09T09:55:56.705523+0000","last_became_active":"2024-05-09T09:55:41.516340+0000","last_became_peered":"2024-05-09T09:55:41.516340+0000","last_unstale":"2024-05-09T09:55:56.705523+0000","last_undegraded":"2024-05-09T09:55:56.705523+0000","last_fullsized":"2024-05-09T09:55:56.705523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'12","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512299+0000","last_change":"2024-05-09T09:53:54.475107+0000","last_active":"2024-05-09T09:55:57.512299+0000","last_peered":"2024-05-09T09:55:57.512299+0000","last_clean":"2024-05-09T09:55:57.512299+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:55:57.512299+0000","last_undegraded":"2024-05-09T09:55:57.512299+0000","last_fullsized":"2024-05-09T09:55:57.512299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:07.978606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":40972,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'10","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017071+0000","last_change":"2024-05-09T09:55:55.725591+0000","last_active":"2024-05-09T09:55:58.017071+0000","last_peered":"2024-05-09T09:55:58.017071+0000","last_clean":"2024-05-09T09:55:58.017071+0000","last_became_active":"2024-05-09T09:55:55.721121+0000","last_became_peered":"2024-05-09T09:55:55.721121+0000","last_unstale":"2024-05-09T09:55:58.017071+0000","last_undegraded":"2024-05-09T09:55:58.017071+0000","last_fullsized":"2024-05-09T09:55:58.017071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298788+0000","last_change":"2024-05-09T09:55:43.389559+0000","last_active":"2024-05-09T09:55:57.298788+0000","last_peered":"2024-05-09T09:55:57.298788+0000","last_clean":"2024-05-09T09:55:57.298788+0000","last_became_active":"2024-05-09T09:55:41.513564+0000","last_became_peered":"2024-05-09T09:55:41.513564+0000","last_unstale":"2024-05-09T09:55:57.298788+0000","last_undegraded":"2024-05-09T09:55:57.298788+0000","last_fullsized":"2024-05-09T09:55:57.298788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:27.560582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"63'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702094+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:55:56.702094+0000","last_peered":"2024-05-09T09:55:56.702094+0000","last_clean":"2024-05-09T09:55:56.702094+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:55:56.702094+0000","last_undegraded":"2024-05-09T09:55:56.702094+0000","last_fullsized":"2024-05-09T09:55:56.702094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017954+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:55:58.017954+0000","last_peered":"2024-05-09T09:55:58.017954+0000","last_clean":"2024-05-09T09:55:58.017954+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:55:58.017954+0000","last_undegraded":"2024-05-09T09:55:58.017954+0000","last_fullsized":"2024-05-09T09:55:58.017954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"63'6","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016486+0000","last_change":"2024-05-09T09:55:10.683098+0000","last_active":"2024-05-09T09:55:58.016486+0000","last_peered":"2024-05-09T09:55:58.016486+0000","last_clean":"2024-05-09T09:55:58.016486+0000","last_became_active":"2024-05-09T09:55:10.495708+0000","last_became_peered":"2024-05-09T09:55:10.495708+0000","last_unstale":"2024-05-09T09:55:58.016486+0000","last_undegraded":"2024-05-09T09:55:58.016486+0000","last_fullsized":"2024-05-09T09:55:58.016486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:35.537784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'19","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513097+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:55:57.513097+0000","last_peered":"2024-05-09T09:55:57.513097+0000","last_clean":"2024-05-09T09:55:57.513097+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:55:57.513097+0000","last_undegraded":"2024-05-09T09:55:57.513097+0000","last_fullsized":"2024-05-09T09:55:57.513097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":39,"num_read_kb":53278,"num_write":69,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'6","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016640+0000","last_change":"2024-05-09T09:55:10.943382+0000","last_active":"2024-05-09T09:55:58.016640+0000","last_peered":"2024-05-09T09:55:58.016640+0000","last_clean":"2024-05-09T09:55:58.016640+0000","last_became_active":"2024-05-09T09:55:10.500255+0000","last_became_peered":"2024-05-09T09:55:10.500255+0000","last_unstale":"2024-05-09T09:55:58.016640+0000","last_undegraded":"2024-05-09T09:55:58.016640+0000","last_fullsized":"2024-05-09T09:55:58.016640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"68'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402011+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.402011+0000","last_peered":"2024-05-09T09:55:57.402011+0000","last_clean":"2024-05-09T09:55:57.402011+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:55:57.402011+0000","last_undegraded":"2024-05-09T09:55:57.402011+0000","last_fullsized":"2024-05-09T09:55:57.402011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"69'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400979+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:55:57.400979+0000","last_peered":"2024-05-09T09:55:57.400979+0000","last_clean":"2024-05-09T09:55:57.400979+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:55:57.400979+0000","last_undegraded":"2024-05-09T09:55:57.400979+0000","last_fullsized":"2024-05-09T09:55:57.400979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706291+0000","last_change":"2024-05-09T09:55:10.507173+0000","last_active":"2024-05-09T09:55:56.706291+0000","last_peered":"2024-05-09T09:55:56.706291+0000","last_clean":"2024-05-09T09:55:56.706291+0000","last_became_active":"2024-05-09T09:55:10.506690+0000","last_became_peered":"2024-05-09T09:55:10.506690+0000","last_unstale":"2024-05-09T09:55:56.706291+0000","last_undegraded":"2024-05-09T09:55:56.706291+0000","last_fullsized":"2024-05-09T09:55:56.706291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'10","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702042+0000","last_change":"2024-05-09T09:55:41.773438+0000","last_active":"2024-05-09T09:55:56.702042+0000","last_peered":"2024-05-09T09:55:56.702042+0000","last_clean":"2024-05-09T09:55:56.702042+0000","last_became_active":"2024-05-09T09:55:41.504558+0000","last_became_peered":"2024-05-09T09:55:41.504558+0000","last_unstale":"2024-05-09T09:55:56.702042+0000","last_undegraded":"2024-05-09T09:55:56.702042+0000","last_fullsized":"2024-05-09T09:55:56.702042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26642,"num_write":40,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399757+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:55:57.399757+0000","last_peered":"2024-05-09T09:55:57.399757+0000","last_clean":"2024-05-09T09:55:57.399757+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:55:57.399757+0000","last_undegraded":"2024-05-09T09:55:57.399757+0000","last_fullsized":"2024-05-09T09:55:57.399757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":634,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":234941,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":916,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":46305,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":230722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":641,"ondisk_log_size":641,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1642,"num_read_kb":1223,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1022,"num_read_kb":1804930,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":1302331392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504000,"kb_used_data":472824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93867840,"statfs":{"total":96636764160,"available":96120668160,"internally_reserved":0,"allocated":484171776,"data_stored":483628948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":392780,"kb_used_data":361604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93979060,"statfs":{"total":96636764160,"available":96234557440,"internally_reserved":0,"allocated":370282496,"data_stored":369785753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":526004,"kb_used_data":494828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93845836,"statfs":{"total":96636764160,"available":96098136064,"internally_reserved":0,"allocated":506703872,"data_stored":506143223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505404,"kb_used_data":474220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866436,"statfs":{"total":96636764160,"available":96119230464,"internally_reserved":0,"allocated":485601280,"data_stored":485118321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462516,"kb_used_data":427180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93909324,"statfs":{"total":96636764160,"available":96163147776,"internally_reserved":0,"allocated":437432320,"data_stored":436912303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331372,"kb_used_data":296036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94040468,"statfs":{"total":96636764160,"available":96297439232,"internally_reserved":0,"allocated":303140864,"data_stored":302661910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315068,"kb_used_data":279732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94056772,"statfs":{"total":96636764160,"available":96314134528,"internally_reserved":0,"allocated":286445568,"data_stored":285929009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434400,"kb_used_data":399056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93937440,"statfs":{"total":96636764160,"available":96191938560,"internally_reserved":0,"allocated":408633344,"data_stored":408125441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":406847488,"data_stored":406847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":285212672,"data_stored":285212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":301989888,"data_stored":301989888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":436207616,"data_stored":436207616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":505413632,"data_stored":505413632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":369098752,"data_stored":369098752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":20947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":38049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":62333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":25989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:56:08.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:56:09.054 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:09.060 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:56:09.074 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-05-09T09:56:07.349030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636605482,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3772,"num_read_kb":1807243,"num_write":3328,"num_write_kb":2051082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":598,"num_bytes_recovered":1302381373,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2063,"ondisk_log_size":2063,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3471544,"kb_used_data":3205480,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":751503176,"statfs":{"total":773094113280,"available":769539252224,"internally_reserved":0,"allocated":3282411520,"data_stored":3278304908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":272354867},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.652339"},"pg_stats":[{"pgid":"3.3f","version":"73'14","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017601+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:55:58.017601+0000","last_peered":"2024-05-09T09:55:58.017601+0000","last_clean":"2024-05-09T09:55:58.017601+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:55:58.017601+0000","last_undegraded":"2024-05-09T09:55:58.017601+0000","last_fullsized":"2024-05-09T09:55:58.017601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":47116,"num_write":34,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400553+0000","last_change":"2024-05-09T09:55:41.485053+0000","last_active":"2024-05-09T09:55:57.400553+0000","last_peered":"2024-05-09T09:55:57.400553+0000","last_clean":"2024-05-09T09:55:57.400553+0000","last_became_active":"2024-05-09T09:55:41.484367+0000","last_became_peered":"2024-05-09T09:55:41.484367+0000","last_unstale":"2024-05-09T09:55:57.400553+0000","last_undegraded":"2024-05-09T09:55:57.400553+0000","last_fullsized":"2024-05-09T09:55:57.400553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:39.155356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"73'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703942+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:55:56.703942+0000","last_peered":"2024-05-09T09:55:56.703942+0000","last_clean":"2024-05-09T09:55:56.703942+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:55:56.703942+0000","last_undegraded":"2024-05-09T09:55:56.703942+0000","last_fullsized":"2024-05-09T09:55:56.703942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'40","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015392+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:55:58.015392+0000","last_peered":"2024-05-09T09:55:58.015392+0000","last_clean":"2024-05-09T09:55:58.015392+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:55:58.015392+0000","last_undegraded":"2024-05-09T09:55:58.015392+0000","last_fullsized":"2024-05-09T09:55:58.015392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"73'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705841+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:55:56.705841+0000","last_peered":"2024-05-09T09:55:56.705841+0000","last_clean":"2024-05-09T09:55:56.705841+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:55:56.705841+0000","last_undegraded":"2024-05-09T09:55:56.705841+0000","last_fullsized":"2024-05-09T09:55:56.705841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":38918,"num_write":22,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705052+0000","last_change":"2024-05-09T09:55:41.476462+0000","last_active":"2024-05-09T09:55:56.705052+0000","last_peered":"2024-05-09T09:55:56.705052+0000","last_clean":"2024-05-09T09:55:56.705052+0000","last_became_active":"2024-05-09T09:55:41.474847+0000","last_became_peered":"2024-05-09T09:55:41.474847+0000","last_unstale":"2024-05-09T09:55:56.705052+0000","last_undegraded":"2024-05-09T09:55:56.705052+0000","last_fullsized":"2024-05-09T09:55:56.705052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'10","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401959+0000","last_change":"2024-05-09T09:55:11.074408+0000","last_active":"2024-05-09T09:55:57.401959+0000","last_peered":"2024-05-09T09:55:57.401959+0000","last_clean":"2024-05-09T09:55:57.401959+0000","last_became_active":"2024-05-09T09:55:10.495355+0000","last_became_peered":"2024-05-09T09:55:10.495355+0000","last_unstale":"2024-05-09T09:55:57.401959+0000","last_undegraded":"2024-05-09T09:55:57.401959+0000","last_fullsized":"2024-05-09T09:55:57.401959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:16:55.087662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704348+0000","last_change":"2024-05-09T09:55:10.508149+0000","last_active":"2024-05-09T09:55:56.704348+0000","last_peered":"2024-05-09T09:55:56.704348+0000","last_clean":"2024-05-09T09:55:56.704348+0000","last_became_active":"2024-05-09T09:55:10.506740+0000","last_became_peered":"2024-05-09T09:55:10.506740+0000","last_unstale":"2024-05-09T09:55:56.704348+0000","last_undegraded":"2024-05-09T09:55:56.704348+0000","last_fullsized":"2024-05-09T09:55:56.704348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:15.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"67'10","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297604+0000","last_change":"2024-05-09T09:53:54.477992+0000","last_active":"2024-05-09T09:55:57.297604+0000","last_peered":"2024-05-09T09:55:57.297604+0000","last_clean":"2024-05-09T09:55:57.297604+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:55:57.297604+0000","last_undegraded":"2024-05-09T09:55:57.297604+0000","last_fullsized":"2024-05-09T09:55:57.297604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:38.501294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'14","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400463+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:55:57.400463+0000","last_peered":"2024-05-09T09:55:57.400463+0000","last_clean":"2024-05-09T09:55:57.400463+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:55:57.400463+0000","last_undegraded":"2024-05-09T09:55:57.400463+0000","last_fullsized":"2024-05-09T09:55:57.400463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:45:31.509591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":34840,"num_write":54,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'38","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706070+0000","last_change":"2024-05-09T09:55:41.723376+0000","last_active":"2024-05-09T09:55:56.706070+0000","last_peered":"2024-05-09T09:55:56.706070+0000","last_clean":"2024-05-09T09:55:56.706070+0000","last_became_active":"2024-05-09T09:55:41.470370+0000","last_became_peered":"2024-05-09T09:55:41.470370+0000","last_unstale":"2024-05-09T09:55:56.706070+0000","last_undegraded":"2024-05-09T09:55:56.706070+0000","last_fullsized":"2024-05-09T09:55:56.706070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:01.442445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"64'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016806+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:55:58.016806+0000","last_peered":"2024-05-09T09:55:58.016806+0000","last_clean":"2024-05-09T09:55:58.016806+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:55:58.016806+0000","last_undegraded":"2024-05-09T09:55:58.016806+0000","last_fullsized":"2024-05-09T09:55:58.016806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":34816,"num_write":9,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399784+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:55:57.399784+0000","last_peered":"2024-05-09T09:55:57.399784+0000","last_clean":"2024-05-09T09:55:57.399784+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:55:57.399784+0000","last_undegraded":"2024-05-09T09:55:57.399784+0000","last_fullsized":"2024-05-09T09:55:57.399784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'15","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013473+0000","last_change":"2024-05-09T09:55:11.513082+0000","last_active":"2024-05-09T09:55:58.013473+0000","last_peered":"2024-05-09T09:55:58.013473+0000","last_clean":"2024-05-09T09:55:58.013473+0000","last_became_active":"2024-05-09T09:55:10.517657+0000","last_became_peered":"2024-05-09T09:55:10.517657+0000","last_unstale":"2024-05-09T09:55:58.013473+0000","last_undegraded":"2024-05-09T09:55:58.013473+0000","last_fullsized":"2024-05-09T09:55:58.013473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:28.563341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":22558,"num_write":65,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513158+0000","last_change":"2024-05-09T09:55:10.525459+0000","last_active":"2024-05-09T09:55:57.513158+0000","last_peered":"2024-05-09T09:55:57.513158+0000","last_clean":"2024-05-09T09:55:57.513158+0000","last_became_active":"2024-05-09T09:55:10.525051+0000","last_became_peered":"2024-05-09T09:55:10.525051+0000","last_unstale":"2024-05-09T09:55:57.513158+0000","last_undegraded":"2024-05-09T09:55:57.513158+0000","last_fullsized":"2024-05-09T09:55:57.513158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:08.309277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704076+0000","last_change":"2024-05-09T09:55:41.727656+0000","last_active":"2024-05-09T09:55:56.704076+0000","last_peered":"2024-05-09T09:55:56.704076+0000","last_clean":"2024-05-09T09:55:56.704076+0000","last_became_active":"2024-05-09T09:55:41.468227+0000","last_became_peered":"2024-05-09T09:55:41.468227+0000","last_unstale":"2024-05-09T09:55:56.704076+0000","last_undegraded":"2024-05-09T09:55:56.704076+0000","last_fullsized":"2024-05-09T09:55:56.704076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017765+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:55:58.017765+0000","last_peered":"2024-05-09T09:55:58.017765+0000","last_clean":"2024-05-09T09:55:58.017765+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:55:58.017765+0000","last_undegraded":"2024-05-09T09:55:58.017765+0000","last_fullsized":"2024-05-09T09:55:58.017765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014983+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:55:58.014983+0000","last_peered":"2024-05-09T09:55:58.014983+0000","last_clean":"2024-05-09T09:55:58.014983+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:55:58.014983+0000","last_undegraded":"2024-05-09T09:55:58.014983+0000","last_fullsized":"2024-05-09T09:55:58.014983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299075+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.299075+0000","last_peered":"2024-05-09T09:55:57.299075+0000","last_clean":"2024-05-09T09:55:57.299075+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:55:57.299075+0000","last_undegraded":"2024-05-09T09:55:57.299075+0000","last_fullsized":"2024-05-09T09:55:57.299075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400770+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:55:57.400770+0000","last_peered":"2024-05-09T09:55:57.400770+0000","last_clean":"2024-05-09T09:55:57.400770+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:55:57.400770+0000","last_undegraded":"2024-05-09T09:55:57.400770+0000","last_fullsized":"2024-05-09T09:55:57.400770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299149+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:55:57.299149+0000","last_peered":"2024-05-09T09:55:57.299149+0000","last_clean":"2024-05-09T09:55:57.299149+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:55:57.299149+0000","last_undegraded":"2024-05-09T09:55:57.299149+0000","last_fullsized":"2024-05-09T09:55:57.299149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512589+0000","last_change":"2024-05-09T09:55:10.502036+0000","last_active":"2024-05-09T09:55:57.512589+0000","last_peered":"2024-05-09T09:55:57.512589+0000","last_clean":"2024-05-09T09:55:57.512589+0000","last_became_active":"2024-05-09T09:55:10.501517+0000","last_became_peered":"2024-05-09T09:55:10.501517+0000","last_unstale":"2024-05-09T09:55:57.512589+0000","last_undegraded":"2024-05-09T09:55:57.512589+0000","last_fullsized":"2024-05-09T09:55:57.512589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:30.945254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"66'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705752+0000","last_change":"2024-05-09T09:55:42.549939+0000","last_active":"2024-05-09T09:55:56.705752+0000","last_peered":"2024-05-09T09:55:56.705752+0000","last_clean":"2024-05-09T09:55:56.705752+0000","last_became_active":"2024-05-09T09:55:41.517108+0000","last_became_peered":"2024-05-09T09:55:41.517108+0000","last_unstale":"2024-05-09T09:55:56.705752+0000","last_undegraded":"2024-05-09T09:55:56.705752+0000","last_fullsized":"2024-05-09T09:55:56.705752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:39.522749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511344+0000","last_change":"2024-05-09T09:55:41.495787+0000","last_active":"2024-05-09T09:55:57.511344+0000","last_peered":"2024-05-09T09:55:57.511344+0000","last_clean":"2024-05-09T09:55:57.511344+0000","last_became_active":"2024-05-09T09:55:41.495217+0000","last_became_peered":"2024-05-09T09:55:41.495217+0000","last_unstale":"2024-05-09T09:55:57.511344+0000","last_undegraded":"2024-05-09T09:55:57.511344+0000","last_fullsized":"2024-05-09T09:55:57.511344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:19.303237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"67'12","reported_seq":73,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017067+0000","last_change":"2024-05-09T09:55:11.744028+0000","last_active":"2024-05-09T09:55:58.017067+0000","last_peered":"2024-05-09T09:55:58.017067+0000","last_clean":"2024-05-09T09:55:58.017067+0000","last_became_active":"2024-05-09T09:55:10.515515+0000","last_became_peered":"2024-05-09T09:55:10.515515+0000","last_unstale":"2024-05-09T09:55:58.017067+0000","last_undegraded":"2024-05-09T09:55:58.017067+0000","last_fullsized":"2024-05-09T09:55:58.017067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:26:21.134168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":77594624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706053+0000","last_change":"2024-05-09T09:55:41.471993+0000","last_active":"2024-05-09T09:55:56.706053+0000","last_peered":"2024-05-09T09:55:56.706053+0000","last_clean":"2024-05-09T09:55:56.706053+0000","last_became_active":"2024-05-09T09:55:41.469463+0000","last_became_peered":"2024-05-09T09:55:41.469463+0000","last_unstale":"2024-05-09T09:55:56.706053+0000","last_undegraded":"2024-05-09T09:55:56.706053+0000","last_fullsized":"2024-05-09T09:55:56.706053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:09.428329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702672+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:55:56.702672+0000","last_peered":"2024-05-09T09:55:56.702672+0000","last_clean":"2024-05-09T09:55:56.702672+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:55:56.702672+0000","last_undegraded":"2024-05-09T09:55:56.702672+0000","last_fullsized":"2024-05-09T09:55:56.702672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703760+0000","last_change":"2024-05-09T09:55:41.489025+0000","last_active":"2024-05-09T09:55:56.703760+0000","last_peered":"2024-05-09T09:55:56.703760+0000","last_clean":"2024-05-09T09:55:56.703760+0000","last_became_active":"2024-05-09T09:55:41.479825+0000","last_became_peered":"2024-05-09T09:55:41.479825+0000","last_unstale":"2024-05-09T09:55:56.703760+0000","last_undegraded":"2024-05-09T09:55:56.703760+0000","last_fullsized":"2024-05-09T09:55:56.703760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017517+0000","last_change":"2024-05-09T09:55:10.499813+0000","last_active":"2024-05-09T09:55:58.017517+0000","last_peered":"2024-05-09T09:55:58.017517+0000","last_clean":"2024-05-09T09:55:58.017517+0000","last_became_active":"2024-05-09T09:55:10.499014+0000","last_became_peered":"2024-05-09T09:55:10.499014+0000","last_unstale":"2024-05-09T09:55:58.017517+0000","last_undegraded":"2024-05-09T09:55:58.017517+0000","last_fullsized":"2024-05-09T09:55:58.017517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:12.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"68'9","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015039+0000","last_change":"2024-05-09T09:55:43.099041+0000","last_active":"2024-05-09T09:55:58.015039+0000","last_peered":"2024-05-09T09:55:58.015039+0000","last_clean":"2024-05-09T09:55:58.015039+0000","last_became_active":"2024-05-09T09:55:41.507252+0000","last_became_peered":"2024-05-09T09:55:41.507252+0000","last_unstale":"2024-05-09T09:55:58.015039+0000","last_undegraded":"2024-05-09T09:55:58.015039+0000","last_fullsized":"2024-05-09T09:55:58.015039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401721+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:55:57.401721+0000","last_peered":"2024-05-09T09:55:57.401721+0000","last_clean":"2024-05-09T09:55:57.401721+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:55:57.401721+0000","last_undegraded":"2024-05-09T09:55:57.401721+0000","last_fullsized":"2024-05-09T09:55:57.401721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"73'16","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706715+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:55:56.706715+0000","last_peered":"2024-05-09T09:55:56.706715+0000","last_clean":"2024-05-09T09:55:56.706715+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:55:56.706715+0000","last_undegraded":"2024-05-09T09:55:56.706715+0000","last_fullsized":"2024-05-09T09:55:56.706715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017272+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:55:58.017272+0000","last_peered":"2024-05-09T09:55:58.017272+0000","last_clean":"2024-05-09T09:55:58.017272+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:55:58.017272+0000","last_undegraded":"2024-05-09T09:55:58.017272+0000","last_fullsized":"2024-05-09T09:55:58.017272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400280+0000","last_change":"2024-05-09T09:55:41.487851+0000","last_active":"2024-05-09T09:55:57.400280+0000","last_peered":"2024-05-09T09:55:57.400280+0000","last_clean":"2024-05-09T09:55:57.400280+0000","last_became_active":"2024-05-09T09:55:41.487060+0000","last_became_peered":"2024-05-09T09:55:41.487060+0000","last_unstale":"2024-05-09T09:55:57.400280+0000","last_undegraded":"2024-05-09T09:55:57.400280+0000","last_fullsized":"2024-05-09T09:55:57.400280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:54:51.000892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402309+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:55:57.402309+0000","last_peered":"2024-05-09T09:55:57.402309+0000","last_clean":"2024-05-09T09:55:57.402309+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:55:57.402309+0000","last_undegraded":"2024-05-09T09:55:57.402309+0000","last_fullsized":"2024-05-09T09:55:57.402309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'4","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702911+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:55:56.702911+0000","last_peered":"2024-05-09T09:55:56.702911+0000","last_clean":"2024-05-09T09:55:56.702911+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:55:56.702911+0000","last_undegraded":"2024-05-09T09:55:56.702911+0000","last_fullsized":"2024-05-09T09:55:56.702911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12294,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018013+0000","last_change":"2024-05-09T09:55:10.509010+0000","last_active":"2024-05-09T09:55:58.018013+0000","last_peered":"2024-05-09T09:55:58.018013+0000","last_clean":"2024-05-09T09:55:58.018013+0000","last_became_active":"2024-05-09T09:55:10.506778+0000","last_became_peered":"2024-05-09T09:55:10.506778+0000","last_unstale":"2024-05-09T09:55:58.018013+0000","last_undegraded":"2024-05-09T09:55:58.018013+0000","last_fullsized":"2024-05-09T09:55:58.018013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706557+0000","last_change":"2024-05-09T09:55:41.534680+0000","last_active":"2024-05-09T09:55:56.706557+0000","last_peered":"2024-05-09T09:55:56.706557+0000","last_clean":"2024-05-09T09:55:56.706557+0000","last_became_active":"2024-05-09T09:55:41.467079+0000","last_became_peered":"2024-05-09T09:55:41.467079+0000","last_unstale":"2024-05-09T09:55:56.706557+0000","last_undegraded":"2024-05-09T09:55:56.706557+0000","last_fullsized":"2024-05-09T09:55:56.706557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:22.934731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706204+0000","last_change":"2024-05-09T09:55:41.468769+0000","last_active":"2024-05-09T09:55:56.706204+0000","last_peered":"2024-05-09T09:55:56.706204+0000","last_clean":"2024-05-09T09:55:56.706204+0000","last_became_active":"2024-05-09T09:55:41.467929+0000","last_became_peered":"2024-05-09T09:55:41.467929+0000","last_unstale":"2024-05-09T09:55:56.706204+0000","last_undegraded":"2024-05-09T09:55:56.706204+0000","last_fullsized":"2024-05-09T09:55:56.706204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:02.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702279+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:55:56.702279+0000","last_peered":"2024-05-09T09:55:56.702279+0000","last_clean":"2024-05-09T09:55:56.702279+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:55:56.702279+0000","last_undegraded":"2024-05-09T09:55:56.702279+0000","last_fullsized":"2024-05-09T09:55:56.702279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705924+0000","last_change":"2024-05-09T09:55:10.483103+0000","last_active":"2024-05-09T09:55:56.705924+0000","last_peered":"2024-05-09T09:55:56.705924+0000","last_clean":"2024-05-09T09:55:56.705924+0000","last_became_active":"2024-05-09T09:55:10.482649+0000","last_became_peered":"2024-05-09T09:55:10.482649+0000","last_unstale":"2024-05-09T09:55:56.705924+0000","last_undegraded":"2024-05-09T09:55:56.705924+0000","last_fullsized":"2024-05-09T09:55:56.705924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'14","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014967+0000","last_change":"2024-05-09T09:55:45.036128+0000","last_active":"2024-05-09T09:55:58.014967+0000","last_peered":"2024-05-09T09:55:58.014967+0000","last_clean":"2024-05-09T09:55:58.014967+0000","last_became_active":"2024-05-09T09:55:41.508695+0000","last_became_peered":"2024-05-09T09:55:41.508695+0000","last_unstale":"2024-05-09T09:55:58.014967+0000","last_undegraded":"2024-05-09T09:55:58.014967+0000","last_fullsized":"2024-05-09T09:55:58.014967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":38936,"num_write":54,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018240+0000","last_change":"2024-05-09T09:55:10.510105+0000","last_active":"2024-05-09T09:55:58.018240+0000","last_peered":"2024-05-09T09:55:58.018240+0000","last_clean":"2024-05-09T09:55:58.018240+0000","last_became_active":"2024-05-09T09:55:10.508122+0000","last_became_peered":"2024-05-09T09:55:10.508122+0000","last_unstale":"2024-05-09T09:55:58.018240+0000","last_undegraded":"2024-05-09T09:55:58.018240+0000","last_fullsized":"2024-05-09T09:55:58.018240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"63'11","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511453+0000","last_change":"2024-05-09T09:55:43.116362+0000","last_active":"2024-05-09T09:55:57.511453+0000","last_peered":"2024-05-09T09:55:57.511453+0000","last_clean":"2024-05-09T09:55:57.511453+0000","last_became_active":"2024-05-09T09:55:41.506785+0000","last_became_peered":"2024-05-09T09:55:41.506785+0000","last_unstale":"2024-05-09T09:55:57.511453+0000","last_undegraded":"2024-05-09T09:55:57.511453+0000","last_fullsized":"2024-05-09T09:55:57.511453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:30.446781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'15","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.019317+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:55:58.019317+0000","last_peered":"2024-05-09T09:55:58.019317+0000","last_clean":"2024-05-09T09:55:58.019317+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:55:58.019317+0000","last_undegraded":"2024-05-09T09:55:58.019317+0000","last_fullsized":"2024-05-09T09:55:58.019317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705111+0000","last_change":"2024-05-09T09:55:42.211684+0000","last_active":"2024-05-09T09:55:56.705111+0000","last_peered":"2024-05-09T09:55:56.705111+0000","last_clean":"2024-05-09T09:55:56.705111+0000","last_became_active":"2024-05-09T09:55:41.492528+0000","last_became_peered":"2024-05-09T09:55:41.492528+0000","last_unstale":"2024-05-09T09:55:56.705111+0000","last_undegraded":"2024-05-09T09:55:56.705111+0000","last_fullsized":"2024-05-09T09:55:56.705111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:23.272525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018549+0000","last_change":"2024-05-09T09:55:10.510510+0000","last_active":"2024-05-09T09:55:58.018549+0000","last_peered":"2024-05-09T09:55:58.018549+0000","last_clean":"2024-05-09T09:55:58.018549+0000","last_became_active":"2024-05-09T09:55:10.508721+0000","last_became_peered":"2024-05-09T09:55:10.508721+0000","last_unstale":"2024-05-09T09:55:58.018549+0000","last_undegraded":"2024-05-09T09:55:58.018549+0000","last_fullsized":"2024-05-09T09:55:58.018549+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'7","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298120+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:55:57.298120+0000","last_peered":"2024-05-09T09:55:57.298120+0000","last_clean":"2024-05-09T09:55:57.298120+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:55:57.298120+0000","last_undegraded":"2024-05-09T09:55:57.298120+0000","last_fullsized":"2024-05-09T09:55:57.298120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401894+0000","last_change":"2024-05-09T09:55:10.508180+0000","last_active":"2024-05-09T09:55:57.401894+0000","last_peered":"2024-05-09T09:55:57.401894+0000","last_clean":"2024-05-09T09:55:57.401894+0000","last_became_active":"2024-05-09T09:55:10.507504+0000","last_became_peered":"2024-05-09T09:55:10.507504+0000","last_unstale":"2024-05-09T09:55:57.401894+0000","last_undegraded":"2024-05-09T09:55:57.401894+0000","last_fullsized":"2024-05-09T09:55:57.401894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:26.131778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"73'14","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018747+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:55:58.018747+0000","last_peered":"2024-05-09T09:55:58.018747+0000","last_clean":"2024-05-09T09:55:58.018747+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:55:58.018747+0000","last_undegraded":"2024-05-09T09:55:58.018747+0000","last_fullsized":"2024-05-09T09:55:58.018747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'18","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017797+0000","last_change":"2024-05-09T09:55:10.785031+0000","last_active":"2024-05-09T09:55:58.017797+0000","last_peered":"2024-05-09T09:55:58.017797+0000","last_clean":"2024-05-09T09:55:58.017797+0000","last_became_active":"2024-05-09T09:55:10.502644+0000","last_became_peered":"2024-05-09T09:55:10.502644+0000","last_unstale":"2024-05-09T09:55:58.017797+0000","last_undegraded":"2024-05-09T09:55:58.017797+0000","last_fullsized":"2024-05-09T09:55:58.017797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:14.036784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400855+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:55:57.400855+0000","last_peered":"2024-05-09T09:55:57.400855+0000","last_clean":"2024-05-09T09:55:57.400855+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:55:57.400855+0000","last_undegraded":"2024-05-09T09:55:57.400855+0000","last_fullsized":"2024-05-09T09:55:57.400855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"75'12","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015784+0000","last_change":"2024-05-09T09:55:44.175359+0000","last_active":"2024-05-09T09:55:58.015784+0000","last_peered":"2024-05-09T09:55:58.015784+0000","last_clean":"2024-05-09T09:55:58.015784+0000","last_became_active":"2024-05-09T09:55:41.507201+0000","last_became_peered":"2024-05-09T09:55:41.507201+0000","last_unstale":"2024-05-09T09:55:58.015784+0000","last_undegraded":"2024-05-09T09:55:58.015784+0000","last_fullsized":"2024-05-09T09:55:58.015784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:07.511876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016355+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:55:58.016355+0000","last_peered":"2024-05-09T09:55:58.016355+0000","last_clean":"2024-05-09T09:55:58.016355+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:55:58.016355+0000","last_undegraded":"2024-05-09T09:55:58.016355+0000","last_fullsized":"2024-05-09T09:55:58.016355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'27","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401423+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:55:57.401423+0000","last_peered":"2024-05-09T09:55:57.401423+0000","last_clean":"2024-05-09T09:55:57.401423+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:55:57.401423+0000","last_undegraded":"2024-05-09T09:55:57.401423+0000","last_fullsized":"2024-05-09T09:55:57.401423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704309+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:55:56.704309+0000","last_peered":"2024-05-09T09:55:56.704309+0000","last_clean":"2024-05-09T09:55:56.704309+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:55:56.704309+0000","last_undegraded":"2024-05-09T09:55:56.704309+0000","last_fullsized":"2024-05-09T09:55:56.704309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401424+0000","last_change":"2024-05-09T09:55:41.485193+0000","last_active":"2024-05-09T09:55:57.401424+0000","last_peered":"2024-05-09T09:55:57.401424+0000","last_clean":"2024-05-09T09:55:57.401424+0000","last_became_active":"2024-05-09T09:55:41.484312+0000","last_became_peered":"2024-05-09T09:55:41.484312+0000","last_unstale":"2024-05-09T09:55:57.401424+0000","last_undegraded":"2024-05-09T09:55:57.401424+0000","last_fullsized":"2024-05-09T09:55:57.401424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:59.737104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704125+0000","last_change":"2024-05-09T09:55:41.479720+0000","last_active":"2024-05-09T09:55:56.704125+0000","last_peered":"2024-05-09T09:55:56.704125+0000","last_clean":"2024-05-09T09:55:56.704125+0000","last_became_active":"2024-05-09T09:55:41.472133+0000","last_became_peered":"2024-05-09T09:55:41.472133+0000","last_unstale":"2024-05-09T09:55:56.704125+0000","last_undegraded":"2024-05-09T09:55:56.704125+0000","last_fullsized":"2024-05-09T09:55:56.704125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:55.564231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"64'4","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015251+0000","last_change":"2024-05-09T09:55:44.852684+0000","last_active":"2024-05-09T09:55:58.015251+0000","last_peered":"2024-05-09T09:55:58.015251+0000","last_clean":"2024-05-09T09:55:58.015251+0000","last_became_active":"2024-05-09T09:55:41.507751+0000","last_became_peered":"2024-05-09T09:55:41.507751+0000","last_unstale":"2024-05-09T09:55:58.015251+0000","last_undegraded":"2024-05-09T09:55:58.015251+0000","last_fullsized":"2024-05-09T09:55:58.015251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:13.201219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511904+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:55:57.511904+0000","last_peered":"2024-05-09T09:55:57.511904+0000","last_clean":"2024-05-09T09:55:57.511904+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:55:57.511904+0000","last_undegraded":"2024-05-09T09:55:57.511904+0000","last_fullsized":"2024-05-09T09:55:57.511904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"73'13","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013285+0000","last_change":"2024-05-09T09:55:11.749967+0000","last_active":"2024-05-09T09:55:58.013285+0000","last_peered":"2024-05-09T09:55:58.013285+0000","last_clean":"2024-05-09T09:55:58.013285+0000","last_became_active":"2024-05-09T09:55:10.522763+0000","last_became_peered":"2024-05-09T09:55:10.522763+0000","last_unstale":"2024-05-09T09:55:58.013285+0000","last_undegraded":"2024-05-09T09:55:58.013285+0000","last_fullsized":"2024-05-09T09:55:58.013285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:03.450608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013669+0000","last_change":"2024-05-09T09:55:10.505759+0000","last_active":"2024-05-09T09:55:58.013669+0000","last_peered":"2024-05-09T09:55:58.013669+0000","last_clean":"2024-05-09T09:55:58.013669+0000","last_became_active":"2024-05-09T09:55:10.504789+0000","last_became_peered":"2024-05-09T09:55:10.504789+0000","last_unstale":"2024-05-09T09:55:58.013669+0000","last_undegraded":"2024-05-09T09:55:58.013669+0000","last_fullsized":"2024-05-09T09:55:58.013669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:53.805557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298207+0000","last_change":"2024-05-09T09:55:41.506430+0000","last_active":"2024-05-09T09:55:57.298207+0000","last_peered":"2024-05-09T09:55:57.298207+0000","last_clean":"2024-05-09T09:55:57.298207+0000","last_became_active":"2024-05-09T09:55:41.505745+0000","last_became_peered":"2024-05-09T09:55:41.505745+0000","last_unstale":"2024-05-09T09:55:57.298207+0000","last_undegraded":"2024-05-09T09:55:57.298207+0000","last_fullsized":"2024-05-09T09:55:57.298207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:18.090362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017383+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:55:58.017383+0000","last_peered":"2024-05-09T09:55:58.017383+0000","last_clean":"2024-05-09T09:55:58.017383+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:55:58.017383+0000","last_undegraded":"2024-05-09T09:55:58.017383+0000","last_fullsized":"2024-05-09T09:55:58.017383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512208+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:55:57.512208+0000","last_peered":"2024-05-09T09:55:57.512208+0000","last_clean":"2024-05-09T09:55:57.512208+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:55:57.512208+0000","last_undegraded":"2024-05-09T09:55:57.512208+0000","last_fullsized":"2024-05-09T09:55:57.512208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"73'21","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016539+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:55:58.016539+0000","last_peered":"2024-05-09T09:55:58.016539+0000","last_clean":"2024-05-09T09:55:58.016539+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:55:58.016539+0000","last_undegraded":"2024-05-09T09:55:58.016539+0000","last_fullsized":"2024-05-09T09:55:58.016539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'15","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701053+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:55:56.701053+0000","last_peered":"2024-05-09T09:55:56.701053+0000","last_clean":"2024-05-09T09:55:56.701053+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:55:56.701053+0000","last_undegraded":"2024-05-09T09:55:56.701053+0000","last_fullsized":"2024-05-09T09:55:56.701053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706729+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:55:56.706729+0000","last_peered":"2024-05-09T09:55:56.706729+0000","last_clean":"2024-05-09T09:55:56.706729+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:55:56.706729+0000","last_undegraded":"2024-05-09T09:55:56.706729+0000","last_fullsized":"2024-05-09T09:55:56.706729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705393+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:55:56.705393+0000","last_peered":"2024-05-09T09:55:56.705393+0000","last_clean":"2024-05-09T09:55:56.705393+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:55:56.705393+0000","last_undegraded":"2024-05-09T09:55:56.705393+0000","last_fullsized":"2024-05-09T09:55:56.705393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'12","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402227+0000","last_change":"2024-05-09T09:55:11.694165+0000","last_active":"2024-05-09T09:55:57.402227+0000","last_peered":"2024-05-09T09:55:57.402227+0000","last_clean":"2024-05-09T09:55:57.402227+0000","last_became_active":"2024-05-09T09:55:10.521894+0000","last_became_peered":"2024-05-09T09:55:10.521894+0000","last_unstale":"2024-05-09T09:55:57.402227+0000","last_undegraded":"2024-05-09T09:55:57.402227+0000","last_fullsized":"2024-05-09T09:55:57.402227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:04.661085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38924,"num_write":32,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511206+0000","last_change":"2024-05-09T09:55:41.484220+0000","last_active":"2024-05-09T09:55:57.511206+0000","last_peered":"2024-05-09T09:55:57.511206+0000","last_clean":"2024-05-09T09:55:57.511206+0000","last_became_active":"2024-05-09T09:55:41.483828+0000","last_became_peered":"2024-05-09T09:55:41.483828+0000","last_unstale":"2024-05-09T09:55:57.511206+0000","last_undegraded":"2024-05-09T09:55:57.511206+0000","last_fullsized":"2024-05-09T09:55:57.511206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:12.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701503+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:55:56.701503+0000","last_peered":"2024-05-09T09:55:56.701503+0000","last_clean":"2024-05-09T09:55:56.701503+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:55:56.701503+0000","last_undegraded":"2024-05-09T09:55:56.701503+0000","last_fullsized":"2024-05-09T09:55:56.701503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13754,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":60,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511648+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:55:57.511648+0000","last_peered":"2024-05-09T09:55:57.511648+0000","last_clean":"2024-05-09T09:55:57.511648+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:55:57.511648+0000","last_undegraded":"2024-05-09T09:55:57.511648+0000","last_fullsized":"2024-05-09T09:55:57.511648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703562+0000","last_change":"2024-05-09T09:55:10.518479+0000","last_active":"2024-05-09T09:55:56.703562+0000","last_peered":"2024-05-09T09:55:56.703562+0000","last_clean":"2024-05-09T09:55:56.703562+0000","last_became_active":"2024-05-09T09:55:10.518109+0000","last_became_peered":"2024-05-09T09:55:10.518109+0000","last_unstale":"2024-05-09T09:55:56.703562+0000","last_undegraded":"2024-05-09T09:55:56.703562+0000","last_fullsized":"2024-05-09T09:55:56.703562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705558+0000","last_change":"2024-05-09T09:55:41.491823+0000","last_active":"2024-05-09T09:55:56.705558+0000","last_peered":"2024-05-09T09:55:56.705558+0000","last_clean":"2024-05-09T09:55:56.705558+0000","last_became_active":"2024-05-09T09:55:41.488846+0000","last_became_peered":"2024-05-09T09:55:41.488846+0000","last_unstale":"2024-05-09T09:55:56.705558+0000","last_undegraded":"2024-05-09T09:55:56.705558+0000","last_fullsized":"2024-05-09T09:55:56.705558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:00.130607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"73'11","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016975+0000","last_change":"2024-05-09T09:55:10.972117+0000","last_active":"2024-05-09T09:55:58.016975+0000","last_peered":"2024-05-09T09:55:58.016975+0000","last_clean":"2024-05-09T09:55:58.016975+0000","last_became_active":"2024-05-09T09:55:10.507132+0000","last_became_peered":"2024-05-09T09:55:10.507132+0000","last_unstale":"2024-05-09T09:55:58.016975+0000","last_undegraded":"2024-05-09T09:55:58.016975+0000","last_fullsized":"2024-05-09T09:55:58.016975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:59.211608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":22550,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512533+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:55:57.512533+0000","last_peered":"2024-05-09T09:55:57.512533+0000","last_clean":"2024-05-09T09:55:57.512533+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:55:57.512533+0000","last_undegraded":"2024-05-09T09:55:57.512533+0000","last_fullsized":"2024-05-09T09:55:57.512533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"78'20","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706140+0000","last_change":"2024-05-09T09:55:42.405072+0000","last_active":"2024-05-09T09:55:56.706140+0000","last_peered":"2024-05-09T09:55:56.706140+0000","last_clean":"2024-05-09T09:55:56.706140+0000","last_became_active":"2024-05-09T09:55:41.509467+0000","last_became_peered":"2024-05-09T09:55:41.509467+0000","last_unstale":"2024-05-09T09:55:56.706140+0000","last_undegraded":"2024-05-09T09:55:56.706140+0000","last_fullsized":"2024-05-09T09:55:56.706140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:31.891322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":28,"num_write":26,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":6936,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706227+0000","last_change":"2024-05-09T09:55:10.506676+0000","last_active":"2024-05-09T09:55:56.706227+0000","last_peered":"2024-05-09T09:55:56.706227+0000","last_clean":"2024-05-09T09:55:56.706227+0000","last_became_active":"2024-05-09T09:55:10.506376+0000","last_became_peered":"2024-05-09T09:55:10.506376+0000","last_unstale":"2024-05-09T09:55:56.706227+0000","last_undegraded":"2024-05-09T09:55:56.706227+0000","last_fullsized":"2024-05-09T09:55:56.706227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:18.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"63'2","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016084+0000","last_change":"2024-05-09T09:55:11.409285+0000","last_active":"2024-05-09T09:55:58.016084+0000","last_peered":"2024-05-09T09:55:58.016084+0000","last_clean":"2024-05-09T09:55:58.016084+0000","last_became_active":"2024-05-09T09:55:10.512509+0000","last_became_peered":"2024-05-09T09:55:10.512509+0000","last_unstale":"2024-05-09T09:55:58.016084+0000","last_undegraded":"2024-05-09T09:55:58.016084+0000","last_fullsized":"2024-05-09T09:55:58.016084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:08.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706333+0000","last_change":"2024-05-09T09:55:41.477052+0000","last_active":"2024-05-09T09:55:56.706333+0000","last_peered":"2024-05-09T09:55:56.706333+0000","last_clean":"2024-05-09T09:55:56.706333+0000","last_became_active":"2024-05-09T09:55:41.471497+0000","last_became_peered":"2024-05-09T09:55:41.471497+0000","last_unstale":"2024-05-09T09:55:56.706333+0000","last_undegraded":"2024-05-09T09:55:56.706333+0000","last_fullsized":"2024-05-09T09:55:56.706333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:59:59.078912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'10","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298753+0000","last_change":"2024-05-09T09:55:42.508840+0000","last_active":"2024-05-09T09:55:57.298753+0000","last_peered":"2024-05-09T09:55:57.298753+0000","last_clean":"2024-05-09T09:55:57.298753+0000","last_became_active":"2024-05-09T09:55:41.513259+0000","last_became_peered":"2024-05-09T09:55:41.513259+0000","last_unstale":"2024-05-09T09:55:57.298753+0000","last_undegraded":"2024-05-09T09:55:57.298753+0000","last_fullsized":"2024-05-09T09:55:57.298753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703127+0000","last_change":"2024-05-09T09:55:41.505012+0000","last_active":"2024-05-09T09:55:56.703127+0000","last_peered":"2024-05-09T09:55:56.703127+0000","last_clean":"2024-05-09T09:55:56.703127+0000","last_became_active":"2024-05-09T09:55:41.504609+0000","last_became_peered":"2024-05-09T09:55:41.504609+0000","last_unstale":"2024-05-09T09:55:56.703127+0000","last_undegraded":"2024-05-09T09:55:56.703127+0000","last_fullsized":"2024-05-09T09:55:56.703127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"73'24","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512979+0000","last_change":"2024-05-09T09:55:10.818400+0000","last_active":"2024-05-09T09:55:57.512979+0000","last_peered":"2024-05-09T09:55:57.512979+0000","last_clean":"2024-05-09T09:55:57.512979+0000","last_became_active":"2024-05-09T09:55:10.520615+0000","last_became_peered":"2024-05-09T09:55:10.520615+0000","last_unstale":"2024-05-09T09:55:57.512979+0000","last_undegraded":"2024-05-09T09:55:57.512979+0000","last_fullsized":"2024-05-09T09:55:57.512979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:32.213479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":3002,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'15","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513004+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:55:57.513004+0000","last_peered":"2024-05-09T09:55:57.513004+0000","last_clean":"2024-05-09T09:55:57.513004+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:55:57.513004+0000","last_undegraded":"2024-05-09T09:55:57.513004+0000","last_fullsized":"2024-05-09T09:55:57.513004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702414+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:55:56.702414+0000","last_peered":"2024-05-09T09:55:56.702414+0000","last_clean":"2024-05-09T09:55:56.702414+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:55:56.702414+0000","last_undegraded":"2024-05-09T09:55:56.702414+0000","last_fullsized":"2024-05-09T09:55:56.702414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706758+0000","last_change":"2024-05-09T09:55:42.572344+0000","last_active":"2024-05-09T09:55:56.706758+0000","last_peered":"2024-05-09T09:55:56.706758+0000","last_clean":"2024-05-09T09:55:56.706758+0000","last_became_active":"2024-05-09T09:55:41.517278+0000","last_became_peered":"2024-05-09T09:55:41.517278+0000","last_unstale":"2024-05-09T09:55:56.706758+0000","last_undegraded":"2024-05-09T09:55:56.706758+0000","last_fullsized":"2024-05-09T09:55:56.706758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'12","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704482+0000","last_change":"2024-05-09T09:55:42.204305+0000","last_active":"2024-05-09T09:55:56.704482+0000","last_peered":"2024-05-09T09:55:56.704482+0000","last_clean":"2024-05-09T09:55:56.704482+0000","last_became_active":"2024-05-09T09:55:41.481490+0000","last_became_peered":"2024-05-09T09:55:41.481490+0000","last_unstale":"2024-05-09T09:55:56.704482+0000","last_undegraded":"2024-05-09T09:55:56.704482+0000","last_fullsized":"2024-05-09T09:55:56.704482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402933+0000","last_change":"2024-05-09T09:55:41.651487+0000","last_active":"2024-05-09T09:55:57.402933+0000","last_peered":"2024-05-09T09:55:57.402933+0000","last_clean":"2024-05-09T09:55:57.402933+0000","last_became_active":"2024-05-09T09:55:41.495448+0000","last_became_peered":"2024-05-09T09:55:41.495448+0000","last_unstale":"2024-05-09T09:55:57.402933+0000","last_undegraded":"2024-05-09T09:55:57.402933+0000","last_fullsized":"2024-05-09T09:55:57.402933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:09.689288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017854+0000","last_change":"2024-05-09T09:55:11.115278+0000","last_active":"2024-05-09T09:55:58.017854+0000","last_peered":"2024-05-09T09:55:58.017854+0000","last_clean":"2024-05-09T09:55:58.017854+0000","last_became_active":"2024-05-09T09:55:10.512273+0000","last_became_peered":"2024-05-09T09:55:10.512273+0000","last_unstale":"2024-05-09T09:55:58.017854+0000","last_undegraded":"2024-05-09T09:55:58.017854+0000","last_fullsized":"2024-05-09T09:55:58.017854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:23:44.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'15","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298835+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:55:57.298835+0000","last_peered":"2024-05-09T09:55:57.298835+0000","last_clean":"2024-05-09T09:55:57.298835+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:55:57.298835+0000","last_undegraded":"2024-05-09T09:55:57.298835+0000","last_fullsized":"2024-05-09T09:55:57.298835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705087+0000","last_change":"2024-05-09T09:55:41.475763+0000","last_active":"2024-05-09T09:55:56.705087+0000","last_peered":"2024-05-09T09:55:56.705087+0000","last_clean":"2024-05-09T09:55:56.705087+0000","last_became_active":"2024-05-09T09:55:41.474020+0000","last_became_peered":"2024-05-09T09:55:41.474020+0000","last_unstale":"2024-05-09T09:55:56.705087+0000","last_undegraded":"2024-05-09T09:55:56.705087+0000","last_fullsized":"2024-05-09T09:55:56.705087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:59.415817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"75'42","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703965+0000","last_change":"2024-05-09T09:55:11.077756+0000","last_active":"2024-05-09T09:55:56.703965+0000","last_peered":"2024-05-09T09:55:56.703965+0000","last_clean":"2024-05-09T09:55:56.703965+0000","last_became_active":"2024-05-09T09:55:10.516407+0000","last_became_peered":"2024-05-09T09:55:10.516407+0000","last_unstale":"2024-05-09T09:55:56.703965+0000","last_undegraded":"2024-05-09T09:55:56.703965+0000","last_fullsized":"2024-05-09T09:55:56.703965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:29.572431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'7","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015602+0000","last_change":"2024-05-09T09:55:11.190571+0000","last_active":"2024-05-09T09:55:58.015602+0000","last_peered":"2024-05-09T09:55:58.015602+0000","last_clean":"2024-05-09T09:55:58.015602+0000","last_became_active":"2024-05-09T09:55:10.516633+0000","last_became_peered":"2024-05-09T09:55:10.516633+0000","last_unstale":"2024-05-09T09:55:58.015602+0000","last_undegraded":"2024-05-09T09:55:58.015602+0000","last_fullsized":"2024-05-09T09:55:58.015602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:56.816319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706539+0000","last_change":"2024-05-09T09:55:41.480580+0000","last_active":"2024-05-09T09:55:56.706539+0000","last_peered":"2024-05-09T09:55:56.706539+0000","last_clean":"2024-05-09T09:55:56.706539+0000","last_became_active":"2024-05-09T09:55:41.479634+0000","last_became_peered":"2024-05-09T09:55:41.479634+0000","last_unstale":"2024-05-09T09:55:56.706539+0000","last_undegraded":"2024-05-09T09:55:56.706539+0000","last_fullsized":"2024-05-09T09:55:56.706539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:12.037871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401416+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:55:57.401416+0000","last_peered":"2024-05-09T09:55:57.401416+0000","last_clean":"2024-05-09T09:55:57.401416+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:55:57.401416+0000","last_undegraded":"2024-05-09T09:55:57.401416+0000","last_fullsized":"2024-05-09T09:55:57.401416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298448+0000","last_change":"2024-05-09T09:55:10.503163+0000","last_active":"2024-05-09T09:55:57.298448+0000","last_peered":"2024-05-09T09:55:57.298448+0000","last_clean":"2024-05-09T09:55:57.298448+0000","last_became_active":"2024-05-09T09:55:10.501658+0000","last_became_peered":"2024-05-09T09:55:10.501658+0000","last_unstale":"2024-05-09T09:55:57.298448+0000","last_undegraded":"2024-05-09T09:55:57.298448+0000","last_fullsized":"2024-05-09T09:55:57.298448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:16.963610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704206+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:55:56.704206+0000","last_peered":"2024-05-09T09:55:56.704206+0000","last_clean":"2024-05-09T09:55:56.704206+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:55:56.704206+0000","last_undegraded":"2024-05-09T09:55:56.704206+0000","last_fullsized":"2024-05-09T09:55:56.704206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299020+0000","last_change":"2024-05-09T09:55:41.514105+0000","last_active":"2024-05-09T09:55:57.299020+0000","last_peered":"2024-05-09T09:55:57.299020+0000","last_clean":"2024-05-09T09:55:57.299020+0000","last_became_active":"2024-05-09T09:55:41.513454+0000","last_became_peered":"2024-05-09T09:55:41.513454+0000","last_unstale":"2024-05-09T09:55:57.299020+0000","last_undegraded":"2024-05-09T09:55:57.299020+0000","last_fullsized":"2024-05-09T09:55:57.299020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:12.201246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014983+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:55:58.014983+0000","last_peered":"2024-05-09T09:55:58.014983+0000","last_clean":"2024-05-09T09:55:58.014983+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:55:58.014983+0000","last_undegraded":"2024-05-09T09:55:58.014983+0000","last_fullsized":"2024-05-09T09:55:58.014983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401371+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:55:57.401371+0000","last_peered":"2024-05-09T09:55:57.401371+0000","last_clean":"2024-05-09T09:55:57.401371+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:55:57.401371+0000","last_undegraded":"2024-05-09T09:55:57.401371+0000","last_fullsized":"2024-05-09T09:55:57.401371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'10","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013595+0000","last_change":"2024-05-09T09:55:10.921973+0000","last_active":"2024-05-09T09:55:58.013595+0000","last_peered":"2024-05-09T09:55:58.013595+0000","last_clean":"2024-05-09T09:55:58.013595+0000","last_became_active":"2024-05-09T09:55:10.505428+0000","last_became_peered":"2024-05-09T09:55:10.505428+0000","last_unstale":"2024-05-09T09:55:58.013595+0000","last_undegraded":"2024-05-09T09:55:58.013595+0000","last_fullsized":"2024-05-09T09:55:58.013595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:11.081894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017491+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:55:58.017491+0000","last_peered":"2024-05-09T09:55:58.017491+0000","last_clean":"2024-05-09T09:55:58.017491+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:55:58.017491+0000","last_undegraded":"2024-05-09T09:55:58.017491+0000","last_fullsized":"2024-05-09T09:55:58.017491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'36","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402785+0000","last_change":"2024-05-09T09:55:11.706091+0000","last_active":"2024-05-09T09:55:57.402785+0000","last_peered":"2024-05-09T09:55:57.402785+0000","last_clean":"2024-05-09T09:55:57.402785+0000","last_became_active":"2024-05-09T09:55:10.522989+0000","last_became_peered":"2024-05-09T09:55:10.522989+0000","last_unstale":"2024-05-09T09:55:57.402785+0000","last_undegraded":"2024-05-09T09:55:57.402785+0000","last_fullsized":"2024-05-09T09:55:57.402785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:21.617588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":11272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706558+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:55:56.706558+0000","last_peered":"2024-05-09T09:55:56.706558+0000","last_clean":"2024-05-09T09:55:56.706558+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:55:56.706558+0000","last_undegraded":"2024-05-09T09:55:56.706558+0000","last_fullsized":"2024-05-09T09:55:56.706558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297460+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:55:57.297460+0000","last_peered":"2024-05-09T09:55:57.297460+0000","last_clean":"2024-05-09T09:55:57.297460+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:55:57.297460+0000","last_undegraded":"2024-05-09T09:55:57.297460+0000","last_fullsized":"2024-05-09T09:55:57.297460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706199+0000","last_change":"2024-05-09T09:53:54.476843+0000","last_active":"2024-05-09T09:55:56.706199+0000","last_peered":"2024-05-09T09:55:56.706199+0000","last_clean":"2024-05-09T09:55:56.706199+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:55:56.706199+0000","last_undegraded":"2024-05-09T09:55:56.706199+0000","last_fullsized":"2024-05-09T09:55:56.706199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:48.486905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015011+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:55:58.015011+0000","last_peered":"2024-05-09T09:55:58.015011+0000","last_clean":"2024-05-09T09:55:58.015011+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:55:58.015011+0000","last_undegraded":"2024-05-09T09:55:58.015011+0000","last_fullsized":"2024-05-09T09:55:58.015011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701698+0000","last_change":"2024-05-09T09:55:42.599407+0000","last_active":"2024-05-09T09:55:56.701698+0000","last_peered":"2024-05-09T09:55:56.701698+0000","last_clean":"2024-05-09T09:55:56.701698+0000","last_became_active":"2024-05-09T09:55:41.489210+0000","last_became_peered":"2024-05-09T09:55:41.489210+0000","last_unstale":"2024-05-09T09:55:56.701698+0000","last_undegraded":"2024-05-09T09:55:56.701698+0000","last_fullsized":"2024-05-09T09:55:56.701698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:36:38.674440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":7,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402446+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:55:57.402446+0000","last_peered":"2024-05-09T09:55:57.402446+0000","last_clean":"2024-05-09T09:55:57.402446+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:55:57.402446+0000","last_undegraded":"2024-05-09T09:55:57.402446+0000","last_fullsized":"2024-05-09T09:55:57.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'60","reported_seq":266,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703266+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:55:56.703266+0000","last_peered":"2024-05-09T09:55:56.703266+0000","last_clean":"2024-05-09T09:55:56.703266+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:55:56.703266+0000","last_undegraded":"2024-05-09T09:55:56.703266+0000","last_fullsized":"2024-05-09T09:55:56.703266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26264,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":86,"num_read_kb":110,"num_write":58,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018988+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:55:58.018988+0000","last_peered":"2024-05-09T09:55:58.018988+0000","last_clean":"2024-05-09T09:55:58.018988+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:55:58.018988+0000","last_undegraded":"2024-05-09T09:55:58.018988+0000","last_fullsized":"2024-05-09T09:55:58.018988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704712+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:55:56.704712+0000","last_peered":"2024-05-09T09:55:56.704712+0000","last_clean":"2024-05-09T09:55:56.704712+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:55:56.704712+0000","last_undegraded":"2024-05-09T09:55:56.704712+0000","last_fullsized":"2024-05-09T09:55:56.704712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'46","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704619+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:55:56.704619+0000","last_peered":"2024-05-09T09:55:56.704619+0000","last_clean":"2024-05-09T09:55:56.704619+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:55:56.704619+0000","last_undegraded":"2024-05-09T09:55:56.704619+0000","last_fullsized":"2024-05-09T09:55:56.704619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512113+0000","last_change":"2024-05-09T09:55:10.500785+0000","last_active":"2024-05-09T09:55:57.512113+0000","last_peered":"2024-05-09T09:55:57.512113+0000","last_clean":"2024-05-09T09:55:57.512113+0000","last_became_active":"2024-05-09T09:55:10.500197+0000","last_became_peered":"2024-05-09T09:55:10.500197+0000","last_unstale":"2024-05-09T09:55:57.512113+0000","last_undegraded":"2024-05-09T09:55:57.512113+0000","last_fullsized":"2024-05-09T09:55:57.512113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:17.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700597+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:55:56.700597+0000","last_peered":"2024-05-09T09:55:56.700597+0000","last_clean":"2024-05-09T09:55:56.700597+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:55:56.700597+0000","last_undegraded":"2024-05-09T09:55:56.700597+0000","last_fullsized":"2024-05-09T09:55:56.700597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513015+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:55:57.513015+0000","last_peered":"2024-05-09T09:55:57.513015+0000","last_clean":"2024-05-09T09:55:57.513015+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:55:57.513015+0000","last_undegraded":"2024-05-09T09:55:57.513015+0000","last_fullsized":"2024-05-09T09:55:57.513015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018568+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:55:58.018568+0000","last_peered":"2024-05-09T09:55:58.018568+0000","last_clean":"2024-05-09T09:55:58.018568+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:55:58.018568+0000","last_undegraded":"2024-05-09T09:55:58.018568+0000","last_fullsized":"2024-05-09T09:55:58.018568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704334+0000","last_change":"2024-05-09T09:55:41.486659+0000","last_active":"2024-05-09T09:55:56.704334+0000","last_peered":"2024-05-09T09:55:56.704334+0000","last_clean":"2024-05-09T09:55:56.704334+0000","last_became_active":"2024-05-09T09:55:41.486383+0000","last_became_peered":"2024-05-09T09:55:41.486383+0000","last_unstale":"2024-05-09T09:55:56.704334+0000","last_undegraded":"2024-05-09T09:55:56.704334+0000","last_fullsized":"2024-05-09T09:55:56.704334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:13.922715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"75'2","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013230+0000","last_change":"2024-05-09T09:55:44.856823+0000","last_active":"2024-05-09T09:55:58.013230+0000","last_peered":"2024-05-09T09:55:58.013230+0000","last_clean":"2024-05-09T09:55:58.013230+0000","last_became_active":"2024-05-09T09:55:41.512553+0000","last_became_peered":"2024-05-09T09:55:41.512553+0000","last_unstale":"2024-05-09T09:55:58.013230+0000","last_undegraded":"2024-05-09T09:55:58.013230+0000","last_fullsized":"2024-05-09T09:55:58.013230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401767+0000","last_change":"2024-05-09T09:54:55.401865+0000","last_active":"2024-05-09T09:55:57.401767+0000","last_peered":"2024-05-09T09:55:57.401767+0000","last_clean":"2024-05-09T09:55:57.401767+0000","last_became_active":"2024-05-09T09:54:55.401038+0000","last_became_peered":"2024-05-09T09:54:55.401038+0000","last_unstale":"2024-05-09T09:55:57.401767+0000","last_undegraded":"2024-05-09T09:55:57.401767+0000","last_fullsized":"2024-05-09T09:55:57.401767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:01.972187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399656+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:55:57.399656+0000","last_peered":"2024-05-09T09:55:57.399656+0000","last_clean":"2024-05-09T09:55:57.399656+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:55:57.399656+0000","last_undegraded":"2024-05-09T09:55:57.399656+0000","last_fullsized":"2024-05-09T09:55:57.399656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705226+0000","last_change":"2024-05-09T09:55:41.719143+0000","last_active":"2024-05-09T09:55:56.705226+0000","last_peered":"2024-05-09T09:55:56.705226+0000","last_clean":"2024-05-09T09:55:56.705226+0000","last_became_active":"2024-05-09T09:55:41.469663+0000","last_became_peered":"2024-05-09T09:55:41.469663+0000","last_unstale":"2024-05-09T09:55:56.705226+0000","last_undegraded":"2024-05-09T09:55:56.705226+0000","last_fullsized":"2024-05-09T09:55:56.705226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:45.753913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705749+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:55:56.705749+0000","last_peered":"2024-05-09T09:55:56.705749+0000","last_clean":"2024-05-09T09:55:56.705749+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:55:56.705749+0000","last_undegraded":"2024-05-09T09:55:56.705749+0000","last_fullsized":"2024-05-09T09:55:56.705749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015389+0000","last_change":"2024-05-09T09:55:42.823551+0000","last_active":"2024-05-09T09:55:58.015389+0000","last_peered":"2024-05-09T09:55:58.015389+0000","last_clean":"2024-05-09T09:55:58.015389+0000","last_became_active":"2024-05-09T09:55:41.504368+0000","last_became_peered":"2024-05-09T09:55:41.504368+0000","last_unstale":"2024-05-09T09:55:58.015389+0000","last_undegraded":"2024-05-09T09:55:58.015389+0000","last_fullsized":"2024-05-09T09:55:58.015389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:38.841317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299096+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:55:57.299096+0000","last_peered":"2024-05-09T09:55:57.299096+0000","last_clean":"2024-05-09T09:55:57.299096+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:55:57.299096+0000","last_undegraded":"2024-05-09T09:55:57.299096+0000","last_fullsized":"2024-05-09T09:55:57.299096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400161+0000","last_change":"2024-05-09T09:55:10.495545+0000","last_active":"2024-05-09T09:55:57.400161+0000","last_peered":"2024-05-09T09:55:57.400161+0000","last_clean":"2024-05-09T09:55:57.400161+0000","last_became_active":"2024-05-09T09:55:10.494741+0000","last_became_peered":"2024-05-09T09:55:10.494741+0000","last_unstale":"2024-05-09T09:55:57.400161+0000","last_undegraded":"2024-05-09T09:55:57.400161+0000","last_fullsized":"2024-05-09T09:55:57.400161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:36.220917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703539+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:55:56.703539+0000","last_peered":"2024-05-09T09:55:56.703539+0000","last_clean":"2024-05-09T09:55:56.703539+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:55:56.703539+0000","last_undegraded":"2024-05-09T09:55:56.703539+0000","last_fullsized":"2024-05-09T09:55:56.703539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'13","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402554+0000","last_change":"2024-05-09T09:55:10.791937+0000","last_active":"2024-05-09T09:55:57.402554+0000","last_peered":"2024-05-09T09:55:57.402554+0000","last_clean":"2024-05-09T09:55:57.402554+0000","last_became_active":"2024-05-09T09:55:10.494626+0000","last_became_peered":"2024-05-09T09:55:10.494626+0000","last_unstale":"2024-05-09T09:55:57.402554+0000","last_undegraded":"2024-05-09T09:55:57.402554+0000","last_fullsized":"2024-05-09T09:55:57.402554+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:06:49.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702746+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:55:56.702746+0000","last_peered":"2024-05-09T09:55:56.702746+0000","last_clean":"2024-05-09T09:55:56.702746+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:55:56.702746+0000","last_undegraded":"2024-05-09T09:55:56.702746+0000","last_fullsized":"2024-05-09T09:55:56.702746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704736+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:55:56.704736+0000","last_peered":"2024-05-09T09:55:56.704736+0000","last_clean":"2024-05-09T09:55:56.704736+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:55:56.704736+0000","last_undegraded":"2024-05-09T09:55:56.704736+0000","last_fullsized":"2024-05-09T09:55:56.704736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'32","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700571+0000","last_change":"2024-05-09T09:55:10.807327+0000","last_active":"2024-05-09T09:55:56.700571+0000","last_peered":"2024-05-09T09:55:56.700571+0000","last_clean":"2024-05-09T09:55:56.700571+0000","last_became_active":"2024-05-09T09:55:10.495540+0000","last_became_peered":"2024-05-09T09:55:10.495540+0000","last_unstale":"2024-05-09T09:55:56.700571+0000","last_undegraded":"2024-05-09T09:55:56.700571+0000","last_fullsized":"2024-05-09T09:55:56.700571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:01.735473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":3221,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704004+0000","last_change":"2024-05-09T09:55:41.499842+0000","last_active":"2024-05-09T09:55:56.704004+0000","last_peered":"2024-05-09T09:55:56.704004+0000","last_clean":"2024-05-09T09:55:56.704004+0000","last_became_active":"2024-05-09T09:55:41.496466+0000","last_became_peered":"2024-05-09T09:55:41.496466+0000","last_unstale":"2024-05-09T09:55:56.704004+0000","last_undegraded":"2024-05-09T09:55:56.704004+0000","last_fullsized":"2024-05-09T09:55:56.704004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:35.612226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706873+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:55:56.706873+0000","last_peered":"2024-05-09T09:55:56.706873+0000","last_clean":"2024-05-09T09:55:56.706873+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:55:56.706873+0000","last_undegraded":"2024-05-09T09:55:56.706873+0000","last_fullsized":"2024-05-09T09:55:56.706873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705288+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:55:56.705288+0000","last_peered":"2024-05-09T09:55:56.705288+0000","last_clean":"2024-05-09T09:55:56.705288+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:55:56.705288+0000","last_undegraded":"2024-05-09T09:55:56.705288+0000","last_fullsized":"2024-05-09T09:55:56.705288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702837+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:55:56.702837+0000","last_peered":"2024-05-09T09:55:56.702837+0000","last_clean":"2024-05-09T09:55:56.702837+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:55:56.702837+0000","last_undegraded":"2024-05-09T09:55:56.702837+0000","last_fullsized":"2024-05-09T09:55:56.702837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":22546,"num_write":39,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015491+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:55:58.015491+0000","last_peered":"2024-05-09T09:55:58.015491+0000","last_clean":"2024-05-09T09:55:58.015491+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:55:58.015491+0000","last_undegraded":"2024-05-09T09:55:58.015491+0000","last_fullsized":"2024-05-09T09:55:58.015491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298282+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:55:57.298282+0000","last_peered":"2024-05-09T09:55:57.298282+0000","last_clean":"2024-05-09T09:55:57.298282+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:55:57.298282+0000","last_undegraded":"2024-05-09T09:55:57.298282+0000","last_fullsized":"2024-05-09T09:55:57.298282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702821+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:55:56.702821+0000","last_peered":"2024-05-09T09:55:56.702821+0000","last_clean":"2024-05-09T09:55:56.702821+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:55:56.702821+0000","last_undegraded":"2024-05-09T09:55:56.702821+0000","last_fullsized":"2024-05-09T09:55:56.702821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'15","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400649+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:55:57.400649+0000","last_peered":"2024-05-09T09:55:57.400649+0000","last_clean":"2024-05-09T09:55:57.400649+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:55:57.400649+0000","last_undegraded":"2024-05-09T09:55:57.400649+0000","last_fullsized":"2024-05-09T09:55:57.400649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018320+0000","last_change":"2024-05-09T09:55:10.517397+0000","last_active":"2024-05-09T09:55:58.018320+0000","last_peered":"2024-05-09T09:55:58.018320+0000","last_clean":"2024-05-09T09:55:58.018320+0000","last_became_active":"2024-05-09T09:55:10.515588+0000","last_became_peered":"2024-05-09T09:55:10.515588+0000","last_unstale":"2024-05-09T09:55:58.018320+0000","last_undegraded":"2024-05-09T09:55:58.018320+0000","last_fullsized":"2024-05-09T09:55:58.018320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:07.130003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"75'44","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015984+0000","last_change":"2024-05-09T09:55:11.515278+0000","last_active":"2024-05-09T09:55:58.015984+0000","last_peered":"2024-05-09T09:55:58.015984+0000","last_clean":"2024-05-09T09:55:58.015984+0000","last_became_active":"2024-05-09T09:55:10.518766+0000","last_became_peered":"2024-05-09T09:55:10.518766+0000","last_unstale":"2024-05-09T09:55:58.015984+0000","last_undegraded":"2024-05-09T09:55:58.015984+0000","last_fullsized":"2024-05-09T09:55:58.015984+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:19.443320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":112,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'13","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018454+0000","last_change":"2024-05-09T09:55:11.060481+0000","last_active":"2024-05-09T09:55:58.018454+0000","last_peered":"2024-05-09T09:55:58.018454+0000","last_clean":"2024-05-09T09:55:58.018454+0000","last_became_active":"2024-05-09T09:55:10.509265+0000","last_became_peered":"2024-05-09T09:55:10.509265+0000","last_unstale":"2024-05-09T09:55:58.018454+0000","last_undegraded":"2024-05-09T09:55:58.018454+0000","last_fullsized":"2024-05-09T09:55:58.018454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:58:29.838618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":16398,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704209+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:55:56.704209+0000","last_peered":"2024-05-09T09:55:56.704209+0000","last_clean":"2024-05-09T09:55:56.704209+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:55:56.704209+0000","last_undegraded":"2024-05-09T09:55:56.704209+0000","last_fullsized":"2024-05-09T09:55:56.704209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704461+0000","last_change":"2024-05-09T09:55:41.502710+0000","last_active":"2024-05-09T09:55:56.704461+0000","last_peered":"2024-05-09T09:55:56.704461+0000","last_clean":"2024-05-09T09:55:56.704461+0000","last_became_active":"2024-05-09T09:55:41.498766+0000","last_became_peered":"2024-05-09T09:55:41.498766+0000","last_unstale":"2024-05-09T09:55:56.704461+0000","last_undegraded":"2024-05-09T09:55:56.704461+0000","last_fullsized":"2024-05-09T09:55:56.704461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:11.800372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705353+0000","last_change":"2024-05-09T09:55:42.422831+0000","last_active":"2024-05-09T09:55:56.705353+0000","last_peered":"2024-05-09T09:55:56.705353+0000","last_clean":"2024-05-09T09:55:56.705353+0000","last_became_active":"2024-05-09T09:55:41.513003+0000","last_became_peered":"2024-05-09T09:55:41.513003+0000","last_unstale":"2024-05-09T09:55:56.705353+0000","last_undegraded":"2024-05-09T09:55:56.705353+0000","last_fullsized":"2024-05-09T09:55:56.705353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:07.499148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'18","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016568+0000","last_change":"2024-05-09T09:55:10.808760+0000","last_active":"2024-05-09T09:55:58.016568+0000","last_peered":"2024-05-09T09:55:58.016568+0000","last_clean":"2024-05-09T09:55:58.016568+0000","last_became_active":"2024-05-09T09:55:10.505477+0000","last_became_peered":"2024-05-09T09:55:10.505477+0000","last_unstale":"2024-05-09T09:55:58.016568+0000","last_undegraded":"2024-05-09T09:55:58.016568+0000","last_fullsized":"2024-05-09T09:55:58.016568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:21.462968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704510+0000","last_change":"2024-05-09T09:55:10.495913+0000","last_active":"2024-05-09T09:55:56.704510+0000","last_peered":"2024-05-09T09:55:56.704510+0000","last_clean":"2024-05-09T09:55:56.704510+0000","last_became_active":"2024-05-09T09:55:10.494445+0000","last_became_peered":"2024-05-09T09:55:10.494445+0000","last_unstale":"2024-05-09T09:55:56.704510+0000","last_undegraded":"2024-05-09T09:55:56.704510+0000","last_fullsized":"2024-05-09T09:55:56.704510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:58.669871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'10","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704782+0000","last_change":"2024-05-09T09:55:42.207577+0000","last_active":"2024-05-09T09:55:56.704782+0000","last_peered":"2024-05-09T09:55:56.704782+0000","last_clean":"2024-05-09T09:55:56.704782+0000","last_became_active":"2024-05-09T09:55:41.480316+0000","last_became_peered":"2024-05-09T09:55:41.480316+0000","last_unstale":"2024-05-09T09:55:56.704782+0000","last_undegraded":"2024-05-09T09:55:56.704782+0000","last_fullsized":"2024-05-09T09:55:56.704782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705886+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:55:56.705886+0000","last_peered":"2024-05-09T09:55:56.705886+0000","last_clean":"2024-05-09T09:55:56.705886+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:55:56.705886+0000","last_undegraded":"2024-05-09T09:55:56.705886+0000","last_fullsized":"2024-05-09T09:55:56.705886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299647+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:55:57.299647+0000","last_peered":"2024-05-09T09:55:57.299647+0000","last_clean":"2024-05-09T09:55:57.299647+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:55:57.299647+0000","last_undegraded":"2024-05-09T09:55:57.299647+0000","last_fullsized":"2024-05-09T09:55:57.299647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015902+0000","last_change":"2024-05-09T09:55:10.517926+0000","last_active":"2024-05-09T09:55:58.015902+0000","last_peered":"2024-05-09T09:55:58.015902+0000","last_clean":"2024-05-09T09:55:58.015902+0000","last_became_active":"2024-05-09T09:55:10.505544+0000","last_became_peered":"2024-05-09T09:55:10.505544+0000","last_unstale":"2024-05-09T09:55:58.015902+0000","last_undegraded":"2024-05-09T09:55:58.015902+0000","last_fullsized":"2024-05-09T09:55:58.015902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:13.161392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'38","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016660+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:55:58.016660+0000","last_peered":"2024-05-09T09:55:58.016660+0000","last_clean":"2024-05-09T09:55:58.016660+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:55:58.016660+0000","last_undegraded":"2024-05-09T09:55:58.016660+0000","last_fullsized":"2024-05-09T09:55:58.016660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":51,"num_write":36,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013580+0000","last_change":"2024-05-09T09:55:10.498516+0000","last_active":"2024-05-09T09:55:58.013580+0000","last_peered":"2024-05-09T09:55:58.013580+0000","last_clean":"2024-05-09T09:55:58.013580+0000","last_became_active":"2024-05-09T09:55:10.498080+0000","last_became_peered":"2024-05-09T09:55:10.498080+0000","last_unstale":"2024-05-09T09:55:58.013580+0000","last_undegraded":"2024-05-09T09:55:58.013580+0000","last_fullsized":"2024-05-09T09:55:58.013580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:21.659232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'2","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401538+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:55:57.401538+0000","last_peered":"2024-05-09T09:55:57.401538+0000","last_clean":"2024-05-09T09:55:57.401538+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:55:57.401538+0000","last_undegraded":"2024-05-09T09:55:57.401538+0000","last_fullsized":"2024-05-09T09:55:57.401538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706114+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:55:56.706114+0000","last_peered":"2024-05-09T09:55:56.706114+0000","last_clean":"2024-05-09T09:55:56.706114+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:55:56.706114+0000","last_undegraded":"2024-05-09T09:55:56.706114+0000","last_fullsized":"2024-05-09T09:55:56.706114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704880+0000","last_change":"2024-05-09T09:55:42.429944+0000","last_active":"2024-05-09T09:55:56.704880+0000","last_peered":"2024-05-09T09:55:56.704880+0000","last_clean":"2024-05-09T09:55:56.704880+0000","last_became_active":"2024-05-09T09:55:41.516290+0000","last_became_peered":"2024-05-09T09:55:41.516290+0000","last_unstale":"2024-05-09T09:55:56.704880+0000","last_undegraded":"2024-05-09T09:55:56.704880+0000","last_fullsized":"2024-05-09T09:55:56.704880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:59.070546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706067+0000","last_change":"2024-05-09T09:55:42.380229+0000","last_active":"2024-05-09T09:55:56.706067+0000","last_peered":"2024-05-09T09:55:56.706067+0000","last_clean":"2024-05-09T09:55:56.706067+0000","last_became_active":"2024-05-09T09:55:41.489973+0000","last_became_peered":"2024-05-09T09:55:41.489973+0000","last_unstale":"2024-05-09T09:55:56.706067+0000","last_undegraded":"2024-05-09T09:55:56.706067+0000","last_fullsized":"2024-05-09T09:55:56.706067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":30736,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703216+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:55:56.703216+0000","last_peered":"2024-05-09T09:55:56.703216+0000","last_clean":"2024-05-09T09:55:56.703216+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:55:56.703216+0000","last_undegraded":"2024-05-09T09:55:56.703216+0000","last_fullsized":"2024-05-09T09:55:56.703216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"73'19","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013249+0000","last_change":"2024-05-09T09:55:10.932387+0000","last_active":"2024-05-09T09:55:58.013249+0000","last_peered":"2024-05-09T09:55:58.013249+0000","last_clean":"2024-05-09T09:55:58.013249+0000","last_became_active":"2024-05-09T09:55:10.507307+0000","last_became_peered":"2024-05-09T09:55:10.507307+0000","last_unstale":"2024-05-09T09:55:58.013249+0000","last_undegraded":"2024-05-09T09:55:58.013249+0000","last_fullsized":"2024-05-09T09:55:58.013249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:44.904375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":29,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016206+0000","last_change":"2024-05-09T09:55:10.519133+0000","last_active":"2024-05-09T09:55:58.016206+0000","last_peered":"2024-05-09T09:55:58.016206+0000","last_clean":"2024-05-09T09:55:58.016206+0000","last_became_active":"2024-05-09T09:55:10.518305+0000","last_became_peered":"2024-05-09T09:55:10.518305+0000","last_unstale":"2024-05-09T09:55:58.016206+0000","last_undegraded":"2024-05-09T09:55:58.016206+0000","last_fullsized":"2024-05-09T09:55:58.016206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:56.110070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018014+0000","last_change":"2024-05-09T09:55:10.505287+0000","last_active":"2024-05-09T09:55:58.018014+0000","last_peered":"2024-05-09T09:55:58.018014+0000","last_clean":"2024-05-09T09:55:58.018014+0000","last_became_active":"2024-05-09T09:55:10.504822+0000","last_became_peered":"2024-05-09T09:55:10.504822+0000","last_unstale":"2024-05-09T09:55:58.018014+0000","last_undegraded":"2024-05-09T09:55:58.018014+0000","last_fullsized":"2024-05-09T09:55:58.018014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:26.980095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016322+0000","last_change":"2024-05-09T09:54:55.399423+0000","last_active":"2024-05-09T09:55:58.016322+0000","last_peered":"2024-05-09T09:55:58.016322+0000","last_clean":"2024-05-09T09:55:58.016322+0000","last_became_active":"2024-05-09T09:54:55.398970+0000","last_became_peered":"2024-05-09T09:54:55.398970+0000","last_unstale":"2024-05-09T09:55:58.016322+0000","last_undegraded":"2024-05-09T09:55:58.016322+0000","last_fullsized":"2024-05-09T09:55:58.016322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"75'10","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017670+0000","last_change":"2024-05-09T09:55:10.626412+0000","last_active":"2024-05-09T09:55:58.017670+0000","last_peered":"2024-05-09T09:55:58.017670+0000","last_clean":"2024-05-09T09:55:58.017670+0000","last_became_active":"2024-05-09T09:55:10.499847+0000","last_became_peered":"2024-05-09T09:55:10.499847+0000","last_unstale":"2024-05-09T09:55:58.017670+0000","last_undegraded":"2024-05-09T09:55:58.017670+0000","last_fullsized":"2024-05-09T09:55:58.017670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016797+0000","last_change":"2024-05-09T09:55:10.508325+0000","last_active":"2024-05-09T09:55:58.016797+0000","last_peered":"2024-05-09T09:55:58.016797+0000","last_clean":"2024-05-09T09:55:58.016797+0000","last_became_active":"2024-05-09T09:55:10.506831+0000","last_became_peered":"2024-05-09T09:55:10.506831+0000","last_unstale":"2024-05-09T09:55:58.016797+0000","last_undegraded":"2024-05-09T09:55:58.016797+0000","last_fullsized":"2024-05-09T09:55:58.016797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:03.449411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700895+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:55:56.700895+0000","last_peered":"2024-05-09T09:55:56.700895+0000","last_clean":"2024-05-09T09:55:56.700895+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:55:56.700895+0000","last_undegraded":"2024-05-09T09:55:56.700895+0000","last_fullsized":"2024-05-09T09:55:56.700895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017129+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:55:58.017129+0000","last_peered":"2024-05-09T09:55:58.017129+0000","last_clean":"2024-05-09T09:55:58.017129+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:55:58.017129+0000","last_undegraded":"2024-05-09T09:55:58.017129+0000","last_fullsized":"2024-05-09T09:55:58.017129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700775+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:55:56.700775+0000","last_peered":"2024-05-09T09:55:56.700775+0000","last_clean":"2024-05-09T09:55:56.700775+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:55:56.700775+0000","last_undegraded":"2024-05-09T09:55:56.700775+0000","last_fullsized":"2024-05-09T09:55:56.700775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013446+0000","last_change":"2024-05-09T09:55:10.514293+0000","last_active":"2024-05-09T09:55:58.013446+0000","last_peered":"2024-05-09T09:55:58.013446+0000","last_clean":"2024-05-09T09:55:58.013446+0000","last_became_active":"2024-05-09T09:55:10.513915+0000","last_became_peered":"2024-05-09T09:55:10.513915+0000","last_unstale":"2024-05-09T09:55:58.013446+0000","last_undegraded":"2024-05-09T09:55:58.013446+0000","last_fullsized":"2024-05-09T09:55:58.013446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:03.485055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"66'9","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402201+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:55:57.402201+0000","last_peered":"2024-05-09T09:55:57.402201+0000","last_clean":"2024-05-09T09:55:57.402201+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:55:57.402201+0000","last_undegraded":"2024-05-09T09:55:57.402201+0000","last_fullsized":"2024-05-09T09:55:57.402201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015455+0000","last_change":"2024-05-09T09:55:42.066725+0000","last_active":"2024-05-09T09:55:58.015455+0000","last_peered":"2024-05-09T09:55:58.015455+0000","last_clean":"2024-05-09T09:55:58.015455+0000","last_became_active":"2024-05-09T09:55:41.506927+0000","last_became_peered":"2024-05-09T09:55:41.506927+0000","last_unstale":"2024-05-09T09:55:58.015455+0000","last_undegraded":"2024-05-09T09:55:58.015455+0000","last_fullsized":"2024-05-09T09:55:58.015455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'21","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016885+0000","last_change":"2024-05-09T09:55:11.122289+0000","last_active":"2024-05-09T09:55:58.016885+0000","last_peered":"2024-05-09T09:55:58.016885+0000","last_clean":"2024-05-09T09:55:58.016885+0000","last_became_active":"2024-05-09T09:55:10.507511+0000","last_became_peered":"2024-05-09T09:55:10.507511+0000","last_unstale":"2024-05-09T09:55:58.016885+0000","last_undegraded":"2024-05-09T09:55:58.016885+0000","last_fullsized":"2024-05-09T09:55:58.016885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:29.227840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12481,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":39,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297997+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:55:57.297997+0000","last_peered":"2024-05-09T09:55:57.297997+0000","last_clean":"2024-05-09T09:55:57.297997+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:55:57.297997+0000","last_undegraded":"2024-05-09T09:55:57.297997+0000","last_fullsized":"2024-05-09T09:55:57.297997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401098+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:55:57.401098+0000","last_peered":"2024-05-09T09:55:57.401098+0000","last_clean":"2024-05-09T09:55:57.401098+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:55:57.401098+0000","last_undegraded":"2024-05-09T09:55:57.401098+0000","last_fullsized":"2024-05-09T09:55:57.401098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'38","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015759+0000","last_change":"2024-05-09T09:55:11.526822+0000","last_active":"2024-05-09T09:55:58.015759+0000","last_peered":"2024-05-09T09:55:58.015759+0000","last_clean":"2024-05-09T09:55:58.015759+0000","last_became_active":"2024-05-09T09:55:10.520941+0000","last_became_peered":"2024-05-09T09:55:10.520941+0000","last_unstale":"2024-05-09T09:55:58.015759+0000","last_undegraded":"2024-05-09T09:55:58.015759+0000","last_fullsized":"2024-05-09T09:55:58.015759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:25.981081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706483+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:55:56.706483+0000","last_peered":"2024-05-09T09:55:56.706483+0000","last_clean":"2024-05-09T09:55:56.706483+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:55:56.706483+0000","last_undegraded":"2024-05-09T09:55:56.706483+0000","last_fullsized":"2024-05-09T09:55:56.706483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298179+0000","last_change":"2024-05-09T09:55:41.515909+0000","last_active":"2024-05-09T09:55:57.298179+0000","last_peered":"2024-05-09T09:55:57.298179+0000","last_clean":"2024-05-09T09:55:57.298179+0000","last_became_active":"2024-05-09T09:55:41.514849+0000","last_became_peered":"2024-05-09T09:55:41.514849+0000","last_unstale":"2024-05-09T09:55:57.298179+0000","last_undegraded":"2024-05-09T09:55:57.298179+0000","last_fullsized":"2024-05-09T09:55:57.298179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:02.137573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"73'15","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016535+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:55:58.016535+0000","last_peered":"2024-05-09T09:55:58.016535+0000","last_clean":"2024-05-09T09:55:58.016535+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:55:58.016535+0000","last_undegraded":"2024-05-09T09:55:58.016535+0000","last_fullsized":"2024-05-09T09:55:58.016535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703964+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:55:56.703964+0000","last_peered":"2024-05-09T09:55:56.703964+0000","last_clean":"2024-05-09T09:55:56.703964+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:55:56.703964+0000","last_undegraded":"2024-05-09T09:55:56.703964+0000","last_fullsized":"2024-05-09T09:55:56.703964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299559+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:55:57.299559+0000","last_peered":"2024-05-09T09:55:57.299559+0000","last_clean":"2024-05-09T09:55:57.299559+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:55:57.299559+0000","last_undegraded":"2024-05-09T09:55:57.299559+0000","last_fullsized":"2024-05-09T09:55:57.299559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"67'11","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511830+0000","last_change":"2024-05-09T09:55:55.809479+0000","last_active":"2024-05-09T09:55:57.511830+0000","last_peered":"2024-05-09T09:55:57.511830+0000","last_clean":"2024-05-09T09:55:57.511830+0000","last_became_active":"2024-05-09T09:55:55.677234+0000","last_became_peered":"2024-05-09T09:55:55.677234+0000","last_unstale":"2024-05-09T09:55:57.511830+0000","last_undegraded":"2024-05-09T09:55:57.511830+0000","last_fullsized":"2024-05-09T09:55:57.511830+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:44.116858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706475+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:55:56.706475+0000","last_peered":"2024-05-09T09:55:56.706475+0000","last_clean":"2024-05-09T09:55:56.706475+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:55:56.706475+0000","last_undegraded":"2024-05-09T09:55:56.706475+0000","last_fullsized":"2024-05-09T09:55:56.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"73'26","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704104+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:55:56.704104+0000","last_peered":"2024-05-09T09:55:56.704104+0000","last_clean":"2024-05-09T09:55:56.704104+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:55:56.704104+0000","last_undegraded":"2024-05-09T09:55:56.704104+0000","last_fullsized":"2024-05-09T09:55:56.704104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401447+0000","last_change":"2024-05-09T09:55:10.495749+0000","last_active":"2024-05-09T09:55:57.401447+0000","last_peered":"2024-05-09T09:55:57.401447+0000","last_clean":"2024-05-09T09:55:57.401447+0000","last_became_active":"2024-05-09T09:55:10.494186+0000","last_became_peered":"2024-05-09T09:55:10.494186+0000","last_unstale":"2024-05-09T09:55:57.401447+0000","last_undegraded":"2024-05-09T09:55:57.401447+0000","last_fullsized":"2024-05-09T09:55:57.401447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:53:44.097211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016703+0000","last_change":"2024-05-09T09:55:10.505728+0000","last_active":"2024-05-09T09:55:58.016703+0000","last_peered":"2024-05-09T09:55:58.016703+0000","last_clean":"2024-05-09T09:55:58.016703+0000","last_became_active":"2024-05-09T09:55:10.504907+0000","last_became_peered":"2024-05-09T09:55:10.504907+0000","last_unstale":"2024-05-09T09:55:58.016703+0000","last_undegraded":"2024-05-09T09:55:58.016703+0000","last_fullsized":"2024-05-09T09:55:58.016703+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:34.895344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706201+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:55:56.706201+0000","last_peered":"2024-05-09T09:55:56.706201+0000","last_clean":"2024-05-09T09:55:56.706201+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:55:56.706201+0000","last_undegraded":"2024-05-09T09:55:56.706201+0000","last_fullsized":"2024-05-09T09:55:56.706201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"67'3","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701843+0000","last_change":"2024-05-09T09:55:10.559316+0000","last_active":"2024-05-09T09:55:56.701843+0000","last_peered":"2024-05-09T09:55:56.701843+0000","last_clean":"2024-05-09T09:55:56.701843+0000","last_became_active":"2024-05-09T09:55:10.497596+0000","last_became_peered":"2024-05-09T09:55:10.497596+0000","last_unstale":"2024-05-09T09:55:56.701843+0000","last_undegraded":"2024-05-09T09:55:56.701843+0000","last_fullsized":"2024-05-09T09:55:56.701843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299240+0000","last_change":"2024-05-09T09:55:41.513826+0000","last_active":"2024-05-09T09:55:57.299240+0000","last_peered":"2024-05-09T09:55:57.299240+0000","last_clean":"2024-05-09T09:55:57.299240+0000","last_became_active":"2024-05-09T09:55:41.513248+0000","last_became_peered":"2024-05-09T09:55:41.513248+0000","last_unstale":"2024-05-09T09:55:57.299240+0000","last_undegraded":"2024-05-09T09:55:57.299240+0000","last_fullsized":"2024-05-09T09:55:57.299240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:15.704381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"73'27","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017080+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:55:58.017080+0000","last_peered":"2024-05-09T09:55:58.017080+0000","last_clean":"2024-05-09T09:55:58.017080+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:55:58.017080+0000","last_undegraded":"2024-05-09T09:55:58.017080+0000","last_fullsized":"2024-05-09T09:55:58.017080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8545,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":54,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703868+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:55:56.703868+0000","last_peered":"2024-05-09T09:55:56.703868+0000","last_clean":"2024-05-09T09:55:56.703868+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:55:56.703868+0000","last_undegraded":"2024-05-09T09:55:56.703868+0000","last_fullsized":"2024-05-09T09:55:56.703868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"63'4","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297673+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:55:57.297673+0000","last_peered":"2024-05-09T09:55:57.297673+0000","last_clean":"2024-05-09T09:55:57.297673+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:55:57.297673+0000","last_undegraded":"2024-05-09T09:55:57.297673+0000","last_fullsized":"2024-05-09T09:55:57.297673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017690+0000","last_change":"2024-05-09T09:55:10.500134+0000","last_active":"2024-05-09T09:55:58.017690+0000","last_peered":"2024-05-09T09:55:58.017690+0000","last_clean":"2024-05-09T09:55:58.017690+0000","last_became_active":"2024-05-09T09:55:10.499690+0000","last_became_peered":"2024-05-09T09:55:10.499690+0000","last_unstale":"2024-05-09T09:55:58.017690+0000","last_undegraded":"2024-05-09T09:55:58.017690+0000","last_fullsized":"2024-05-09T09:55:58.017690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"66'13","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704696+0000","last_change":"2024-05-09T09:55:42.033924+0000","last_active":"2024-05-09T09:55:56.704696+0000","last_peered":"2024-05-09T09:55:56.704696+0000","last_clean":"2024-05-09T09:55:56.704696+0000","last_became_active":"2024-05-09T09:55:41.481073+0000","last_became_peered":"2024-05-09T09:55:41.481073+0000","last_unstale":"2024-05-09T09:55:56.704696+0000","last_undegraded":"2024-05-09T09:55:56.704696+0000","last_fullsized":"2024-05-09T09:55:56.704696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:48.598565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":45062,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706054+0000","last_change":"2024-05-09T09:55:41.513074+0000","last_active":"2024-05-09T09:55:56.706054+0000","last_peered":"2024-05-09T09:55:56.706054+0000","last_clean":"2024-05-09T09:55:56.706054+0000","last_became_active":"2024-05-09T09:55:41.512431+0000","last_became_peered":"2024-05-09T09:55:41.512431+0000","last_unstale":"2024-05-09T09:55:56.706054+0000","last_undegraded":"2024-05-09T09:55:56.706054+0000","last_fullsized":"2024-05-09T09:55:56.706054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:14.565690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"73'20","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018290+0000","last_change":"2024-05-09T09:55:11.526104+0000","last_active":"2024-05-09T09:55:58.018290+0000","last_peered":"2024-05-09T09:55:58.018290+0000","last_clean":"2024-05-09T09:55:58.018290+0000","last_became_active":"2024-05-09T09:55:10.517760+0000","last_became_peered":"2024-05-09T09:55:10.517760+0000","last_unstale":"2024-05-09T09:55:58.018290+0000","last_undegraded":"2024-05-09T09:55:58.018290+0000","last_fullsized":"2024-05-09T09:55:58.018290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:24.084847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":34,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703148+0000","last_change":"2024-05-09T09:55:10.485758+0000","last_active":"2024-05-09T09:55:56.703148+0000","last_peered":"2024-05-09T09:55:56.703148+0000","last_clean":"2024-05-09T09:55:56.703148+0000","last_became_active":"2024-05-09T09:55:10.485167+0000","last_became_peered":"2024-05-09T09:55:10.485167+0000","last_unstale":"2024-05-09T09:55:56.703148+0000","last_undegraded":"2024-05-09T09:55:56.703148+0000","last_fullsized":"2024-05-09T09:55:56.703148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:16.070700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400396+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:55:57.400396+0000","last_peered":"2024-05-09T09:55:57.400396+0000","last_clean":"2024-05-09T09:55:57.400396+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:55:57.400396+0000","last_undegraded":"2024-05-09T09:55:57.400396+0000","last_fullsized":"2024-05-09T09:55:57.400396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511241+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:55:57.511241+0000","last_peered":"2024-05-09T09:55:57.511241+0000","last_clean":"2024-05-09T09:55:57.511241+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:55:57.511241+0000","last_undegraded":"2024-05-09T09:55:57.511241+0000","last_fullsized":"2024-05-09T09:55:57.511241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'10","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704163+0000","last_change":"2024-05-09T09:55:41.638527+0000","last_active":"2024-05-09T09:55:56.704163+0000","last_peered":"2024-05-09T09:55:56.704163+0000","last_clean":"2024-05-09T09:55:56.704163+0000","last_became_active":"2024-05-09T09:55:41.470350+0000","last_became_peered":"2024-05-09T09:55:41.470350+0000","last_unstale":"2024-05-09T09:55:56.704163+0000","last_undegraded":"2024-05-09T09:55:56.704163+0000","last_fullsized":"2024-05-09T09:55:56.704163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:55:41.504749+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:55:41.504290+0000","last_became_peered":"2024-05-09T09:55:41.504290+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706444+0000","last_change":"2024-05-09T09:55:42.568315+0000","last_active":"2024-05-09T09:55:56.706444+0000","last_peered":"2024-05-09T09:55:56.706444+0000","last_clean":"2024-05-09T09:55:56.706444+0000","last_became_active":"2024-05-09T09:55:41.517072+0000","last_became_peered":"2024-05-09T09:55:41.517072+0000","last_unstale":"2024-05-09T09:55:56.706444+0000","last_undegraded":"2024-05-09T09:55:56.706444+0000","last_fullsized":"2024-05-09T09:55:56.706444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:54.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'20","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299420+0000","last_change":"2024-05-09T09:55:44.549663+0000","last_active":"2024-05-09T09:55:57.299420+0000","last_peered":"2024-05-09T09:55:57.299420+0000","last_clean":"2024-05-09T09:55:57.299420+0000","last_became_active":"2024-05-09T09:55:41.514399+0000","last_became_peered":"2024-05-09T09:55:41.514399+0000","last_unstale":"2024-05-09T09:55:57.299420+0000","last_undegraded":"2024-05-09T09:55:57.299420+0000","last_fullsized":"2024-05-09T09:55:57.299420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:46.578164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"63'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015795+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:55:58.015795+0000","last_peered":"2024-05-09T09:55:58.015795+0000","last_clean":"2024-05-09T09:55:58.015795+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:55:58.015795+0000","last_undegraded":"2024-05-09T09:55:58.015795+0000","last_fullsized":"2024-05-09T09:55:58.015795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704832+0000","last_change":"2024-05-09T09:55:41.514279+0000","last_active":"2024-05-09T09:55:56.704832+0000","last_peered":"2024-05-09T09:55:56.704832+0000","last_clean":"2024-05-09T09:55:56.704832+0000","last_became_active":"2024-05-09T09:55:41.513724+0000","last_became_peered":"2024-05-09T09:55:41.513724+0000","last_unstale":"2024-05-09T09:55:56.704832+0000","last_undegraded":"2024-05-09T09:55:56.704832+0000","last_fullsized":"2024-05-09T09:55:56.704832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:53.879426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511499+0000","last_change":"2024-05-09T09:55:42.243360+0000","last_active":"2024-05-09T09:55:57.511499+0000","last_peered":"2024-05-09T09:55:57.511499+0000","last_clean":"2024-05-09T09:55:57.511499+0000","last_became_active":"2024-05-09T09:55:41.495012+0000","last_became_peered":"2024-05-09T09:55:41.495012+0000","last_unstale":"2024-05-09T09:55:57.511499+0000","last_undegraded":"2024-05-09T09:55:57.511499+0000","last_fullsized":"2024-05-09T09:55:57.511499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:55:30.669989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014988+0000","last_change":"2024-05-09T09:55:41.508232+0000","last_active":"2024-05-09T09:55:58.014988+0000","last_peered":"2024-05-09T09:55:58.014988+0000","last_clean":"2024-05-09T09:55:58.014988+0000","last_became_active":"2024-05-09T09:55:41.506905+0000","last_became_peered":"2024-05-09T09:55:41.506905+0000","last_unstale":"2024-05-09T09:55:58.014988+0000","last_undegraded":"2024-05-09T09:55:58.014988+0000","last_fullsized":"2024-05-09T09:55:58.014988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"73'24","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400581+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:55:57.400581+0000","last_peered":"2024-05-09T09:55:57.400581+0000","last_clean":"2024-05-09T09:55:57.400581+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:55:57.400581+0000","last_undegraded":"2024-05-09T09:55:57.400581+0000","last_fullsized":"2024-05-09T09:55:57.400581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701605+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:55:56.701605+0000","last_peered":"2024-05-09T09:55:56.701605+0000","last_clean":"2024-05-09T09:55:56.701605+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:55:56.701605+0000","last_undegraded":"2024-05-09T09:55:56.701605+0000","last_fullsized":"2024-05-09T09:55:56.701605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015572+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:55:58.015572+0000","last_peered":"2024-05-09T09:55:58.015572+0000","last_clean":"2024-05-09T09:55:58.015572+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:55:58.015572+0000","last_undegraded":"2024-05-09T09:55:58.015572+0000","last_fullsized":"2024-05-09T09:55:58.015572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705208+0000","last_change":"2024-05-09T09:55:41.513633+0000","last_active":"2024-05-09T09:55:56.705208+0000","last_peered":"2024-05-09T09:55:56.705208+0000","last_clean":"2024-05-09T09:55:56.705208+0000","last_became_active":"2024-05-09T09:55:41.512176+0000","last_became_peered":"2024-05-09T09:55:41.512176+0000","last_unstale":"2024-05-09T09:55:56.705208+0000","last_undegraded":"2024-05-09T09:55:56.705208+0000","last_fullsized":"2024-05-09T09:55:56.705208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"68'9","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402348+0000","last_change":"2024-05-09T09:55:42.801375+0000","last_active":"2024-05-09T09:55:57.402348+0000","last_peered":"2024-05-09T09:55:57.402348+0000","last_clean":"2024-05-09T09:55:57.402348+0000","last_became_active":"2024-05-09T09:55:41.495260+0000","last_became_peered":"2024-05-09T09:55:41.495260+0000","last_unstale":"2024-05-09T09:55:57.402348+0000","last_undegraded":"2024-05-09T09:55:57.402348+0000","last_fullsized":"2024-05-09T09:55:57.402348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:20.725921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401363+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:55:57.401363+0000","last_peered":"2024-05-09T09:55:57.401363+0000","last_clean":"2024-05-09T09:55:57.401363+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:55:57.401363+0000","last_undegraded":"2024-05-09T09:55:57.401363+0000","last_fullsized":"2024-05-09T09:55:57.401363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"73'13","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701493+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:55:56.701493+0000","last_peered":"2024-05-09T09:55:56.701493+0000","last_clean":"2024-05-09T09:55:56.701493+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:55:56.701493+0000","last_undegraded":"2024-05-09T09:55:56.701493+0000","last_fullsized":"2024-05-09T09:55:56.701493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297877+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:55:57.297877+0000","last_peered":"2024-05-09T09:55:57.297877+0000","last_clean":"2024-05-09T09:55:57.297877+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:55:57.297877+0000","last_undegraded":"2024-05-09T09:55:57.297877+0000","last_fullsized":"2024-05-09T09:55:57.297877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017891+0000","last_change":"2024-05-09T09:55:10.502456+0000","last_active":"2024-05-09T09:55:58.017891+0000","last_peered":"2024-05-09T09:55:58.017891+0000","last_clean":"2024-05-09T09:55:58.017891+0000","last_became_active":"2024-05-09T09:55:10.502015+0000","last_became_peered":"2024-05-09T09:55:10.502015+0000","last_unstale":"2024-05-09T09:55:58.017891+0000","last_undegraded":"2024-05-09T09:55:58.017891+0000","last_fullsized":"2024-05-09T09:55:58.017891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:01.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"75'46","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016669+0000","last_change":"2024-05-09T09:55:10.787056+0000","last_active":"2024-05-09T09:55:58.016669+0000","last_peered":"2024-05-09T09:55:58.016669+0000","last_clean":"2024-05-09T09:55:58.016669+0000","last_became_active":"2024-05-09T09:55:10.503704+0000","last_became_peered":"2024-05-09T09:55:10.503704+0000","last_unstale":"2024-05-09T09:55:58.016669+0000","last_undegraded":"2024-05-09T09:55:58.016669+0000","last_fullsized":"2024-05-09T09:55:58.016669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:07.882920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'4","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017899+0000","last_change":"2024-05-09T09:55:11.105873+0000","last_active":"2024-05-09T09:55:58.017899+0000","last_peered":"2024-05-09T09:55:58.017899+0000","last_clean":"2024-05-09T09:55:58.017899+0000","last_became_active":"2024-05-09T09:55:10.511777+0000","last_became_peered":"2024-05-09T09:55:10.511777+0000","last_unstale":"2024-05-09T09:55:58.017899+0000","last_undegraded":"2024-05-09T09:55:58.017899+0000","last_fullsized":"2024-05-09T09:55:58.017899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:49.719909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704012+0000","last_change":"2024-05-09T09:55:41.504930+0000","last_active":"2024-05-09T09:55:56.704012+0000","last_peered":"2024-05-09T09:55:56.704012+0000","last_clean":"2024-05-09T09:55:56.704012+0000","last_became_active":"2024-05-09T09:55:41.503996+0000","last_became_peered":"2024-05-09T09:55:41.503996+0000","last_unstale":"2024-05-09T09:55:56.704012+0000","last_undegraded":"2024-05-09T09:55:56.704012+0000","last_fullsized":"2024-05-09T09:55:56.704012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:17.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"73'12","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013352+0000","last_change":"2024-05-09T09:55:11.754129+0000","last_active":"2024-05-09T09:55:58.013352+0000","last_peered":"2024-05-09T09:55:58.013352+0000","last_clean":"2024-05-09T09:55:58.013352+0000","last_became_active":"2024-05-09T09:55:10.525384+0000","last_became_peered":"2024-05-09T09:55:10.525384+0000","last_unstale":"2024-05-09T09:55:58.013352+0000","last_undegraded":"2024-05-09T09:55:58.013352+0000","last_fullsized":"2024-05-09T09:55:58.013352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:56.439887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":18,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704813+0000","last_change":"2024-05-09T09:55:41.503227+0000","last_active":"2024-05-09T09:55:56.704813+0000","last_peered":"2024-05-09T09:55:56.704813+0000","last_clean":"2024-05-09T09:55:56.704813+0000","last_became_active":"2024-05-09T09:55:41.502389+0000","last_became_peered":"2024-05-09T09:55:41.502389+0000","last_unstale":"2024-05-09T09:55:56.704813+0000","last_undegraded":"2024-05-09T09:55:56.704813+0000","last_fullsized":"2024-05-09T09:55:56.704813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:58.478317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015740+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:55:58.015740+0000","last_peered":"2024-05-09T09:55:58.015740+0000","last_clean":"2024-05-09T09:55:58.015740+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:55:58.015740+0000","last_undegraded":"2024-05-09T09:55:58.015740+0000","last_fullsized":"2024-05-09T09:55:58.015740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703739+0000","last_change":"2024-05-09T09:55:41.504669+0000","last_active":"2024-05-09T09:55:56.703739+0000","last_peered":"2024-05-09T09:55:56.703739+0000","last_clean":"2024-05-09T09:55:56.703739+0000","last_became_active":"2024-05-09T09:55:41.503132+0000","last_became_peered":"2024-05-09T09:55:41.503132+0000","last_unstale":"2024-05-09T09:55:56.703739+0000","last_undegraded":"2024-05-09T09:55:56.703739+0000","last_fullsized":"2024-05-09T09:55:56.703739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:40.768463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706462+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:55:56.706462+0000","last_peered":"2024-05-09T09:55:56.706462+0000","last_clean":"2024-05-09T09:55:56.706462+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:55:56.706462+0000","last_undegraded":"2024-05-09T09:55:56.706462+0000","last_fullsized":"2024-05-09T09:55:56.706462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":36882,"num_write":42,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702636+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:55:56.702636+0000","last_peered":"2024-05-09T09:55:56.702636+0000","last_clean":"2024-05-09T09:55:56.702636+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:55:56.702636+0000","last_undegraded":"2024-05-09T09:55:56.702636+0000","last_fullsized":"2024-05-09T09:55:56.702636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"73'15","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704375+0000","last_change":"2024-05-09T09:55:41.528075+0000","last_active":"2024-05-09T09:55:56.704375+0000","last_peered":"2024-05-09T09:55:56.704375+0000","last_clean":"2024-05-09T09:55:56.704375+0000","last_became_active":"2024-05-09T09:55:41.453982+0000","last_became_peered":"2024-05-09T09:55:41.453982+0000","last_unstale":"2024-05-09T09:55:56.704375+0000","last_undegraded":"2024-05-09T09:55:56.704375+0000","last_fullsized":"2024-05-09T09:55:56.704375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:30.849980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703788+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:55:56.703788+0000","last_peered":"2024-05-09T09:55:56.703788+0000","last_clean":"2024-05-09T09:55:56.703788+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:55:56.703788+0000","last_undegraded":"2024-05-09T09:55:56.703788+0000","last_fullsized":"2024-05-09T09:55:56.703788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705754+0000","last_change":"2024-05-09T09:55:41.488023+0000","last_active":"2024-05-09T09:55:56.705754+0000","last_peered":"2024-05-09T09:55:56.705754+0000","last_clean":"2024-05-09T09:55:56.705754+0000","last_became_active":"2024-05-09T09:55:41.478429+0000","last_became_peered":"2024-05-09T09:55:41.478429+0000","last_unstale":"2024-05-09T09:55:56.705754+0000","last_undegraded":"2024-05-09T09:55:56.705754+0000","last_fullsized":"2024-05-09T09:55:56.705754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:21.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703865+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:55:56.703865+0000","last_peered":"2024-05-09T09:55:56.703865+0000","last_clean":"2024-05-09T09:55:56.703865+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:55:56.703865+0000","last_undegraded":"2024-05-09T09:55:56.703865+0000","last_fullsized":"2024-05-09T09:55:56.703865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":76,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298338+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:55:57.298338+0000","last_peered":"2024-05-09T09:55:57.298338+0000","last_clean":"2024-05-09T09:55:57.298338+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:55:57.298338+0000","last_undegraded":"2024-05-09T09:55:57.298338+0000","last_fullsized":"2024-05-09T09:55:57.298338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'16","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511896+0000","last_change":"2024-05-09T09:53:54.474568+0000","last_active":"2024-05-09T09:55:57.511896+0000","last_peered":"2024-05-09T09:55:57.511896+0000","last_clean":"2024-05-09T09:55:57.511896+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:55:57.511896+0000","last_undegraded":"2024-05-09T09:55:57.511896+0000","last_fullsized":"2024-05-09T09:55:57.511896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:31.979515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":38936,"num_write":56,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401833+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:55:57.401833+0000","last_peered":"2024-05-09T09:55:57.401833+0000","last_clean":"2024-05-09T09:55:57.401833+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:55:57.401833+0000","last_undegraded":"2024-05-09T09:55:57.401833+0000","last_fullsized":"2024-05-09T09:55:57.401833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401072+0000","last_change":"2024-05-09T09:55:11.421625+0000","last_active":"2024-05-09T09:55:57.401072+0000","last_peered":"2024-05-09T09:55:57.401072+0000","last_clean":"2024-05-09T09:55:57.401072+0000","last_became_active":"2024-05-09T09:55:10.518812+0000","last_became_peered":"2024-05-09T09:55:10.518812+0000","last_unstale":"2024-05-09T09:55:57.401072+0000","last_undegraded":"2024-05-09T09:55:57.401072+0000","last_fullsized":"2024-05-09T09:55:57.401072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:01.935968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":30726,"num_write":20,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703042+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:55:56.703042+0000","last_peered":"2024-05-09T09:55:56.703042+0000","last_clean":"2024-05-09T09:55:56.703042+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:55:56.703042+0000","last_undegraded":"2024-05-09T09:55:56.703042+0000","last_fullsized":"2024-05-09T09:55:56.703042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704515+0000","last_change":"2024-05-09T09:55:11.272479+0000","last_active":"2024-05-09T09:55:56.704515+0000","last_peered":"2024-05-09T09:55:56.704515+0000","last_clean":"2024-05-09T09:55:56.704515+0000","last_became_active":"2024-05-09T09:55:10.507500+0000","last_became_peered":"2024-05-09T09:55:10.507500+0000","last_unstale":"2024-05-09T09:55:56.704515+0000","last_undegraded":"2024-05-09T09:55:56.704515+0000","last_fullsized":"2024-05-09T09:55:56.704515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:01.473207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013452+0000","last_change":"2024-05-09T09:55:10.524923+0000","last_active":"2024-05-09T09:55:58.013452+0000","last_peered":"2024-05-09T09:55:58.013452+0000","last_clean":"2024-05-09T09:55:58.013452+0000","last_became_active":"2024-05-09T09:55:10.523552+0000","last_became_peered":"2024-05-09T09:55:10.523552+0000","last_unstale":"2024-05-09T09:55:58.013452+0000","last_undegraded":"2024-05-09T09:55:58.013452+0000","last_fullsized":"2024-05-09T09:55:58.013452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:43.486340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'15","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013377+0000","last_change":"2024-05-09T09:55:42.061427+0000","last_active":"2024-05-09T09:55:58.013377+0000","last_peered":"2024-05-09T09:55:58.013377+0000","last_clean":"2024-05-09T09:55:58.013377+0000","last_became_active":"2024-05-09T09:55:41.504165+0000","last_became_peered":"2024-05-09T09:55:41.504165+0000","last_unstale":"2024-05-09T09:55:58.013377+0000","last_undegraded":"2024-05-09T09:55:58.013377+0000","last_fullsized":"2024-05-09T09:55:58.013377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:23.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":13,"num_read_kb":12298,"num_write":35,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":113246208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704514+0000","last_change":"2024-05-09T09:55:41.501384+0000","last_active":"2024-05-09T09:55:56.704514+0000","last_peered":"2024-05-09T09:55:56.704514+0000","last_clean":"2024-05-09T09:55:56.704514+0000","last_became_active":"2024-05-09T09:55:41.500371+0000","last_became_peered":"2024-05-09T09:55:41.500371+0000","last_unstale":"2024-05-09T09:55:56.704514+0000","last_undegraded":"2024-05-09T09:55:56.704514+0000","last_fullsized":"2024-05-09T09:55:56.704514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:40.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'20","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703337+0000","last_change":"2024-05-09T09:55:10.940790+0000","last_active":"2024-05-09T09:55:56.703337+0000","last_peered":"2024-05-09T09:55:56.703337+0000","last_clean":"2024-05-09T09:55:56.703337+0000","last_became_active":"2024-05-09T09:55:10.497720+0000","last_became_peered":"2024-05-09T09:55:10.497720+0000","last_unstale":"2024-05-09T09:55:56.703337+0000","last_undegraded":"2024-05-09T09:55:56.703337+0000","last_fullsized":"2024-05-09T09:55:56.703337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":40,"num_read_kb":51230,"num_write":70,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013352+0000","last_change":"2024-05-09T09:55:10.522327+0000","last_active":"2024-05-09T09:55:58.013352+0000","last_peered":"2024-05-09T09:55:58.013352+0000","last_clean":"2024-05-09T09:55:58.013352+0000","last_became_active":"2024-05-09T09:55:10.520654+0000","last_became_peered":"2024-05-09T09:55:10.520654+0000","last_unstale":"2024-05-09T09:55:58.013352+0000","last_undegraded":"2024-05-09T09:55:58.013352+0000","last_fullsized":"2024-05-09T09:55:58.013352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299280+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:55:57.299280+0000","last_peered":"2024-05-09T09:55:57.299280+0000","last_clean":"2024-05-09T09:55:57.299280+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:55:57.299280+0000","last_undegraded":"2024-05-09T09:55:57.299280+0000","last_fullsized":"2024-05-09T09:55:57.299280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297786+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:55:57.297786+0000","last_peered":"2024-05-09T09:55:57.297786+0000","last_clean":"2024-05-09T09:55:57.297786+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:55:57.297786+0000","last_undegraded":"2024-05-09T09:55:57.297786+0000","last_fullsized":"2024-05-09T09:55:57.297786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"67'7","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013217+0000","last_change":"2024-05-09T09:55:43.542093+0000","last_active":"2024-05-09T09:55:58.013217+0000","last_peered":"2024-05-09T09:55:58.013217+0000","last_clean":"2024-05-09T09:55:58.013217+0000","last_became_active":"2024-05-09T09:55:41.504555+0000","last_became_peered":"2024-05-09T09:55:41.504555+0000","last_unstale":"2024-05-09T09:55:58.013217+0000","last_undegraded":"2024-05-09T09:55:58.013217+0000","last_fullsized":"2024-05-09T09:55:58.013217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:48:05.626495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"75'34","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706338+0000","last_change":"2024-05-09T09:55:11.694902+0000","last_active":"2024-05-09T09:55:56.706338+0000","last_peered":"2024-05-09T09:55:56.706338+0000","last_clean":"2024-05-09T09:55:56.706338+0000","last_became_active":"2024-05-09T09:55:10.515872+0000","last_became_peered":"2024-05-09T09:55:10.515872+0000","last_unstale":"2024-05-09T09:55:56.706338+0000","last_undegraded":"2024-05-09T09:55:56.706338+0000","last_fullsized":"2024-05-09T09:55:56.706338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"67'8","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401104+0000","last_change":"2024-05-09T09:55:11.200964+0000","last_active":"2024-05-09T09:55:57.401104+0000","last_peered":"2024-05-09T09:55:57.401104+0000","last_clean":"2024-05-09T09:55:57.401104+0000","last_became_active":"2024-05-09T09:55:10.506370+0000","last_became_peered":"2024-05-09T09:55:10.506370+0000","last_unstale":"2024-05-09T09:55:57.401104+0000","last_undegraded":"2024-05-09T09:55:57.401104+0000","last_fullsized":"2024-05-09T09:55:57.401104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:45.803361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":16388,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706695+0000","last_change":"2024-05-09T09:55:41.494250+0000","last_active":"2024-05-09T09:55:56.706695+0000","last_peered":"2024-05-09T09:55:56.706695+0000","last_clean":"2024-05-09T09:55:56.706695+0000","last_became_active":"2024-05-09T09:55:41.492423+0000","last_became_peered":"2024-05-09T09:55:41.492423+0000","last_unstale":"2024-05-09T09:55:56.706695+0000","last_undegraded":"2024-05-09T09:55:56.706695+0000","last_fullsized":"2024-05-09T09:55:56.706695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'9","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.012993+0000","last_change":"2024-05-09T09:55:44.733118+0000","last_active":"2024-05-09T09:55:58.012993+0000","last_peered":"2024-05-09T09:55:58.012993+0000","last_clean":"2024-05-09T09:55:58.012993+0000","last_became_active":"2024-05-09T09:55:41.505078+0000","last_became_peered":"2024-05-09T09:55:41.505078+0000","last_unstale":"2024-05-09T09:55:58.012993+0000","last_undegraded":"2024-05-09T09:55:58.012993+0000","last_fullsized":"2024-05-09T09:55:58.012993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:36.404862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512634+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:55:57.512634+0000","last_peered":"2024-05-09T09:55:57.512634+0000","last_clean":"2024-05-09T09:55:57.512634+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:55:57.512634+0000","last_undegraded":"2024-05-09T09:55:57.512634+0000","last_fullsized":"2024-05-09T09:55:57.512634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'18","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401073+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:55:57.401073+0000","last_peered":"2024-05-09T09:55:57.401073+0000","last_clean":"2024-05-09T09:55:57.401073+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:55:57.401073+0000","last_undegraded":"2024-05-09T09:55:57.401073+0000","last_fullsized":"2024-05-09T09:55:57.401073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":63494,"num_write":28,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'34","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705523+0000","last_change":"2024-05-09T09:55:42.435861+0000","last_active":"2024-05-09T09:55:56.705523+0000","last_peered":"2024-05-09T09:55:56.705523+0000","last_clean":"2024-05-09T09:55:56.705523+0000","last_became_active":"2024-05-09T09:55:41.516340+0000","last_became_peered":"2024-05-09T09:55:41.516340+0000","last_unstale":"2024-05-09T09:55:56.705523+0000","last_undegraded":"2024-05-09T09:55:56.705523+0000","last_fullsized":"2024-05-09T09:55:56.705523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'12","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512299+0000","last_change":"2024-05-09T09:53:54.475107+0000","last_active":"2024-05-09T09:55:57.512299+0000","last_peered":"2024-05-09T09:55:57.512299+0000","last_clean":"2024-05-09T09:55:57.512299+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:55:57.512299+0000","last_undegraded":"2024-05-09T09:55:57.512299+0000","last_fullsized":"2024-05-09T09:55:57.512299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:07.978606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":40972,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'10","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017071+0000","last_change":"2024-05-09T09:55:55.725591+0000","last_active":"2024-05-09T09:55:58.017071+0000","last_peered":"2024-05-09T09:55:58.017071+0000","last_clean":"2024-05-09T09:55:58.017071+0000","last_became_active":"2024-05-09T09:55:55.721121+0000","last_became_peered":"2024-05-09T09:55:55.721121+0000","last_unstale":"2024-05-09T09:55:58.017071+0000","last_undegraded":"2024-05-09T09:55:58.017071+0000","last_fullsized":"2024-05-09T09:55:58.017071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298788+0000","last_change":"2024-05-09T09:55:43.389559+0000","last_active":"2024-05-09T09:55:57.298788+0000","last_peered":"2024-05-09T09:55:57.298788+0000","last_clean":"2024-05-09T09:55:57.298788+0000","last_became_active":"2024-05-09T09:55:41.513564+0000","last_became_peered":"2024-05-09T09:55:41.513564+0000","last_unstale":"2024-05-09T09:55:57.298788+0000","last_undegraded":"2024-05-09T09:55:57.298788+0000","last_fullsized":"2024-05-09T09:55:57.298788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:27.560582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"63'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702094+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:55:56.702094+0000","last_peered":"2024-05-09T09:55:56.702094+0000","last_clean":"2024-05-09T09:55:56.702094+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:55:56.702094+0000","last_undegraded":"2024-05-09T09:55:56.702094+0000","last_fullsized":"2024-05-09T09:55:56.702094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017954+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:55:58.017954+0000","last_peered":"2024-05-09T09:55:58.017954+0000","last_clean":"2024-05-09T09:55:58.017954+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:55:58.017954+0000","last_undegraded":"2024-05-09T09:55:58.017954+0000","last_fullsized":"2024-05-09T09:55:58.017954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"63'6","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016486+0000","last_change":"2024-05-09T09:55:10.683098+0000","last_active":"2024-05-09T09:55:58.016486+0000","last_peered":"2024-05-09T09:55:58.016486+0000","last_clean":"2024-05-09T09:55:58.016486+0000","last_became_active":"2024-05-09T09:55:10.495708+0000","last_became_peered":"2024-05-09T09:55:10.495708+0000","last_unstale":"2024-05-09T09:55:58.016486+0000","last_undegraded":"2024-05-09T09:55:58.016486+0000","last_fullsized":"2024-05-09T09:55:58.016486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:35.537784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'19","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513097+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:55:57.513097+0000","last_peered":"2024-05-09T09:55:57.513097+0000","last_clean":"2024-05-09T09:55:57.513097+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:55:57.513097+0000","last_undegraded":"2024-05-09T09:55:57.513097+0000","last_fullsized":"2024-05-09T09:55:57.513097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":39,"num_read_kb":53278,"num_write":69,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'6","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016640+0000","last_change":"2024-05-09T09:55:10.943382+0000","last_active":"2024-05-09T09:55:58.016640+0000","last_peered":"2024-05-09T09:55:58.016640+0000","last_clean":"2024-05-09T09:55:58.016640+0000","last_became_active":"2024-05-09T09:55:10.500255+0000","last_became_peered":"2024-05-09T09:55:10.500255+0000","last_unstale":"2024-05-09T09:55:58.016640+0000","last_undegraded":"2024-05-09T09:55:58.016640+0000","last_fullsized":"2024-05-09T09:55:58.016640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"68'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402011+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.402011+0000","last_peered":"2024-05-09T09:55:57.402011+0000","last_clean":"2024-05-09T09:55:57.402011+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:55:57.402011+0000","last_undegraded":"2024-05-09T09:55:57.402011+0000","last_fullsized":"2024-05-09T09:55:57.402011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"69'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400979+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:55:57.400979+0000","last_peered":"2024-05-09T09:55:57.400979+0000","last_clean":"2024-05-09T09:55:57.400979+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:55:57.400979+0000","last_undegraded":"2024-05-09T09:55:57.400979+0000","last_fullsized":"2024-05-09T09:55:57.400979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706291+0000","last_change":"2024-05-09T09:55:10.507173+0000","last_active":"2024-05-09T09:55:56.706291+0000","last_peered":"2024-05-09T09:55:56.706291+0000","last_clean":"2024-05-09T09:55:56.706291+0000","last_became_active":"2024-05-09T09:55:10.506690+0000","last_became_peered":"2024-05-09T09:55:10.506690+0000","last_unstale":"2024-05-09T09:55:56.706291+0000","last_undegraded":"2024-05-09T09:55:56.706291+0000","last_fullsized":"2024-05-09T09:55:56.706291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'10","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702042+0000","last_change":"2024-05-09T09:55:41.773438+0000","last_active":"2024-05-09T09:55:56.702042+0000","last_peered":"2024-05-09T09:55:56.702042+0000","last_clean":"2024-05-09T09:55:56.702042+0000","last_became_active":"2024-05-09T09:55:41.504558+0000","last_became_peered":"2024-05-09T09:55:41.504558+0000","last_unstale":"2024-05-09T09:55:56.702042+0000","last_undegraded":"2024-05-09T09:55:56.702042+0000","last_fullsized":"2024-05-09T09:55:56.702042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26642,"num_write":40,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399757+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:55:57.399757+0000","last_peered":"2024-05-09T09:55:57.399757+0000","last_clean":"2024-05-09T09:55:57.399757+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:55:57.399757+0000","last_undegraded":"2024-05-09T09:55:57.399757+0000","last_fullsized":"2024-05-09T09:55:57.399757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":634,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":234941,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":916,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":46305,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":230722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":641,"ondisk_log_size":641,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1642,"num_read_kb":1223,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1022,"num_read_kb":1804930,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":1302331392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504000,"kb_used_data":472824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93867840,"statfs":{"total":96636764160,"available":96120668160,"internally_reserved":0,"allocated":484171776,"data_stored":483628948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":392780,"kb_used_data":361604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93979060,"statfs":{"total":96636764160,"available":96234557440,"internally_reserved":0,"allocated":370282496,"data_stored":369785753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":526004,"kb_used_data":494828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93845836,"statfs":{"total":96636764160,"available":96098136064,"internally_reserved":0,"allocated":506703872,"data_stored":506143223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505404,"kb_used_data":474220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866436,"statfs":{"total":96636764160,"available":96119230464,"internally_reserved":0,"allocated":485601280,"data_stored":485118321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462516,"kb_used_data":427180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93909324,"statfs":{"total":96636764160,"available":96163147776,"internally_reserved":0,"allocated":437432320,"data_stored":436912303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331372,"kb_used_data":296036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94040468,"statfs":{"total":96636764160,"available":96297439232,"internally_reserved":0,"allocated":303140864,"data_stored":302661910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315068,"kb_used_data":279732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94056772,"statfs":{"total":96636764160,"available":96314134528,"internally_reserved":0,"allocated":286445568,"data_stored":285929009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434400,"kb_used_data":399056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93937440,"statfs":{"total":96636764160,"available":96191938560,"internally_reserved":0,"allocated":408633344,"data_stored":408125441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":406847488,"data_stored":406847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":285212672,"data_stored":285212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":301989888,"data_stored":301989888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":436207616,"data_stored":436207616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":505413632,"data_stored":505413632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":369098752,"data_stored":369098752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":20947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":38049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":62333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":25989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:56:09.084 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T09:56:09.084 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:56:09.433 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:09.440 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:56:09.456 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-05-09T09:56:09.349551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636605482,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3772,"num_read_kb":1807243,"num_write":3328,"num_write_kb":2051082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":598,"num_bytes_recovered":1302381373,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2063,"ondisk_log_size":2063,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3471544,"kb_used_data":3205480,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":751503176,"statfs":{"total":773094113280,"available":769539252224,"internally_reserved":0,"allocated":3282411520,"data_stored":3278304908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":272354867},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005602"},"pg_stats":[{"pgid":"3.3f","version":"73'14","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017601+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:55:58.017601+0000","last_peered":"2024-05-09T09:55:58.017601+0000","last_clean":"2024-05-09T09:55:58.017601+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:55:58.017601+0000","last_undegraded":"2024-05-09T09:55:58.017601+0000","last_fullsized":"2024-05-09T09:55:58.017601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":47116,"num_write":34,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400553+0000","last_change":"2024-05-09T09:55:41.485053+0000","last_active":"2024-05-09T09:55:57.400553+0000","last_peered":"2024-05-09T09:55:57.400553+0000","last_clean":"2024-05-09T09:55:57.400553+0000","last_became_active":"2024-05-09T09:55:41.484367+0000","last_became_peered":"2024-05-09T09:55:41.484367+0000","last_unstale":"2024-05-09T09:55:57.400553+0000","last_undegraded":"2024-05-09T09:55:57.400553+0000","last_fullsized":"2024-05-09T09:55:57.400553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:39.155356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"73'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703942+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:55:56.703942+0000","last_peered":"2024-05-09T09:55:56.703942+0000","last_clean":"2024-05-09T09:55:56.703942+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:55:56.703942+0000","last_undegraded":"2024-05-09T09:55:56.703942+0000","last_fullsized":"2024-05-09T09:55:56.703942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'40","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015392+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:55:58.015392+0000","last_peered":"2024-05-09T09:55:58.015392+0000","last_clean":"2024-05-09T09:55:58.015392+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:55:58.015392+0000","last_undegraded":"2024-05-09T09:55:58.015392+0000","last_fullsized":"2024-05-09T09:55:58.015392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"73'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705841+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:55:56.705841+0000","last_peered":"2024-05-09T09:55:56.705841+0000","last_clean":"2024-05-09T09:55:56.705841+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:55:56.705841+0000","last_undegraded":"2024-05-09T09:55:56.705841+0000","last_fullsized":"2024-05-09T09:55:56.705841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":38918,"num_write":22,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705052+0000","last_change":"2024-05-09T09:55:41.476462+0000","last_active":"2024-05-09T09:55:56.705052+0000","last_peered":"2024-05-09T09:55:56.705052+0000","last_clean":"2024-05-09T09:55:56.705052+0000","last_became_active":"2024-05-09T09:55:41.474847+0000","last_became_peered":"2024-05-09T09:55:41.474847+0000","last_unstale":"2024-05-09T09:55:56.705052+0000","last_undegraded":"2024-05-09T09:55:56.705052+0000","last_fullsized":"2024-05-09T09:55:56.705052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'10","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401959+0000","last_change":"2024-05-09T09:55:11.074408+0000","last_active":"2024-05-09T09:55:57.401959+0000","last_peered":"2024-05-09T09:55:57.401959+0000","last_clean":"2024-05-09T09:55:57.401959+0000","last_became_active":"2024-05-09T09:55:10.495355+0000","last_became_peered":"2024-05-09T09:55:10.495355+0000","last_unstale":"2024-05-09T09:55:57.401959+0000","last_undegraded":"2024-05-09T09:55:57.401959+0000","last_fullsized":"2024-05-09T09:55:57.401959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:16:55.087662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704348+0000","last_change":"2024-05-09T09:55:10.508149+0000","last_active":"2024-05-09T09:55:56.704348+0000","last_peered":"2024-05-09T09:55:56.704348+0000","last_clean":"2024-05-09T09:55:56.704348+0000","last_became_active":"2024-05-09T09:55:10.506740+0000","last_became_peered":"2024-05-09T09:55:10.506740+0000","last_unstale":"2024-05-09T09:55:56.704348+0000","last_undegraded":"2024-05-09T09:55:56.704348+0000","last_fullsized":"2024-05-09T09:55:56.704348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:15.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"67'10","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297604+0000","last_change":"2024-05-09T09:53:54.477992+0000","last_active":"2024-05-09T09:55:57.297604+0000","last_peered":"2024-05-09T09:55:57.297604+0000","last_clean":"2024-05-09T09:55:57.297604+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:55:57.297604+0000","last_undegraded":"2024-05-09T09:55:57.297604+0000","last_fullsized":"2024-05-09T09:55:57.297604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:38.501294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'14","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400463+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:55:57.400463+0000","last_peered":"2024-05-09T09:55:57.400463+0000","last_clean":"2024-05-09T09:55:57.400463+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:55:57.400463+0000","last_undegraded":"2024-05-09T09:55:57.400463+0000","last_fullsized":"2024-05-09T09:55:57.400463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:45:31.509591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":34840,"num_write":54,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'38","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706070+0000","last_change":"2024-05-09T09:55:41.723376+0000","last_active":"2024-05-09T09:55:56.706070+0000","last_peered":"2024-05-09T09:55:56.706070+0000","last_clean":"2024-05-09T09:55:56.706070+0000","last_became_active":"2024-05-09T09:55:41.470370+0000","last_became_peered":"2024-05-09T09:55:41.470370+0000","last_unstale":"2024-05-09T09:55:56.706070+0000","last_undegraded":"2024-05-09T09:55:56.706070+0000","last_fullsized":"2024-05-09T09:55:56.706070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:01.442445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"64'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016806+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:55:58.016806+0000","last_peered":"2024-05-09T09:55:58.016806+0000","last_clean":"2024-05-09T09:55:58.016806+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:55:58.016806+0000","last_undegraded":"2024-05-09T09:55:58.016806+0000","last_fullsized":"2024-05-09T09:55:58.016806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":34816,"num_write":9,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399784+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:55:57.399784+0000","last_peered":"2024-05-09T09:55:57.399784+0000","last_clean":"2024-05-09T09:55:57.399784+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:55:57.399784+0000","last_undegraded":"2024-05-09T09:55:57.399784+0000","last_fullsized":"2024-05-09T09:55:57.399784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'15","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013473+0000","last_change":"2024-05-09T09:55:11.513082+0000","last_active":"2024-05-09T09:55:58.013473+0000","last_peered":"2024-05-09T09:55:58.013473+0000","last_clean":"2024-05-09T09:55:58.013473+0000","last_became_active":"2024-05-09T09:55:10.517657+0000","last_became_peered":"2024-05-09T09:55:10.517657+0000","last_unstale":"2024-05-09T09:55:58.013473+0000","last_undegraded":"2024-05-09T09:55:58.013473+0000","last_fullsized":"2024-05-09T09:55:58.013473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:28.563341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":22558,"num_write":65,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513158+0000","last_change":"2024-05-09T09:55:10.525459+0000","last_active":"2024-05-09T09:55:57.513158+0000","last_peered":"2024-05-09T09:55:57.513158+0000","last_clean":"2024-05-09T09:55:57.513158+0000","last_became_active":"2024-05-09T09:55:10.525051+0000","last_became_peered":"2024-05-09T09:55:10.525051+0000","last_unstale":"2024-05-09T09:55:57.513158+0000","last_undegraded":"2024-05-09T09:55:57.513158+0000","last_fullsized":"2024-05-09T09:55:57.513158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:08.309277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704076+0000","last_change":"2024-05-09T09:55:41.727656+0000","last_active":"2024-05-09T09:55:56.704076+0000","last_peered":"2024-05-09T09:55:56.704076+0000","last_clean":"2024-05-09T09:55:56.704076+0000","last_became_active":"2024-05-09T09:55:41.468227+0000","last_became_peered":"2024-05-09T09:55:41.468227+0000","last_unstale":"2024-05-09T09:55:56.704076+0000","last_undegraded":"2024-05-09T09:55:56.704076+0000","last_fullsized":"2024-05-09T09:55:56.704076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017765+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:55:58.017765+0000","last_peered":"2024-05-09T09:55:58.017765+0000","last_clean":"2024-05-09T09:55:58.017765+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:55:58.017765+0000","last_undegraded":"2024-05-09T09:55:58.017765+0000","last_fullsized":"2024-05-09T09:55:58.017765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014983+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:55:58.014983+0000","last_peered":"2024-05-09T09:55:58.014983+0000","last_clean":"2024-05-09T09:55:58.014983+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:55:58.014983+0000","last_undegraded":"2024-05-09T09:55:58.014983+0000","last_fullsized":"2024-05-09T09:55:58.014983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299075+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.299075+0000","last_peered":"2024-05-09T09:55:57.299075+0000","last_clean":"2024-05-09T09:55:57.299075+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:55:57.299075+0000","last_undegraded":"2024-05-09T09:55:57.299075+0000","last_fullsized":"2024-05-09T09:55:57.299075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400770+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:55:57.400770+0000","last_peered":"2024-05-09T09:55:57.400770+0000","last_clean":"2024-05-09T09:55:57.400770+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:55:57.400770+0000","last_undegraded":"2024-05-09T09:55:57.400770+0000","last_fullsized":"2024-05-09T09:55:57.400770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"66'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299149+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:55:57.299149+0000","last_peered":"2024-05-09T09:55:57.299149+0000","last_clean":"2024-05-09T09:55:57.299149+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:55:57.299149+0000","last_undegraded":"2024-05-09T09:55:57.299149+0000","last_fullsized":"2024-05-09T09:55:57.299149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512589+0000","last_change":"2024-05-09T09:55:10.502036+0000","last_active":"2024-05-09T09:55:57.512589+0000","last_peered":"2024-05-09T09:55:57.512589+0000","last_clean":"2024-05-09T09:55:57.512589+0000","last_became_active":"2024-05-09T09:55:10.501517+0000","last_became_peered":"2024-05-09T09:55:10.501517+0000","last_unstale":"2024-05-09T09:55:57.512589+0000","last_undegraded":"2024-05-09T09:55:57.512589+0000","last_fullsized":"2024-05-09T09:55:57.512589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:30.945254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"66'4","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705752+0000","last_change":"2024-05-09T09:55:42.549939+0000","last_active":"2024-05-09T09:55:56.705752+0000","last_peered":"2024-05-09T09:55:56.705752+0000","last_clean":"2024-05-09T09:55:56.705752+0000","last_became_active":"2024-05-09T09:55:41.517108+0000","last_became_peered":"2024-05-09T09:55:41.517108+0000","last_unstale":"2024-05-09T09:55:56.705752+0000","last_undegraded":"2024-05-09T09:55:56.705752+0000","last_fullsized":"2024-05-09T09:55:56.705752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:39.522749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511344+0000","last_change":"2024-05-09T09:55:41.495787+0000","last_active":"2024-05-09T09:55:57.511344+0000","last_peered":"2024-05-09T09:55:57.511344+0000","last_clean":"2024-05-09T09:55:57.511344+0000","last_became_active":"2024-05-09T09:55:41.495217+0000","last_became_peered":"2024-05-09T09:55:41.495217+0000","last_unstale":"2024-05-09T09:55:57.511344+0000","last_undegraded":"2024-05-09T09:55:57.511344+0000","last_fullsized":"2024-05-09T09:55:57.511344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:19.303237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"67'12","reported_seq":73,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017067+0000","last_change":"2024-05-09T09:55:11.744028+0000","last_active":"2024-05-09T09:55:58.017067+0000","last_peered":"2024-05-09T09:55:58.017067+0000","last_clean":"2024-05-09T09:55:58.017067+0000","last_became_active":"2024-05-09T09:55:10.515515+0000","last_became_peered":"2024-05-09T09:55:10.515515+0000","last_unstale":"2024-05-09T09:55:58.017067+0000","last_undegraded":"2024-05-09T09:55:58.017067+0000","last_fullsized":"2024-05-09T09:55:58.017067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:26:21.134168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":77594624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706053+0000","last_change":"2024-05-09T09:55:41.471993+0000","last_active":"2024-05-09T09:55:56.706053+0000","last_peered":"2024-05-09T09:55:56.706053+0000","last_clean":"2024-05-09T09:55:56.706053+0000","last_became_active":"2024-05-09T09:55:41.469463+0000","last_became_peered":"2024-05-09T09:55:41.469463+0000","last_unstale":"2024-05-09T09:55:56.706053+0000","last_undegraded":"2024-05-09T09:55:56.706053+0000","last_fullsized":"2024-05-09T09:55:56.706053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:09.428329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702672+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:55:56.702672+0000","last_peered":"2024-05-09T09:55:56.702672+0000","last_clean":"2024-05-09T09:55:56.702672+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:55:56.702672+0000","last_undegraded":"2024-05-09T09:55:56.702672+0000","last_fullsized":"2024-05-09T09:55:56.702672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":26630,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703760+0000","last_change":"2024-05-09T09:55:41.489025+0000","last_active":"2024-05-09T09:55:56.703760+0000","last_peered":"2024-05-09T09:55:56.703760+0000","last_clean":"2024-05-09T09:55:56.703760+0000","last_became_active":"2024-05-09T09:55:41.479825+0000","last_became_peered":"2024-05-09T09:55:41.479825+0000","last_unstale":"2024-05-09T09:55:56.703760+0000","last_undegraded":"2024-05-09T09:55:56.703760+0000","last_fullsized":"2024-05-09T09:55:56.703760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017517+0000","last_change":"2024-05-09T09:55:10.499813+0000","last_active":"2024-05-09T09:55:58.017517+0000","last_peered":"2024-05-09T09:55:58.017517+0000","last_clean":"2024-05-09T09:55:58.017517+0000","last_became_active":"2024-05-09T09:55:10.499014+0000","last_became_peered":"2024-05-09T09:55:10.499014+0000","last_unstale":"2024-05-09T09:55:58.017517+0000","last_undegraded":"2024-05-09T09:55:58.017517+0000","last_fullsized":"2024-05-09T09:55:58.017517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:12.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"68'9","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015039+0000","last_change":"2024-05-09T09:55:43.099041+0000","last_active":"2024-05-09T09:55:58.015039+0000","last_peered":"2024-05-09T09:55:58.015039+0000","last_clean":"2024-05-09T09:55:58.015039+0000","last_became_active":"2024-05-09T09:55:41.507252+0000","last_became_peered":"2024-05-09T09:55:41.507252+0000","last_unstale":"2024-05-09T09:55:58.015039+0000","last_undegraded":"2024-05-09T09:55:58.015039+0000","last_fullsized":"2024-05-09T09:55:58.015039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401721+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:55:57.401721+0000","last_peered":"2024-05-09T09:55:57.401721+0000","last_clean":"2024-05-09T09:55:57.401721+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:55:57.401721+0000","last_undegraded":"2024-05-09T09:55:57.401721+0000","last_fullsized":"2024-05-09T09:55:57.401721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"73'16","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706715+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:55:56.706715+0000","last_peered":"2024-05-09T09:55:56.706715+0000","last_clean":"2024-05-09T09:55:56.706715+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:55:56.706715+0000","last_undegraded":"2024-05-09T09:55:56.706715+0000","last_fullsized":"2024-05-09T09:55:56.706715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":20,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017272+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:55:58.017272+0000","last_peered":"2024-05-09T09:55:58.017272+0000","last_clean":"2024-05-09T09:55:58.017272+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:55:58.017272+0000","last_undegraded":"2024-05-09T09:55:58.017272+0000","last_fullsized":"2024-05-09T09:55:58.017272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400280+0000","last_change":"2024-05-09T09:55:41.487851+0000","last_active":"2024-05-09T09:55:57.400280+0000","last_peered":"2024-05-09T09:55:57.400280+0000","last_clean":"2024-05-09T09:55:57.400280+0000","last_became_active":"2024-05-09T09:55:41.487060+0000","last_became_peered":"2024-05-09T09:55:41.487060+0000","last_unstale":"2024-05-09T09:55:57.400280+0000","last_undegraded":"2024-05-09T09:55:57.400280+0000","last_fullsized":"2024-05-09T09:55:57.400280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:54:51.000892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402309+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:55:57.402309+0000","last_peered":"2024-05-09T09:55:57.402309+0000","last_clean":"2024-05-09T09:55:57.402309+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:55:57.402309+0000","last_undegraded":"2024-05-09T09:55:57.402309+0000","last_fullsized":"2024-05-09T09:55:57.402309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'4","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702911+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:55:56.702911+0000","last_peered":"2024-05-09T09:55:56.702911+0000","last_clean":"2024-05-09T09:55:56.702911+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:55:56.702911+0000","last_undegraded":"2024-05-09T09:55:56.702911+0000","last_fullsized":"2024-05-09T09:55:56.702911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12294,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018013+0000","last_change":"2024-05-09T09:55:10.509010+0000","last_active":"2024-05-09T09:55:58.018013+0000","last_peered":"2024-05-09T09:55:58.018013+0000","last_clean":"2024-05-09T09:55:58.018013+0000","last_became_active":"2024-05-09T09:55:10.506778+0000","last_became_peered":"2024-05-09T09:55:10.506778+0000","last_unstale":"2024-05-09T09:55:58.018013+0000","last_undegraded":"2024-05-09T09:55:58.018013+0000","last_fullsized":"2024-05-09T09:55:58.018013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706557+0000","last_change":"2024-05-09T09:55:41.534680+0000","last_active":"2024-05-09T09:55:56.706557+0000","last_peered":"2024-05-09T09:55:56.706557+0000","last_clean":"2024-05-09T09:55:56.706557+0000","last_became_active":"2024-05-09T09:55:41.467079+0000","last_became_peered":"2024-05-09T09:55:41.467079+0000","last_unstale":"2024-05-09T09:55:56.706557+0000","last_undegraded":"2024-05-09T09:55:56.706557+0000","last_fullsized":"2024-05-09T09:55:56.706557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:22.934731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706204+0000","last_change":"2024-05-09T09:55:41.468769+0000","last_active":"2024-05-09T09:55:56.706204+0000","last_peered":"2024-05-09T09:55:56.706204+0000","last_clean":"2024-05-09T09:55:56.706204+0000","last_became_active":"2024-05-09T09:55:41.467929+0000","last_became_peered":"2024-05-09T09:55:41.467929+0000","last_unstale":"2024-05-09T09:55:56.706204+0000","last_undegraded":"2024-05-09T09:55:56.706204+0000","last_fullsized":"2024-05-09T09:55:56.706204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:02.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702279+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:55:56.702279+0000","last_peered":"2024-05-09T09:55:56.702279+0000","last_clean":"2024-05-09T09:55:56.702279+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:55:56.702279+0000","last_undegraded":"2024-05-09T09:55:56.702279+0000","last_fullsized":"2024-05-09T09:55:56.702279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705924+0000","last_change":"2024-05-09T09:55:10.483103+0000","last_active":"2024-05-09T09:55:56.705924+0000","last_peered":"2024-05-09T09:55:56.705924+0000","last_clean":"2024-05-09T09:55:56.705924+0000","last_became_active":"2024-05-09T09:55:10.482649+0000","last_became_peered":"2024-05-09T09:55:10.482649+0000","last_unstale":"2024-05-09T09:55:56.705924+0000","last_undegraded":"2024-05-09T09:55:56.705924+0000","last_fullsized":"2024-05-09T09:55:56.705924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'14","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014967+0000","last_change":"2024-05-09T09:55:45.036128+0000","last_active":"2024-05-09T09:55:58.014967+0000","last_peered":"2024-05-09T09:55:58.014967+0000","last_clean":"2024-05-09T09:55:58.014967+0000","last_became_active":"2024-05-09T09:55:41.508695+0000","last_became_peered":"2024-05-09T09:55:41.508695+0000","last_unstale":"2024-05-09T09:55:58.014967+0000","last_undegraded":"2024-05-09T09:55:58.014967+0000","last_fullsized":"2024-05-09T09:55:58.014967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":38936,"num_write":54,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018240+0000","last_change":"2024-05-09T09:55:10.510105+0000","last_active":"2024-05-09T09:55:58.018240+0000","last_peered":"2024-05-09T09:55:58.018240+0000","last_clean":"2024-05-09T09:55:58.018240+0000","last_became_active":"2024-05-09T09:55:10.508122+0000","last_became_peered":"2024-05-09T09:55:10.508122+0000","last_unstale":"2024-05-09T09:55:58.018240+0000","last_undegraded":"2024-05-09T09:55:58.018240+0000","last_fullsized":"2024-05-09T09:55:58.018240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"63'11","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511453+0000","last_change":"2024-05-09T09:55:43.116362+0000","last_active":"2024-05-09T09:55:57.511453+0000","last_peered":"2024-05-09T09:55:57.511453+0000","last_clean":"2024-05-09T09:55:57.511453+0000","last_became_active":"2024-05-09T09:55:41.506785+0000","last_became_peered":"2024-05-09T09:55:41.506785+0000","last_unstale":"2024-05-09T09:55:57.511453+0000","last_undegraded":"2024-05-09T09:55:57.511453+0000","last_fullsized":"2024-05-09T09:55:57.511453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:30.446781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'15","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.019317+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:55:58.019317+0000","last_peered":"2024-05-09T09:55:58.019317+0000","last_clean":"2024-05-09T09:55:58.019317+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:55:58.019317+0000","last_undegraded":"2024-05-09T09:55:58.019317+0000","last_fullsized":"2024-05-09T09:55:58.019317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705111+0000","last_change":"2024-05-09T09:55:42.211684+0000","last_active":"2024-05-09T09:55:56.705111+0000","last_peered":"2024-05-09T09:55:56.705111+0000","last_clean":"2024-05-09T09:55:56.705111+0000","last_became_active":"2024-05-09T09:55:41.492528+0000","last_became_peered":"2024-05-09T09:55:41.492528+0000","last_unstale":"2024-05-09T09:55:56.705111+0000","last_undegraded":"2024-05-09T09:55:56.705111+0000","last_fullsized":"2024-05-09T09:55:56.705111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:23.272525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018549+0000","last_change":"2024-05-09T09:55:10.510510+0000","last_active":"2024-05-09T09:55:58.018549+0000","last_peered":"2024-05-09T09:55:58.018549+0000","last_clean":"2024-05-09T09:55:58.018549+0000","last_became_active":"2024-05-09T09:55:10.508721+0000","last_became_peered":"2024-05-09T09:55:10.508721+0000","last_unstale":"2024-05-09T09:55:58.018549+0000","last_undegraded":"2024-05-09T09:55:58.018549+0000","last_fullsized":"2024-05-09T09:55:58.018549+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'7","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298120+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:55:57.298120+0000","last_peered":"2024-05-09T09:55:57.298120+0000","last_clean":"2024-05-09T09:55:57.298120+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:55:57.298120+0000","last_undegraded":"2024-05-09T09:55:57.298120+0000","last_fullsized":"2024-05-09T09:55:57.298120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401894+0000","last_change":"2024-05-09T09:55:10.508180+0000","last_active":"2024-05-09T09:55:57.401894+0000","last_peered":"2024-05-09T09:55:57.401894+0000","last_clean":"2024-05-09T09:55:57.401894+0000","last_became_active":"2024-05-09T09:55:10.507504+0000","last_became_peered":"2024-05-09T09:55:10.507504+0000","last_unstale":"2024-05-09T09:55:57.401894+0000","last_undegraded":"2024-05-09T09:55:57.401894+0000","last_fullsized":"2024-05-09T09:55:57.401894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:26.131778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"73'14","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018747+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:55:58.018747+0000","last_peered":"2024-05-09T09:55:58.018747+0000","last_clean":"2024-05-09T09:55:58.018747+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:55:58.018747+0000","last_undegraded":"2024-05-09T09:55:58.018747+0000","last_fullsized":"2024-05-09T09:55:58.018747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'18","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017797+0000","last_change":"2024-05-09T09:55:10.785031+0000","last_active":"2024-05-09T09:55:58.017797+0000","last_peered":"2024-05-09T09:55:58.017797+0000","last_clean":"2024-05-09T09:55:58.017797+0000","last_became_active":"2024-05-09T09:55:10.502644+0000","last_became_peered":"2024-05-09T09:55:10.502644+0000","last_unstale":"2024-05-09T09:55:58.017797+0000","last_undegraded":"2024-05-09T09:55:58.017797+0000","last_fullsized":"2024-05-09T09:55:58.017797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:14.036784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400855+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:55:57.400855+0000","last_peered":"2024-05-09T09:55:57.400855+0000","last_clean":"2024-05-09T09:55:57.400855+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:55:57.400855+0000","last_undegraded":"2024-05-09T09:55:57.400855+0000","last_fullsized":"2024-05-09T09:55:57.400855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"75'12","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015784+0000","last_change":"2024-05-09T09:55:44.175359+0000","last_active":"2024-05-09T09:55:58.015784+0000","last_peered":"2024-05-09T09:55:58.015784+0000","last_clean":"2024-05-09T09:55:58.015784+0000","last_became_active":"2024-05-09T09:55:41.507201+0000","last_became_peered":"2024-05-09T09:55:41.507201+0000","last_unstale":"2024-05-09T09:55:58.015784+0000","last_undegraded":"2024-05-09T09:55:58.015784+0000","last_fullsized":"2024-05-09T09:55:58.015784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:07.511876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016355+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:55:58.016355+0000","last_peered":"2024-05-09T09:55:58.016355+0000","last_clean":"2024-05-09T09:55:58.016355+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:55:58.016355+0000","last_undegraded":"2024-05-09T09:55:58.016355+0000","last_fullsized":"2024-05-09T09:55:58.016355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'27","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401423+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:55:57.401423+0000","last_peered":"2024-05-09T09:55:57.401423+0000","last_clean":"2024-05-09T09:55:57.401423+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:55:57.401423+0000","last_undegraded":"2024-05-09T09:55:57.401423+0000","last_fullsized":"2024-05-09T09:55:57.401423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704309+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:55:56.704309+0000","last_peered":"2024-05-09T09:55:56.704309+0000","last_clean":"2024-05-09T09:55:56.704309+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:55:56.704309+0000","last_undegraded":"2024-05-09T09:55:56.704309+0000","last_fullsized":"2024-05-09T09:55:56.704309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401424+0000","last_change":"2024-05-09T09:55:41.485193+0000","last_active":"2024-05-09T09:55:57.401424+0000","last_peered":"2024-05-09T09:55:57.401424+0000","last_clean":"2024-05-09T09:55:57.401424+0000","last_became_active":"2024-05-09T09:55:41.484312+0000","last_became_peered":"2024-05-09T09:55:41.484312+0000","last_unstale":"2024-05-09T09:55:57.401424+0000","last_undegraded":"2024-05-09T09:55:57.401424+0000","last_fullsized":"2024-05-09T09:55:57.401424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:59.737104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704125+0000","last_change":"2024-05-09T09:55:41.479720+0000","last_active":"2024-05-09T09:55:56.704125+0000","last_peered":"2024-05-09T09:55:56.704125+0000","last_clean":"2024-05-09T09:55:56.704125+0000","last_became_active":"2024-05-09T09:55:41.472133+0000","last_became_peered":"2024-05-09T09:55:41.472133+0000","last_unstale":"2024-05-09T09:55:56.704125+0000","last_undegraded":"2024-05-09T09:55:56.704125+0000","last_fullsized":"2024-05-09T09:55:56.704125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:55.564231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"64'4","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015251+0000","last_change":"2024-05-09T09:55:44.852684+0000","last_active":"2024-05-09T09:55:58.015251+0000","last_peered":"2024-05-09T09:55:58.015251+0000","last_clean":"2024-05-09T09:55:58.015251+0000","last_became_active":"2024-05-09T09:55:41.507751+0000","last_became_peered":"2024-05-09T09:55:41.507751+0000","last_unstale":"2024-05-09T09:55:58.015251+0000","last_undegraded":"2024-05-09T09:55:58.015251+0000","last_fullsized":"2024-05-09T09:55:58.015251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:13.201219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511904+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:55:57.511904+0000","last_peered":"2024-05-09T09:55:57.511904+0000","last_clean":"2024-05-09T09:55:57.511904+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:55:57.511904+0000","last_undegraded":"2024-05-09T09:55:57.511904+0000","last_fullsized":"2024-05-09T09:55:57.511904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"73'13","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013285+0000","last_change":"2024-05-09T09:55:11.749967+0000","last_active":"2024-05-09T09:55:58.013285+0000","last_peered":"2024-05-09T09:55:58.013285+0000","last_clean":"2024-05-09T09:55:58.013285+0000","last_became_active":"2024-05-09T09:55:10.522763+0000","last_became_peered":"2024-05-09T09:55:10.522763+0000","last_unstale":"2024-05-09T09:55:58.013285+0000","last_undegraded":"2024-05-09T09:55:58.013285+0000","last_fullsized":"2024-05-09T09:55:58.013285+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:03.450608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013669+0000","last_change":"2024-05-09T09:55:10.505759+0000","last_active":"2024-05-09T09:55:58.013669+0000","last_peered":"2024-05-09T09:55:58.013669+0000","last_clean":"2024-05-09T09:55:58.013669+0000","last_became_active":"2024-05-09T09:55:10.504789+0000","last_became_peered":"2024-05-09T09:55:10.504789+0000","last_unstale":"2024-05-09T09:55:58.013669+0000","last_undegraded":"2024-05-09T09:55:58.013669+0000","last_fullsized":"2024-05-09T09:55:58.013669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:53.805557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298207+0000","last_change":"2024-05-09T09:55:41.506430+0000","last_active":"2024-05-09T09:55:57.298207+0000","last_peered":"2024-05-09T09:55:57.298207+0000","last_clean":"2024-05-09T09:55:57.298207+0000","last_became_active":"2024-05-09T09:55:41.505745+0000","last_became_peered":"2024-05-09T09:55:41.505745+0000","last_unstale":"2024-05-09T09:55:57.298207+0000","last_undegraded":"2024-05-09T09:55:57.298207+0000","last_fullsized":"2024-05-09T09:55:57.298207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:18.090362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017383+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:55:58.017383+0000","last_peered":"2024-05-09T09:55:58.017383+0000","last_clean":"2024-05-09T09:55:58.017383+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:55:58.017383+0000","last_undegraded":"2024-05-09T09:55:58.017383+0000","last_fullsized":"2024-05-09T09:55:58.017383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34828,"num_write":32,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512208+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:55:57.512208+0000","last_peered":"2024-05-09T09:55:57.512208+0000","last_clean":"2024-05-09T09:55:57.512208+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:55:57.512208+0000","last_undegraded":"2024-05-09T09:55:57.512208+0000","last_fullsized":"2024-05-09T09:55:57.512208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"73'21","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016539+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:55:58.016539+0000","last_peered":"2024-05-09T09:55:58.016539+0000","last_clean":"2024-05-09T09:55:58.016539+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:55:58.016539+0000","last_undegraded":"2024-05-09T09:55:58.016539+0000","last_fullsized":"2024-05-09T09:55:58.016539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'15","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701053+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:55:56.701053+0000","last_peered":"2024-05-09T09:55:56.701053+0000","last_clean":"2024-05-09T09:55:56.701053+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:55:56.701053+0000","last_undegraded":"2024-05-09T09:55:56.701053+0000","last_fullsized":"2024-05-09T09:55:56.701053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706729+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:55:56.706729+0000","last_peered":"2024-05-09T09:55:56.706729+0000","last_clean":"2024-05-09T09:55:56.706729+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:55:56.706729+0000","last_undegraded":"2024-05-09T09:55:56.706729+0000","last_fullsized":"2024-05-09T09:55:56.706729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705393+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:55:56.705393+0000","last_peered":"2024-05-09T09:55:56.705393+0000","last_clean":"2024-05-09T09:55:56.705393+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:55:56.705393+0000","last_undegraded":"2024-05-09T09:55:56.705393+0000","last_fullsized":"2024-05-09T09:55:56.705393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'12","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402227+0000","last_change":"2024-05-09T09:55:11.694165+0000","last_active":"2024-05-09T09:55:57.402227+0000","last_peered":"2024-05-09T09:55:57.402227+0000","last_clean":"2024-05-09T09:55:57.402227+0000","last_became_active":"2024-05-09T09:55:10.521894+0000","last_became_peered":"2024-05-09T09:55:10.521894+0000","last_unstale":"2024-05-09T09:55:57.402227+0000","last_undegraded":"2024-05-09T09:55:57.402227+0000","last_fullsized":"2024-05-09T09:55:57.402227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:04.661085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38924,"num_write":32,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511206+0000","last_change":"2024-05-09T09:55:41.484220+0000","last_active":"2024-05-09T09:55:57.511206+0000","last_peered":"2024-05-09T09:55:57.511206+0000","last_clean":"2024-05-09T09:55:57.511206+0000","last_became_active":"2024-05-09T09:55:41.483828+0000","last_became_peered":"2024-05-09T09:55:41.483828+0000","last_unstale":"2024-05-09T09:55:57.511206+0000","last_undegraded":"2024-05-09T09:55:57.511206+0000","last_fullsized":"2024-05-09T09:55:57.511206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:12.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701503+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:55:56.701503+0000","last_peered":"2024-05-09T09:55:56.701503+0000","last_clean":"2024-05-09T09:55:56.701503+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:55:56.701503+0000","last_undegraded":"2024-05-09T09:55:56.701503+0000","last_fullsized":"2024-05-09T09:55:56.701503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13754,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":60,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511648+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:55:57.511648+0000","last_peered":"2024-05-09T09:55:57.511648+0000","last_clean":"2024-05-09T09:55:57.511648+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:55:57.511648+0000","last_undegraded":"2024-05-09T09:55:57.511648+0000","last_fullsized":"2024-05-09T09:55:57.511648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703562+0000","last_change":"2024-05-09T09:55:10.518479+0000","last_active":"2024-05-09T09:55:56.703562+0000","last_peered":"2024-05-09T09:55:56.703562+0000","last_clean":"2024-05-09T09:55:56.703562+0000","last_became_active":"2024-05-09T09:55:10.518109+0000","last_became_peered":"2024-05-09T09:55:10.518109+0000","last_unstale":"2024-05-09T09:55:56.703562+0000","last_undegraded":"2024-05-09T09:55:56.703562+0000","last_fullsized":"2024-05-09T09:55:56.703562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705558+0000","last_change":"2024-05-09T09:55:41.491823+0000","last_active":"2024-05-09T09:55:56.705558+0000","last_peered":"2024-05-09T09:55:56.705558+0000","last_clean":"2024-05-09T09:55:56.705558+0000","last_became_active":"2024-05-09T09:55:41.488846+0000","last_became_peered":"2024-05-09T09:55:41.488846+0000","last_unstale":"2024-05-09T09:55:56.705558+0000","last_undegraded":"2024-05-09T09:55:56.705558+0000","last_fullsized":"2024-05-09T09:55:56.705558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:00.130607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"73'11","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016975+0000","last_change":"2024-05-09T09:55:10.972117+0000","last_active":"2024-05-09T09:55:58.016975+0000","last_peered":"2024-05-09T09:55:58.016975+0000","last_clean":"2024-05-09T09:55:58.016975+0000","last_became_active":"2024-05-09T09:55:10.507132+0000","last_became_peered":"2024-05-09T09:55:10.507132+0000","last_unstale":"2024-05-09T09:55:58.016975+0000","last_undegraded":"2024-05-09T09:55:58.016975+0000","last_fullsized":"2024-05-09T09:55:58.016975+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:59.211608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":22550,"num_write":51,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512533+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:55:57.512533+0000","last_peered":"2024-05-09T09:55:57.512533+0000","last_clean":"2024-05-09T09:55:57.512533+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:55:57.512533+0000","last_undegraded":"2024-05-09T09:55:57.512533+0000","last_fullsized":"2024-05-09T09:55:57.512533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"78'20","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706140+0000","last_change":"2024-05-09T09:55:42.405072+0000","last_active":"2024-05-09T09:55:56.706140+0000","last_peered":"2024-05-09T09:55:56.706140+0000","last_clean":"2024-05-09T09:55:56.706140+0000","last_became_active":"2024-05-09T09:55:41.509467+0000","last_became_peered":"2024-05-09T09:55:41.509467+0000","last_unstale":"2024-05-09T09:55:56.706140+0000","last_undegraded":"2024-05-09T09:55:56.706140+0000","last_fullsized":"2024-05-09T09:55:56.706140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:31.891322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":28,"num_write":26,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":6936,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706227+0000","last_change":"2024-05-09T09:55:10.506676+0000","last_active":"2024-05-09T09:55:56.706227+0000","last_peered":"2024-05-09T09:55:56.706227+0000","last_clean":"2024-05-09T09:55:56.706227+0000","last_became_active":"2024-05-09T09:55:10.506376+0000","last_became_peered":"2024-05-09T09:55:10.506376+0000","last_unstale":"2024-05-09T09:55:56.706227+0000","last_undegraded":"2024-05-09T09:55:56.706227+0000","last_fullsized":"2024-05-09T09:55:56.706227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:18.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"63'2","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016084+0000","last_change":"2024-05-09T09:55:11.409285+0000","last_active":"2024-05-09T09:55:58.016084+0000","last_peered":"2024-05-09T09:55:58.016084+0000","last_clean":"2024-05-09T09:55:58.016084+0000","last_became_active":"2024-05-09T09:55:10.512509+0000","last_became_peered":"2024-05-09T09:55:10.512509+0000","last_unstale":"2024-05-09T09:55:58.016084+0000","last_undegraded":"2024-05-09T09:55:58.016084+0000","last_fullsized":"2024-05-09T09:55:58.016084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:08.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706333+0000","last_change":"2024-05-09T09:55:41.477052+0000","last_active":"2024-05-09T09:55:56.706333+0000","last_peered":"2024-05-09T09:55:56.706333+0000","last_clean":"2024-05-09T09:55:56.706333+0000","last_became_active":"2024-05-09T09:55:41.471497+0000","last_became_peered":"2024-05-09T09:55:41.471497+0000","last_unstale":"2024-05-09T09:55:56.706333+0000","last_undegraded":"2024-05-09T09:55:56.706333+0000","last_fullsized":"2024-05-09T09:55:56.706333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:59:59.078912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'10","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298753+0000","last_change":"2024-05-09T09:55:42.508840+0000","last_active":"2024-05-09T09:55:57.298753+0000","last_peered":"2024-05-09T09:55:57.298753+0000","last_clean":"2024-05-09T09:55:57.298753+0000","last_became_active":"2024-05-09T09:55:41.513259+0000","last_became_peered":"2024-05-09T09:55:41.513259+0000","last_unstale":"2024-05-09T09:55:57.298753+0000","last_undegraded":"2024-05-09T09:55:57.298753+0000","last_fullsized":"2024-05-09T09:55:57.298753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703127+0000","last_change":"2024-05-09T09:55:41.505012+0000","last_active":"2024-05-09T09:55:56.703127+0000","last_peered":"2024-05-09T09:55:56.703127+0000","last_clean":"2024-05-09T09:55:56.703127+0000","last_became_active":"2024-05-09T09:55:41.504609+0000","last_became_peered":"2024-05-09T09:55:41.504609+0000","last_unstale":"2024-05-09T09:55:56.703127+0000","last_undegraded":"2024-05-09T09:55:56.703127+0000","last_fullsized":"2024-05-09T09:55:56.703127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"73'24","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512979+0000","last_change":"2024-05-09T09:55:10.818400+0000","last_active":"2024-05-09T09:55:57.512979+0000","last_peered":"2024-05-09T09:55:57.512979+0000","last_clean":"2024-05-09T09:55:57.512979+0000","last_became_active":"2024-05-09T09:55:10.520615+0000","last_became_peered":"2024-05-09T09:55:10.520615+0000","last_unstale":"2024-05-09T09:55:57.512979+0000","last_undegraded":"2024-05-09T09:55:57.512979+0000","last_fullsized":"2024-05-09T09:55:57.512979+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:32.213479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":3002,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'15","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513004+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:55:57.513004+0000","last_peered":"2024-05-09T09:55:57.513004+0000","last_clean":"2024-05-09T09:55:57.513004+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:55:57.513004+0000","last_undegraded":"2024-05-09T09:55:57.513004+0000","last_fullsized":"2024-05-09T09:55:57.513004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702414+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:55:56.702414+0000","last_peered":"2024-05-09T09:55:56.702414+0000","last_clean":"2024-05-09T09:55:56.702414+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:55:56.702414+0000","last_undegraded":"2024-05-09T09:55:56.702414+0000","last_fullsized":"2024-05-09T09:55:56.702414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706758+0000","last_change":"2024-05-09T09:55:42.572344+0000","last_active":"2024-05-09T09:55:56.706758+0000","last_peered":"2024-05-09T09:55:56.706758+0000","last_clean":"2024-05-09T09:55:56.706758+0000","last_became_active":"2024-05-09T09:55:41.517278+0000","last_became_peered":"2024-05-09T09:55:41.517278+0000","last_unstale":"2024-05-09T09:55:56.706758+0000","last_undegraded":"2024-05-09T09:55:56.706758+0000","last_fullsized":"2024-05-09T09:55:56.706758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'12","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704482+0000","last_change":"2024-05-09T09:55:42.204305+0000","last_active":"2024-05-09T09:55:56.704482+0000","last_peered":"2024-05-09T09:55:56.704482+0000","last_clean":"2024-05-09T09:55:56.704482+0000","last_became_active":"2024-05-09T09:55:41.481490+0000","last_became_peered":"2024-05-09T09:55:41.481490+0000","last_unstale":"2024-05-09T09:55:56.704482+0000","last_undegraded":"2024-05-09T09:55:56.704482+0000","last_fullsized":"2024-05-09T09:55:56.704482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402933+0000","last_change":"2024-05-09T09:55:41.651487+0000","last_active":"2024-05-09T09:55:57.402933+0000","last_peered":"2024-05-09T09:55:57.402933+0000","last_clean":"2024-05-09T09:55:57.402933+0000","last_became_active":"2024-05-09T09:55:41.495448+0000","last_became_peered":"2024-05-09T09:55:41.495448+0000","last_unstale":"2024-05-09T09:55:57.402933+0000","last_undegraded":"2024-05-09T09:55:57.402933+0000","last_fullsized":"2024-05-09T09:55:57.402933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:09.689288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017854+0000","last_change":"2024-05-09T09:55:11.115278+0000","last_active":"2024-05-09T09:55:58.017854+0000","last_peered":"2024-05-09T09:55:58.017854+0000","last_clean":"2024-05-09T09:55:58.017854+0000","last_became_active":"2024-05-09T09:55:10.512273+0000","last_became_peered":"2024-05-09T09:55:10.512273+0000","last_unstale":"2024-05-09T09:55:58.017854+0000","last_undegraded":"2024-05-09T09:55:58.017854+0000","last_fullsized":"2024-05-09T09:55:58.017854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:23:44.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'15","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298835+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:55:57.298835+0000","last_peered":"2024-05-09T09:55:57.298835+0000","last_clean":"2024-05-09T09:55:57.298835+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:55:57.298835+0000","last_undegraded":"2024-05-09T09:55:57.298835+0000","last_fullsized":"2024-05-09T09:55:57.298835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705087+0000","last_change":"2024-05-09T09:55:41.475763+0000","last_active":"2024-05-09T09:55:56.705087+0000","last_peered":"2024-05-09T09:55:56.705087+0000","last_clean":"2024-05-09T09:55:56.705087+0000","last_became_active":"2024-05-09T09:55:41.474020+0000","last_became_peered":"2024-05-09T09:55:41.474020+0000","last_unstale":"2024-05-09T09:55:56.705087+0000","last_undegraded":"2024-05-09T09:55:56.705087+0000","last_fullsized":"2024-05-09T09:55:56.705087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:59.415817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"75'42","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703965+0000","last_change":"2024-05-09T09:55:11.077756+0000","last_active":"2024-05-09T09:55:56.703965+0000","last_peered":"2024-05-09T09:55:56.703965+0000","last_clean":"2024-05-09T09:55:56.703965+0000","last_became_active":"2024-05-09T09:55:10.516407+0000","last_became_peered":"2024-05-09T09:55:10.516407+0000","last_unstale":"2024-05-09T09:55:56.703965+0000","last_undegraded":"2024-05-09T09:55:56.703965+0000","last_fullsized":"2024-05-09T09:55:56.703965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:29.572431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'7","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015602+0000","last_change":"2024-05-09T09:55:11.190571+0000","last_active":"2024-05-09T09:55:58.015602+0000","last_peered":"2024-05-09T09:55:58.015602+0000","last_clean":"2024-05-09T09:55:58.015602+0000","last_became_active":"2024-05-09T09:55:10.516633+0000","last_became_peered":"2024-05-09T09:55:10.516633+0000","last_unstale":"2024-05-09T09:55:58.015602+0000","last_undegraded":"2024-05-09T09:55:58.015602+0000","last_fullsized":"2024-05-09T09:55:58.015602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:56.816319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706539+0000","last_change":"2024-05-09T09:55:41.480580+0000","last_active":"2024-05-09T09:55:56.706539+0000","last_peered":"2024-05-09T09:55:56.706539+0000","last_clean":"2024-05-09T09:55:56.706539+0000","last_became_active":"2024-05-09T09:55:41.479634+0000","last_became_peered":"2024-05-09T09:55:41.479634+0000","last_unstale":"2024-05-09T09:55:56.706539+0000","last_undegraded":"2024-05-09T09:55:56.706539+0000","last_fullsized":"2024-05-09T09:55:56.706539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:12.037871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401416+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:55:57.401416+0000","last_peered":"2024-05-09T09:55:57.401416+0000","last_clean":"2024-05-09T09:55:57.401416+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:55:57.401416+0000","last_undegraded":"2024-05-09T09:55:57.401416+0000","last_fullsized":"2024-05-09T09:55:57.401416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298448+0000","last_change":"2024-05-09T09:55:10.503163+0000","last_active":"2024-05-09T09:55:57.298448+0000","last_peered":"2024-05-09T09:55:57.298448+0000","last_clean":"2024-05-09T09:55:57.298448+0000","last_became_active":"2024-05-09T09:55:10.501658+0000","last_became_peered":"2024-05-09T09:55:10.501658+0000","last_unstale":"2024-05-09T09:55:57.298448+0000","last_undegraded":"2024-05-09T09:55:57.298448+0000","last_fullsized":"2024-05-09T09:55:57.298448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:16.963610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704206+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:55:56.704206+0000","last_peered":"2024-05-09T09:55:56.704206+0000","last_clean":"2024-05-09T09:55:56.704206+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:55:56.704206+0000","last_undegraded":"2024-05-09T09:55:56.704206+0000","last_fullsized":"2024-05-09T09:55:56.704206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299020+0000","last_change":"2024-05-09T09:55:41.514105+0000","last_active":"2024-05-09T09:55:57.299020+0000","last_peered":"2024-05-09T09:55:57.299020+0000","last_clean":"2024-05-09T09:55:57.299020+0000","last_became_active":"2024-05-09T09:55:41.513454+0000","last_became_peered":"2024-05-09T09:55:41.513454+0000","last_unstale":"2024-05-09T09:55:57.299020+0000","last_undegraded":"2024-05-09T09:55:57.299020+0000","last_fullsized":"2024-05-09T09:55:57.299020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:12.201246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014983+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:55:58.014983+0000","last_peered":"2024-05-09T09:55:58.014983+0000","last_clean":"2024-05-09T09:55:58.014983+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:55:58.014983+0000","last_undegraded":"2024-05-09T09:55:58.014983+0000","last_fullsized":"2024-05-09T09:55:58.014983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401371+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:55:57.401371+0000","last_peered":"2024-05-09T09:55:57.401371+0000","last_clean":"2024-05-09T09:55:57.401371+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:55:57.401371+0000","last_undegraded":"2024-05-09T09:55:57.401371+0000","last_fullsized":"2024-05-09T09:55:57.401371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'10","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013595+0000","last_change":"2024-05-09T09:55:10.921973+0000","last_active":"2024-05-09T09:55:58.013595+0000","last_peered":"2024-05-09T09:55:58.013595+0000","last_clean":"2024-05-09T09:55:58.013595+0000","last_became_active":"2024-05-09T09:55:10.505428+0000","last_became_peered":"2024-05-09T09:55:10.505428+0000","last_unstale":"2024-05-09T09:55:58.013595+0000","last_undegraded":"2024-05-09T09:55:58.013595+0000","last_fullsized":"2024-05-09T09:55:58.013595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:11.081894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017491+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:55:58.017491+0000","last_peered":"2024-05-09T09:55:58.017491+0000","last_clean":"2024-05-09T09:55:58.017491+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:55:58.017491+0000","last_undegraded":"2024-05-09T09:55:58.017491+0000","last_fullsized":"2024-05-09T09:55:58.017491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'36","reported_seq":231,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402785+0000","last_change":"2024-05-09T09:55:11.706091+0000","last_active":"2024-05-09T09:55:57.402785+0000","last_peered":"2024-05-09T09:55:57.402785+0000","last_clean":"2024-05-09T09:55:57.402785+0000","last_became_active":"2024-05-09T09:55:10.522989+0000","last_became_peered":"2024-05-09T09:55:10.522989+0000","last_unstale":"2024-05-09T09:55:57.402785+0000","last_undegraded":"2024-05-09T09:55:57.402785+0000","last_fullsized":"2024-05-09T09:55:57.402785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:21.617588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":11272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706558+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:55:56.706558+0000","last_peered":"2024-05-09T09:55:56.706558+0000","last_clean":"2024-05-09T09:55:56.706558+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:55:56.706558+0000","last_undegraded":"2024-05-09T09:55:56.706558+0000","last_fullsized":"2024-05-09T09:55:56.706558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297460+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:55:57.297460+0000","last_peered":"2024-05-09T09:55:57.297460+0000","last_clean":"2024-05-09T09:55:57.297460+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:55:57.297460+0000","last_undegraded":"2024-05-09T09:55:57.297460+0000","last_fullsized":"2024-05-09T09:55:57.297460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706199+0000","last_change":"2024-05-09T09:53:54.476843+0000","last_active":"2024-05-09T09:55:56.706199+0000","last_peered":"2024-05-09T09:55:56.706199+0000","last_clean":"2024-05-09T09:55:56.706199+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:55:56.706199+0000","last_undegraded":"2024-05-09T09:55:56.706199+0000","last_fullsized":"2024-05-09T09:55:56.706199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:48.486905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015011+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:55:58.015011+0000","last_peered":"2024-05-09T09:55:58.015011+0000","last_clean":"2024-05-09T09:55:58.015011+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:55:58.015011+0000","last_undegraded":"2024-05-09T09:55:58.015011+0000","last_fullsized":"2024-05-09T09:55:58.015011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"66'7","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701698+0000","last_change":"2024-05-09T09:55:42.599407+0000","last_active":"2024-05-09T09:55:56.701698+0000","last_peered":"2024-05-09T09:55:56.701698+0000","last_clean":"2024-05-09T09:55:56.701698+0000","last_became_active":"2024-05-09T09:55:41.489210+0000","last_became_peered":"2024-05-09T09:55:41.489210+0000","last_unstale":"2024-05-09T09:55:56.701698+0000","last_undegraded":"2024-05-09T09:55:56.701698+0000","last_fullsized":"2024-05-09T09:55:56.701698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:36:38.674440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":7,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402446+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:55:57.402446+0000","last_peered":"2024-05-09T09:55:57.402446+0000","last_clean":"2024-05-09T09:55:57.402446+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:55:57.402446+0000","last_undegraded":"2024-05-09T09:55:57.402446+0000","last_fullsized":"2024-05-09T09:55:57.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'60","reported_seq":266,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703266+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:55:56.703266+0000","last_peered":"2024-05-09T09:55:56.703266+0000","last_clean":"2024-05-09T09:55:56.703266+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:55:56.703266+0000","last_undegraded":"2024-05-09T09:55:56.703266+0000","last_fullsized":"2024-05-09T09:55:56.703266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26264,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":86,"num_read_kb":110,"num_write":58,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018988+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:55:58.018988+0000","last_peered":"2024-05-09T09:55:58.018988+0000","last_clean":"2024-05-09T09:55:58.018988+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:55:58.018988+0000","last_undegraded":"2024-05-09T09:55:58.018988+0000","last_fullsized":"2024-05-09T09:55:58.018988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704712+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:55:56.704712+0000","last_peered":"2024-05-09T09:55:56.704712+0000","last_clean":"2024-05-09T09:55:56.704712+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:55:56.704712+0000","last_undegraded":"2024-05-09T09:55:56.704712+0000","last_fullsized":"2024-05-09T09:55:56.704712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'46","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704619+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:55:56.704619+0000","last_peered":"2024-05-09T09:55:56.704619+0000","last_clean":"2024-05-09T09:55:56.704619+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:55:56.704619+0000","last_undegraded":"2024-05-09T09:55:56.704619+0000","last_fullsized":"2024-05-09T09:55:56.704619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512113+0000","last_change":"2024-05-09T09:55:10.500785+0000","last_active":"2024-05-09T09:55:57.512113+0000","last_peered":"2024-05-09T09:55:57.512113+0000","last_clean":"2024-05-09T09:55:57.512113+0000","last_became_active":"2024-05-09T09:55:10.500197+0000","last_became_peered":"2024-05-09T09:55:10.500197+0000","last_unstale":"2024-05-09T09:55:57.512113+0000","last_undegraded":"2024-05-09T09:55:57.512113+0000","last_fullsized":"2024-05-09T09:55:57.512113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:17.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700597+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:55:56.700597+0000","last_peered":"2024-05-09T09:55:56.700597+0000","last_clean":"2024-05-09T09:55:56.700597+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:55:56.700597+0000","last_undegraded":"2024-05-09T09:55:56.700597+0000","last_fullsized":"2024-05-09T09:55:56.700597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513015+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:55:57.513015+0000","last_peered":"2024-05-09T09:55:57.513015+0000","last_clean":"2024-05-09T09:55:57.513015+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:55:57.513015+0000","last_undegraded":"2024-05-09T09:55:57.513015+0000","last_fullsized":"2024-05-09T09:55:57.513015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018568+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:55:58.018568+0000","last_peered":"2024-05-09T09:55:58.018568+0000","last_clean":"2024-05-09T09:55:58.018568+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:55:58.018568+0000","last_undegraded":"2024-05-09T09:55:58.018568+0000","last_fullsized":"2024-05-09T09:55:58.018568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704334+0000","last_change":"2024-05-09T09:55:41.486659+0000","last_active":"2024-05-09T09:55:56.704334+0000","last_peered":"2024-05-09T09:55:56.704334+0000","last_clean":"2024-05-09T09:55:56.704334+0000","last_became_active":"2024-05-09T09:55:41.486383+0000","last_became_peered":"2024-05-09T09:55:41.486383+0000","last_unstale":"2024-05-09T09:55:56.704334+0000","last_undegraded":"2024-05-09T09:55:56.704334+0000","last_fullsized":"2024-05-09T09:55:56.704334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:13.922715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"75'2","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013230+0000","last_change":"2024-05-09T09:55:44.856823+0000","last_active":"2024-05-09T09:55:58.013230+0000","last_peered":"2024-05-09T09:55:58.013230+0000","last_clean":"2024-05-09T09:55:58.013230+0000","last_became_active":"2024-05-09T09:55:41.512553+0000","last_became_peered":"2024-05-09T09:55:41.512553+0000","last_unstale":"2024-05-09T09:55:58.013230+0000","last_undegraded":"2024-05-09T09:55:58.013230+0000","last_fullsized":"2024-05-09T09:55:58.013230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401767+0000","last_change":"2024-05-09T09:54:55.401865+0000","last_active":"2024-05-09T09:55:57.401767+0000","last_peered":"2024-05-09T09:55:57.401767+0000","last_clean":"2024-05-09T09:55:57.401767+0000","last_became_active":"2024-05-09T09:54:55.401038+0000","last_became_peered":"2024-05-09T09:54:55.401038+0000","last_unstale":"2024-05-09T09:55:57.401767+0000","last_undegraded":"2024-05-09T09:55:57.401767+0000","last_fullsized":"2024-05-09T09:55:57.401767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:01.972187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399656+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:55:57.399656+0000","last_peered":"2024-05-09T09:55:57.399656+0000","last_clean":"2024-05-09T09:55:57.399656+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:55:57.399656+0000","last_undegraded":"2024-05-09T09:55:57.399656+0000","last_fullsized":"2024-05-09T09:55:57.399656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705226+0000","last_change":"2024-05-09T09:55:41.719143+0000","last_active":"2024-05-09T09:55:56.705226+0000","last_peered":"2024-05-09T09:55:56.705226+0000","last_clean":"2024-05-09T09:55:56.705226+0000","last_became_active":"2024-05-09T09:55:41.469663+0000","last_became_peered":"2024-05-09T09:55:41.469663+0000","last_unstale":"2024-05-09T09:55:56.705226+0000","last_undegraded":"2024-05-09T09:55:56.705226+0000","last_fullsized":"2024-05-09T09:55:56.705226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:45.753913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705749+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:55:56.705749+0000","last_peered":"2024-05-09T09:55:56.705749+0000","last_clean":"2024-05-09T09:55:56.705749+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:55:56.705749+0000","last_undegraded":"2024-05-09T09:55:56.705749+0000","last_fullsized":"2024-05-09T09:55:56.705749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015389+0000","last_change":"2024-05-09T09:55:42.823551+0000","last_active":"2024-05-09T09:55:58.015389+0000","last_peered":"2024-05-09T09:55:58.015389+0000","last_clean":"2024-05-09T09:55:58.015389+0000","last_became_active":"2024-05-09T09:55:41.504368+0000","last_became_peered":"2024-05-09T09:55:41.504368+0000","last_unstale":"2024-05-09T09:55:58.015389+0000","last_undegraded":"2024-05-09T09:55:58.015389+0000","last_fullsized":"2024-05-09T09:55:58.015389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:38.841317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299096+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:55:57.299096+0000","last_peered":"2024-05-09T09:55:57.299096+0000","last_clean":"2024-05-09T09:55:57.299096+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:55:57.299096+0000","last_undegraded":"2024-05-09T09:55:57.299096+0000","last_fullsized":"2024-05-09T09:55:57.299096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400161+0000","last_change":"2024-05-09T09:55:10.495545+0000","last_active":"2024-05-09T09:55:57.400161+0000","last_peered":"2024-05-09T09:55:57.400161+0000","last_clean":"2024-05-09T09:55:57.400161+0000","last_became_active":"2024-05-09T09:55:10.494741+0000","last_became_peered":"2024-05-09T09:55:10.494741+0000","last_unstale":"2024-05-09T09:55:57.400161+0000","last_undegraded":"2024-05-09T09:55:57.400161+0000","last_fullsized":"2024-05-09T09:55:57.400161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:36.220917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703539+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:55:56.703539+0000","last_peered":"2024-05-09T09:55:56.703539+0000","last_clean":"2024-05-09T09:55:56.703539+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:55:56.703539+0000","last_undegraded":"2024-05-09T09:55:56.703539+0000","last_fullsized":"2024-05-09T09:55:56.703539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'13","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402554+0000","last_change":"2024-05-09T09:55:10.791937+0000","last_active":"2024-05-09T09:55:57.402554+0000","last_peered":"2024-05-09T09:55:57.402554+0000","last_clean":"2024-05-09T09:55:57.402554+0000","last_became_active":"2024-05-09T09:55:10.494626+0000","last_became_peered":"2024-05-09T09:55:10.494626+0000","last_unstale":"2024-05-09T09:55:57.402554+0000","last_undegraded":"2024-05-09T09:55:57.402554+0000","last_fullsized":"2024-05-09T09:55:57.402554+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:06:49.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":23,"num_read_kb":30738,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702746+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:55:56.702746+0000","last_peered":"2024-05-09T09:55:56.702746+0000","last_clean":"2024-05-09T09:55:56.702746+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:55:56.702746+0000","last_undegraded":"2024-05-09T09:55:56.702746+0000","last_fullsized":"2024-05-09T09:55:56.702746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704736+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:55:56.704736+0000","last_peered":"2024-05-09T09:55:56.704736+0000","last_clean":"2024-05-09T09:55:56.704736+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:55:56.704736+0000","last_undegraded":"2024-05-09T09:55:56.704736+0000","last_fullsized":"2024-05-09T09:55:56.704736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'32","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700571+0000","last_change":"2024-05-09T09:55:10.807327+0000","last_active":"2024-05-09T09:55:56.700571+0000","last_peered":"2024-05-09T09:55:56.700571+0000","last_clean":"2024-05-09T09:55:56.700571+0000","last_became_active":"2024-05-09T09:55:10.495540+0000","last_became_peered":"2024-05-09T09:55:10.495540+0000","last_unstale":"2024-05-09T09:55:56.700571+0000","last_undegraded":"2024-05-09T09:55:56.700571+0000","last_fullsized":"2024-05-09T09:55:56.700571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:01.735473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":3221,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704004+0000","last_change":"2024-05-09T09:55:41.499842+0000","last_active":"2024-05-09T09:55:56.704004+0000","last_peered":"2024-05-09T09:55:56.704004+0000","last_clean":"2024-05-09T09:55:56.704004+0000","last_became_active":"2024-05-09T09:55:41.496466+0000","last_became_peered":"2024-05-09T09:55:41.496466+0000","last_unstale":"2024-05-09T09:55:56.704004+0000","last_undegraded":"2024-05-09T09:55:56.704004+0000","last_fullsized":"2024-05-09T09:55:56.704004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:35.612226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706873+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:55:56.706873+0000","last_peered":"2024-05-09T09:55:56.706873+0000","last_clean":"2024-05-09T09:55:56.706873+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:55:56.706873+0000","last_undegraded":"2024-05-09T09:55:56.706873+0000","last_fullsized":"2024-05-09T09:55:56.706873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705288+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:55:56.705288+0000","last_peered":"2024-05-09T09:55:56.705288+0000","last_clean":"2024-05-09T09:55:56.705288+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:55:56.705288+0000","last_undegraded":"2024-05-09T09:55:56.705288+0000","last_fullsized":"2024-05-09T09:55:56.705288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'9","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702837+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:55:56.702837+0000","last_peered":"2024-05-09T09:55:56.702837+0000","last_clean":"2024-05-09T09:55:56.702837+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:55:56.702837+0000","last_undegraded":"2024-05-09T09:55:56.702837+0000","last_fullsized":"2024-05-09T09:55:56.702837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":22546,"num_write":39,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015491+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:55:58.015491+0000","last_peered":"2024-05-09T09:55:58.015491+0000","last_clean":"2024-05-09T09:55:58.015491+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:55:58.015491+0000","last_undegraded":"2024-05-09T09:55:58.015491+0000","last_fullsized":"2024-05-09T09:55:58.015491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298282+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:55:57.298282+0000","last_peered":"2024-05-09T09:55:57.298282+0000","last_clean":"2024-05-09T09:55:57.298282+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:55:57.298282+0000","last_undegraded":"2024-05-09T09:55:57.298282+0000","last_fullsized":"2024-05-09T09:55:57.298282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702821+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:55:56.702821+0000","last_peered":"2024-05-09T09:55:56.702821+0000","last_clean":"2024-05-09T09:55:56.702821+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:55:56.702821+0000","last_undegraded":"2024-05-09T09:55:56.702821+0000","last_fullsized":"2024-05-09T09:55:56.702821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'15","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400649+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:55:57.400649+0000","last_peered":"2024-05-09T09:55:57.400649+0000","last_clean":"2024-05-09T09:55:57.400649+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:55:57.400649+0000","last_undegraded":"2024-05-09T09:55:57.400649+0000","last_fullsized":"2024-05-09T09:55:57.400649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018320+0000","last_change":"2024-05-09T09:55:10.517397+0000","last_active":"2024-05-09T09:55:58.018320+0000","last_peered":"2024-05-09T09:55:58.018320+0000","last_clean":"2024-05-09T09:55:58.018320+0000","last_became_active":"2024-05-09T09:55:10.515588+0000","last_became_peered":"2024-05-09T09:55:10.515588+0000","last_unstale":"2024-05-09T09:55:58.018320+0000","last_undegraded":"2024-05-09T09:55:58.018320+0000","last_fullsized":"2024-05-09T09:55:58.018320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:07.130003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"75'44","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015984+0000","last_change":"2024-05-09T09:55:11.515278+0000","last_active":"2024-05-09T09:55:58.015984+0000","last_peered":"2024-05-09T09:55:58.015984+0000","last_clean":"2024-05-09T09:55:58.015984+0000","last_became_active":"2024-05-09T09:55:10.518766+0000","last_became_peered":"2024-05-09T09:55:10.518766+0000","last_unstale":"2024-05-09T09:55:58.015984+0000","last_undegraded":"2024-05-09T09:55:58.015984+0000","last_fullsized":"2024-05-09T09:55:58.015984+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:19.443320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":112,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'13","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018454+0000","last_change":"2024-05-09T09:55:11.060481+0000","last_active":"2024-05-09T09:55:58.018454+0000","last_peered":"2024-05-09T09:55:58.018454+0000","last_clean":"2024-05-09T09:55:58.018454+0000","last_became_active":"2024-05-09T09:55:10.509265+0000","last_became_peered":"2024-05-09T09:55:10.509265+0000","last_unstale":"2024-05-09T09:55:58.018454+0000","last_undegraded":"2024-05-09T09:55:58.018454+0000","last_fullsized":"2024-05-09T09:55:58.018454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:58:29.838618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":16398,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704209+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:55:56.704209+0000","last_peered":"2024-05-09T09:55:56.704209+0000","last_clean":"2024-05-09T09:55:56.704209+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:55:56.704209+0000","last_undegraded":"2024-05-09T09:55:56.704209+0000","last_fullsized":"2024-05-09T09:55:56.704209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704461+0000","last_change":"2024-05-09T09:55:41.502710+0000","last_active":"2024-05-09T09:55:56.704461+0000","last_peered":"2024-05-09T09:55:56.704461+0000","last_clean":"2024-05-09T09:55:56.704461+0000","last_became_active":"2024-05-09T09:55:41.498766+0000","last_became_peered":"2024-05-09T09:55:41.498766+0000","last_unstale":"2024-05-09T09:55:56.704461+0000","last_undegraded":"2024-05-09T09:55:56.704461+0000","last_fullsized":"2024-05-09T09:55:56.704461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:11.800372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705353+0000","last_change":"2024-05-09T09:55:42.422831+0000","last_active":"2024-05-09T09:55:56.705353+0000","last_peered":"2024-05-09T09:55:56.705353+0000","last_clean":"2024-05-09T09:55:56.705353+0000","last_became_active":"2024-05-09T09:55:41.513003+0000","last_became_peered":"2024-05-09T09:55:41.513003+0000","last_unstale":"2024-05-09T09:55:56.705353+0000","last_undegraded":"2024-05-09T09:55:56.705353+0000","last_fullsized":"2024-05-09T09:55:56.705353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:07.499148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'18","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016568+0000","last_change":"2024-05-09T09:55:10.808760+0000","last_active":"2024-05-09T09:55:58.016568+0000","last_peered":"2024-05-09T09:55:58.016568+0000","last_clean":"2024-05-09T09:55:58.016568+0000","last_became_active":"2024-05-09T09:55:10.505477+0000","last_became_peered":"2024-05-09T09:55:10.505477+0000","last_unstale":"2024-05-09T09:55:58.016568+0000","last_undegraded":"2024-05-09T09:55:58.016568+0000","last_fullsized":"2024-05-09T09:55:58.016568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:21.462968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704510+0000","last_change":"2024-05-09T09:55:10.495913+0000","last_active":"2024-05-09T09:55:56.704510+0000","last_peered":"2024-05-09T09:55:56.704510+0000","last_clean":"2024-05-09T09:55:56.704510+0000","last_became_active":"2024-05-09T09:55:10.494445+0000","last_became_peered":"2024-05-09T09:55:10.494445+0000","last_unstale":"2024-05-09T09:55:56.704510+0000","last_undegraded":"2024-05-09T09:55:56.704510+0000","last_fullsized":"2024-05-09T09:55:56.704510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:58.669871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'10","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704782+0000","last_change":"2024-05-09T09:55:42.207577+0000","last_active":"2024-05-09T09:55:56.704782+0000","last_peered":"2024-05-09T09:55:56.704782+0000","last_clean":"2024-05-09T09:55:56.704782+0000","last_became_active":"2024-05-09T09:55:41.480316+0000","last_became_peered":"2024-05-09T09:55:41.480316+0000","last_unstale":"2024-05-09T09:55:56.704782+0000","last_undegraded":"2024-05-09T09:55:56.704782+0000","last_fullsized":"2024-05-09T09:55:56.704782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'13","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705886+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:55:56.705886+0000","last_peered":"2024-05-09T09:55:56.705886+0000","last_clean":"2024-05-09T09:55:56.705886+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:55:56.705886+0000","last_undegraded":"2024-05-09T09:55:56.705886+0000","last_fullsized":"2024-05-09T09:55:56.705886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299647+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:55:57.299647+0000","last_peered":"2024-05-09T09:55:57.299647+0000","last_clean":"2024-05-09T09:55:57.299647+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:55:57.299647+0000","last_undegraded":"2024-05-09T09:55:57.299647+0000","last_fullsized":"2024-05-09T09:55:57.299647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015902+0000","last_change":"2024-05-09T09:55:10.517926+0000","last_active":"2024-05-09T09:55:58.015902+0000","last_peered":"2024-05-09T09:55:58.015902+0000","last_clean":"2024-05-09T09:55:58.015902+0000","last_became_active":"2024-05-09T09:55:10.505544+0000","last_became_peered":"2024-05-09T09:55:10.505544+0000","last_unstale":"2024-05-09T09:55:58.015902+0000","last_undegraded":"2024-05-09T09:55:58.015902+0000","last_fullsized":"2024-05-09T09:55:58.015902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:13.161392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'38","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016660+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:55:58.016660+0000","last_peered":"2024-05-09T09:55:58.016660+0000","last_clean":"2024-05-09T09:55:58.016660+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:55:58.016660+0000","last_undegraded":"2024-05-09T09:55:58.016660+0000","last_fullsized":"2024-05-09T09:55:58.016660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21228,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":51,"num_write":36,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013580+0000","last_change":"2024-05-09T09:55:10.498516+0000","last_active":"2024-05-09T09:55:58.013580+0000","last_peered":"2024-05-09T09:55:58.013580+0000","last_clean":"2024-05-09T09:55:58.013580+0000","last_became_active":"2024-05-09T09:55:10.498080+0000","last_became_peered":"2024-05-09T09:55:10.498080+0000","last_unstale":"2024-05-09T09:55:58.013580+0000","last_undegraded":"2024-05-09T09:55:58.013580+0000","last_fullsized":"2024-05-09T09:55:58.013580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:21.659232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'2","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401538+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:55:57.401538+0000","last_peered":"2024-05-09T09:55:57.401538+0000","last_clean":"2024-05-09T09:55:57.401538+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:55:57.401538+0000","last_undegraded":"2024-05-09T09:55:57.401538+0000","last_fullsized":"2024-05-09T09:55:57.401538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706114+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:55:56.706114+0000","last_peered":"2024-05-09T09:55:56.706114+0000","last_clean":"2024-05-09T09:55:56.706114+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:55:56.706114+0000","last_undegraded":"2024-05-09T09:55:56.706114+0000","last_fullsized":"2024-05-09T09:55:56.706114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704880+0000","last_change":"2024-05-09T09:55:42.429944+0000","last_active":"2024-05-09T09:55:56.704880+0000","last_peered":"2024-05-09T09:55:56.704880+0000","last_clean":"2024-05-09T09:55:56.704880+0000","last_became_active":"2024-05-09T09:55:41.516290+0000","last_became_peered":"2024-05-09T09:55:41.516290+0000","last_unstale":"2024-05-09T09:55:56.704880+0000","last_undegraded":"2024-05-09T09:55:56.704880+0000","last_fullsized":"2024-05-09T09:55:56.704880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:59.070546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706067+0000","last_change":"2024-05-09T09:55:42.380229+0000","last_active":"2024-05-09T09:55:56.706067+0000","last_peered":"2024-05-09T09:55:56.706067+0000","last_clean":"2024-05-09T09:55:56.706067+0000","last_became_active":"2024-05-09T09:55:41.489973+0000","last_became_peered":"2024-05-09T09:55:41.489973+0000","last_unstale":"2024-05-09T09:55:56.706067+0000","last_undegraded":"2024-05-09T09:55:56.706067+0000","last_fullsized":"2024-05-09T09:55:56.706067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":30736,"num_write":41,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703216+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:55:56.703216+0000","last_peered":"2024-05-09T09:55:56.703216+0000","last_clean":"2024-05-09T09:55:56.703216+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:55:56.703216+0000","last_undegraded":"2024-05-09T09:55:56.703216+0000","last_fullsized":"2024-05-09T09:55:56.703216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"73'19","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013249+0000","last_change":"2024-05-09T09:55:10.932387+0000","last_active":"2024-05-09T09:55:58.013249+0000","last_peered":"2024-05-09T09:55:58.013249+0000","last_clean":"2024-05-09T09:55:58.013249+0000","last_became_active":"2024-05-09T09:55:10.507307+0000","last_became_peered":"2024-05-09T09:55:10.507307+0000","last_unstale":"2024-05-09T09:55:58.013249+0000","last_undegraded":"2024-05-09T09:55:58.013249+0000","last_fullsized":"2024-05-09T09:55:58.013249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:44.904375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":29,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016206+0000","last_change":"2024-05-09T09:55:10.519133+0000","last_active":"2024-05-09T09:55:58.016206+0000","last_peered":"2024-05-09T09:55:58.016206+0000","last_clean":"2024-05-09T09:55:58.016206+0000","last_became_active":"2024-05-09T09:55:10.518305+0000","last_became_peered":"2024-05-09T09:55:10.518305+0000","last_unstale":"2024-05-09T09:55:58.016206+0000","last_undegraded":"2024-05-09T09:55:58.016206+0000","last_fullsized":"2024-05-09T09:55:58.016206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:56.110070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018014+0000","last_change":"2024-05-09T09:55:10.505287+0000","last_active":"2024-05-09T09:55:58.018014+0000","last_peered":"2024-05-09T09:55:58.018014+0000","last_clean":"2024-05-09T09:55:58.018014+0000","last_became_active":"2024-05-09T09:55:10.504822+0000","last_became_peered":"2024-05-09T09:55:10.504822+0000","last_unstale":"2024-05-09T09:55:58.018014+0000","last_undegraded":"2024-05-09T09:55:58.018014+0000","last_fullsized":"2024-05-09T09:55:58.018014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:26.980095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016322+0000","last_change":"2024-05-09T09:54:55.399423+0000","last_active":"2024-05-09T09:55:58.016322+0000","last_peered":"2024-05-09T09:55:58.016322+0000","last_clean":"2024-05-09T09:55:58.016322+0000","last_became_active":"2024-05-09T09:54:55.398970+0000","last_became_peered":"2024-05-09T09:54:55.398970+0000","last_unstale":"2024-05-09T09:55:58.016322+0000","last_undegraded":"2024-05-09T09:55:58.016322+0000","last_fullsized":"2024-05-09T09:55:58.016322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"75'10","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017670+0000","last_change":"2024-05-09T09:55:10.626412+0000","last_active":"2024-05-09T09:55:58.017670+0000","last_peered":"2024-05-09T09:55:58.017670+0000","last_clean":"2024-05-09T09:55:58.017670+0000","last_became_active":"2024-05-09T09:55:10.499847+0000","last_became_peered":"2024-05-09T09:55:10.499847+0000","last_unstale":"2024-05-09T09:55:58.017670+0000","last_undegraded":"2024-05-09T09:55:58.017670+0000","last_fullsized":"2024-05-09T09:55:58.017670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016797+0000","last_change":"2024-05-09T09:55:10.508325+0000","last_active":"2024-05-09T09:55:58.016797+0000","last_peered":"2024-05-09T09:55:58.016797+0000","last_clean":"2024-05-09T09:55:58.016797+0000","last_became_active":"2024-05-09T09:55:10.506831+0000","last_became_peered":"2024-05-09T09:55:10.506831+0000","last_unstale":"2024-05-09T09:55:58.016797+0000","last_undegraded":"2024-05-09T09:55:58.016797+0000","last_fullsized":"2024-05-09T09:55:58.016797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:03.449411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700895+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:55:56.700895+0000","last_peered":"2024-05-09T09:55:56.700895+0000","last_clean":"2024-05-09T09:55:56.700895+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:55:56.700895+0000","last_undegraded":"2024-05-09T09:55:56.700895+0000","last_fullsized":"2024-05-09T09:55:56.700895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017129+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:55:58.017129+0000","last_peered":"2024-05-09T09:55:58.017129+0000","last_clean":"2024-05-09T09:55:58.017129+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:55:58.017129+0000","last_undegraded":"2024-05-09T09:55:58.017129+0000","last_fullsized":"2024-05-09T09:55:58.017129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700775+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:55:56.700775+0000","last_peered":"2024-05-09T09:55:56.700775+0000","last_clean":"2024-05-09T09:55:56.700775+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:55:56.700775+0000","last_undegraded":"2024-05-09T09:55:56.700775+0000","last_fullsized":"2024-05-09T09:55:56.700775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013446+0000","last_change":"2024-05-09T09:55:10.514293+0000","last_active":"2024-05-09T09:55:58.013446+0000","last_peered":"2024-05-09T09:55:58.013446+0000","last_clean":"2024-05-09T09:55:58.013446+0000","last_became_active":"2024-05-09T09:55:10.513915+0000","last_became_peered":"2024-05-09T09:55:10.513915+0000","last_unstale":"2024-05-09T09:55:58.013446+0000","last_undegraded":"2024-05-09T09:55:58.013446+0000","last_fullsized":"2024-05-09T09:55:58.013446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:03.485055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"66'9","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402201+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:55:57.402201+0000","last_peered":"2024-05-09T09:55:57.402201+0000","last_clean":"2024-05-09T09:55:57.402201+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:55:57.402201+0000","last_undegraded":"2024-05-09T09:55:57.402201+0000","last_fullsized":"2024-05-09T09:55:57.402201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015455+0000","last_change":"2024-05-09T09:55:42.066725+0000","last_active":"2024-05-09T09:55:58.015455+0000","last_peered":"2024-05-09T09:55:58.015455+0000","last_clean":"2024-05-09T09:55:58.015455+0000","last_became_active":"2024-05-09T09:55:41.506927+0000","last_became_peered":"2024-05-09T09:55:41.506927+0000","last_unstale":"2024-05-09T09:55:58.015455+0000","last_undegraded":"2024-05-09T09:55:58.015455+0000","last_fullsized":"2024-05-09T09:55:58.015455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'21","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016885+0000","last_change":"2024-05-09T09:55:11.122289+0000","last_active":"2024-05-09T09:55:58.016885+0000","last_peered":"2024-05-09T09:55:58.016885+0000","last_clean":"2024-05-09T09:55:58.016885+0000","last_became_active":"2024-05-09T09:55:10.507511+0000","last_became_peered":"2024-05-09T09:55:10.507511+0000","last_unstale":"2024-05-09T09:55:58.016885+0000","last_undegraded":"2024-05-09T09:55:58.016885+0000","last_fullsized":"2024-05-09T09:55:58.016885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:29.227840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12481,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":39,"num_write":24,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297997+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:55:57.297997+0000","last_peered":"2024-05-09T09:55:57.297997+0000","last_clean":"2024-05-09T09:55:57.297997+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:55:57.297997+0000","last_undegraded":"2024-05-09T09:55:57.297997+0000","last_fullsized":"2024-05-09T09:55:57.297997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401098+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:55:57.401098+0000","last_peered":"2024-05-09T09:55:57.401098+0000","last_clean":"2024-05-09T09:55:57.401098+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:55:57.401098+0000","last_undegraded":"2024-05-09T09:55:57.401098+0000","last_fullsized":"2024-05-09T09:55:57.401098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'38","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015759+0000","last_change":"2024-05-09T09:55:11.526822+0000","last_active":"2024-05-09T09:55:58.015759+0000","last_peered":"2024-05-09T09:55:58.015759+0000","last_clean":"2024-05-09T09:55:58.015759+0000","last_became_active":"2024-05-09T09:55:10.520941+0000","last_became_peered":"2024-05-09T09:55:10.520941+0000","last_unstale":"2024-05-09T09:55:58.015759+0000","last_undegraded":"2024-05-09T09:55:58.015759+0000","last_fullsized":"2024-05-09T09:55:58.015759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:25.981081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'8","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706483+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:55:56.706483+0000","last_peered":"2024-05-09T09:55:56.706483+0000","last_clean":"2024-05-09T09:55:56.706483+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:55:56.706483+0000","last_undegraded":"2024-05-09T09:55:56.706483+0000","last_fullsized":"2024-05-09T09:55:56.706483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298179+0000","last_change":"2024-05-09T09:55:41.515909+0000","last_active":"2024-05-09T09:55:57.298179+0000","last_peered":"2024-05-09T09:55:57.298179+0000","last_clean":"2024-05-09T09:55:57.298179+0000","last_became_active":"2024-05-09T09:55:41.514849+0000","last_became_peered":"2024-05-09T09:55:41.514849+0000","last_unstale":"2024-05-09T09:55:57.298179+0000","last_undegraded":"2024-05-09T09:55:57.298179+0000","last_fullsized":"2024-05-09T09:55:57.298179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:02.137573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"73'15","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016535+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:55:58.016535+0000","last_peered":"2024-05-09T09:55:58.016535+0000","last_clean":"2024-05-09T09:55:58.016535+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:55:58.016535+0000","last_undegraded":"2024-05-09T09:55:58.016535+0000","last_fullsized":"2024-05-09T09:55:58.016535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703964+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:55:56.703964+0000","last_peered":"2024-05-09T09:55:56.703964+0000","last_clean":"2024-05-09T09:55:56.703964+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:55:56.703964+0000","last_undegraded":"2024-05-09T09:55:56.703964+0000","last_fullsized":"2024-05-09T09:55:56.703964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299559+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:55:57.299559+0000","last_peered":"2024-05-09T09:55:57.299559+0000","last_clean":"2024-05-09T09:55:57.299559+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:55:57.299559+0000","last_undegraded":"2024-05-09T09:55:57.299559+0000","last_fullsized":"2024-05-09T09:55:57.299559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"67'11","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511830+0000","last_change":"2024-05-09T09:55:55.809479+0000","last_active":"2024-05-09T09:55:57.511830+0000","last_peered":"2024-05-09T09:55:57.511830+0000","last_clean":"2024-05-09T09:55:57.511830+0000","last_became_active":"2024-05-09T09:55:55.677234+0000","last_became_peered":"2024-05-09T09:55:55.677234+0000","last_unstale":"2024-05-09T09:55:57.511830+0000","last_undegraded":"2024-05-09T09:55:57.511830+0000","last_fullsized":"2024-05-09T09:55:57.511830+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:44.116858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":8196,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706475+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:55:56.706475+0000","last_peered":"2024-05-09T09:55:56.706475+0000","last_clean":"2024-05-09T09:55:56.706475+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:55:56.706475+0000","last_undegraded":"2024-05-09T09:55:56.706475+0000","last_fullsized":"2024-05-09T09:55:56.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"73'26","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704104+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:55:56.704104+0000","last_peered":"2024-05-09T09:55:56.704104+0000","last_clean":"2024-05-09T09:55:56.704104+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:55:56.704104+0000","last_undegraded":"2024-05-09T09:55:56.704104+0000","last_fullsized":"2024-05-09T09:55:56.704104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401447+0000","last_change":"2024-05-09T09:55:10.495749+0000","last_active":"2024-05-09T09:55:57.401447+0000","last_peered":"2024-05-09T09:55:57.401447+0000","last_clean":"2024-05-09T09:55:57.401447+0000","last_became_active":"2024-05-09T09:55:10.494186+0000","last_became_peered":"2024-05-09T09:55:10.494186+0000","last_unstale":"2024-05-09T09:55:57.401447+0000","last_undegraded":"2024-05-09T09:55:57.401447+0000","last_fullsized":"2024-05-09T09:55:57.401447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:53:44.097211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016703+0000","last_change":"2024-05-09T09:55:10.505728+0000","last_active":"2024-05-09T09:55:58.016703+0000","last_peered":"2024-05-09T09:55:58.016703+0000","last_clean":"2024-05-09T09:55:58.016703+0000","last_became_active":"2024-05-09T09:55:10.504907+0000","last_became_peered":"2024-05-09T09:55:10.504907+0000","last_unstale":"2024-05-09T09:55:58.016703+0000","last_undegraded":"2024-05-09T09:55:58.016703+0000","last_fullsized":"2024-05-09T09:55:58.016703+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:34.895344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706201+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:55:56.706201+0000","last_peered":"2024-05-09T09:55:56.706201+0000","last_clean":"2024-05-09T09:55:56.706201+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:55:56.706201+0000","last_undegraded":"2024-05-09T09:55:56.706201+0000","last_fullsized":"2024-05-09T09:55:56.706201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"67'3","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701843+0000","last_change":"2024-05-09T09:55:10.559316+0000","last_active":"2024-05-09T09:55:56.701843+0000","last_peered":"2024-05-09T09:55:56.701843+0000","last_clean":"2024-05-09T09:55:56.701843+0000","last_became_active":"2024-05-09T09:55:10.497596+0000","last_became_peered":"2024-05-09T09:55:10.497596+0000","last_unstale":"2024-05-09T09:55:56.701843+0000","last_undegraded":"2024-05-09T09:55:56.701843+0000","last_fullsized":"2024-05-09T09:55:56.701843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299240+0000","last_change":"2024-05-09T09:55:41.513826+0000","last_active":"2024-05-09T09:55:57.299240+0000","last_peered":"2024-05-09T09:55:57.299240+0000","last_clean":"2024-05-09T09:55:57.299240+0000","last_became_active":"2024-05-09T09:55:41.513248+0000","last_became_peered":"2024-05-09T09:55:41.513248+0000","last_unstale":"2024-05-09T09:55:57.299240+0000","last_undegraded":"2024-05-09T09:55:57.299240+0000","last_fullsized":"2024-05-09T09:55:57.299240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:15.704381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"73'27","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017080+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:55:58.017080+0000","last_peered":"2024-05-09T09:55:58.017080+0000","last_clean":"2024-05-09T09:55:58.017080+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:55:58.017080+0000","last_undegraded":"2024-05-09T09:55:58.017080+0000","last_fullsized":"2024-05-09T09:55:58.017080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8545,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":42,"num_read_kb":54,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703868+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:55:56.703868+0000","last_peered":"2024-05-09T09:55:56.703868+0000","last_clean":"2024-05-09T09:55:56.703868+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:55:56.703868+0000","last_undegraded":"2024-05-09T09:55:56.703868+0000","last_fullsized":"2024-05-09T09:55:56.703868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"63'4","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297673+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:55:57.297673+0000","last_peered":"2024-05-09T09:55:57.297673+0000","last_clean":"2024-05-09T09:55:57.297673+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:55:57.297673+0000","last_undegraded":"2024-05-09T09:55:57.297673+0000","last_fullsized":"2024-05-09T09:55:57.297673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017690+0000","last_change":"2024-05-09T09:55:10.500134+0000","last_active":"2024-05-09T09:55:58.017690+0000","last_peered":"2024-05-09T09:55:58.017690+0000","last_clean":"2024-05-09T09:55:58.017690+0000","last_became_active":"2024-05-09T09:55:10.499690+0000","last_became_peered":"2024-05-09T09:55:10.499690+0000","last_unstale":"2024-05-09T09:55:58.017690+0000","last_undegraded":"2024-05-09T09:55:58.017690+0000","last_fullsized":"2024-05-09T09:55:58.017690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"66'13","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704696+0000","last_change":"2024-05-09T09:55:42.033924+0000","last_active":"2024-05-09T09:55:56.704696+0000","last_peered":"2024-05-09T09:55:56.704696+0000","last_clean":"2024-05-09T09:55:56.704696+0000","last_became_active":"2024-05-09T09:55:41.481073+0000","last_became_peered":"2024-05-09T09:55:41.481073+0000","last_unstale":"2024-05-09T09:55:56.704696+0000","last_undegraded":"2024-05-09T09:55:56.704696+0000","last_fullsized":"2024-05-09T09:55:56.704696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:48.598565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":45062,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706054+0000","last_change":"2024-05-09T09:55:41.513074+0000","last_active":"2024-05-09T09:55:56.706054+0000","last_peered":"2024-05-09T09:55:56.706054+0000","last_clean":"2024-05-09T09:55:56.706054+0000","last_became_active":"2024-05-09T09:55:41.512431+0000","last_became_peered":"2024-05-09T09:55:41.512431+0000","last_unstale":"2024-05-09T09:55:56.706054+0000","last_undegraded":"2024-05-09T09:55:56.706054+0000","last_fullsized":"2024-05-09T09:55:56.706054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:14.565690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"73'20","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018290+0000","last_change":"2024-05-09T09:55:11.526104+0000","last_active":"2024-05-09T09:55:58.018290+0000","last_peered":"2024-05-09T09:55:58.018290+0000","last_clean":"2024-05-09T09:55:58.018290+0000","last_became_active":"2024-05-09T09:55:10.517760+0000","last_became_peered":"2024-05-09T09:55:10.517760+0000","last_unstale":"2024-05-09T09:55:58.018290+0000","last_undegraded":"2024-05-09T09:55:58.018290+0000","last_fullsized":"2024-05-09T09:55:58.018290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:24.084847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":34,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703148+0000","last_change":"2024-05-09T09:55:10.485758+0000","last_active":"2024-05-09T09:55:56.703148+0000","last_peered":"2024-05-09T09:55:56.703148+0000","last_clean":"2024-05-09T09:55:56.703148+0000","last_became_active":"2024-05-09T09:55:10.485167+0000","last_became_peered":"2024-05-09T09:55:10.485167+0000","last_unstale":"2024-05-09T09:55:56.703148+0000","last_undegraded":"2024-05-09T09:55:56.703148+0000","last_fullsized":"2024-05-09T09:55:56.703148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:16.070700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400396+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:55:57.400396+0000","last_peered":"2024-05-09T09:55:57.400396+0000","last_clean":"2024-05-09T09:55:57.400396+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:55:57.400396+0000","last_undegraded":"2024-05-09T09:55:57.400396+0000","last_fullsized":"2024-05-09T09:55:57.400396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511241+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:55:57.511241+0000","last_peered":"2024-05-09T09:55:57.511241+0000","last_clean":"2024-05-09T09:55:57.511241+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:55:57.511241+0000","last_undegraded":"2024-05-09T09:55:57.511241+0000","last_fullsized":"2024-05-09T09:55:57.511241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'10","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704163+0000","last_change":"2024-05-09T09:55:41.638527+0000","last_active":"2024-05-09T09:55:56.704163+0000","last_peered":"2024-05-09T09:55:56.704163+0000","last_clean":"2024-05-09T09:55:56.704163+0000","last_became_active":"2024-05-09T09:55:41.470350+0000","last_became_peered":"2024-05-09T09:55:41.470350+0000","last_unstale":"2024-05-09T09:55:56.704163+0000","last_undegraded":"2024-05-09T09:55:56.704163+0000","last_fullsized":"2024-05-09T09:55:56.704163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:55:41.504749+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:55:41.504290+0000","last_became_peered":"2024-05-09T09:55:41.504290+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706444+0000","last_change":"2024-05-09T09:55:42.568315+0000","last_active":"2024-05-09T09:55:56.706444+0000","last_peered":"2024-05-09T09:55:56.706444+0000","last_clean":"2024-05-09T09:55:56.706444+0000","last_became_active":"2024-05-09T09:55:41.517072+0000","last_became_peered":"2024-05-09T09:55:41.517072+0000","last_unstale":"2024-05-09T09:55:56.706444+0000","last_undegraded":"2024-05-09T09:55:56.706444+0000","last_fullsized":"2024-05-09T09:55:56.706444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:54.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'20","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299420+0000","last_change":"2024-05-09T09:55:44.549663+0000","last_active":"2024-05-09T09:55:57.299420+0000","last_peered":"2024-05-09T09:55:57.299420+0000","last_clean":"2024-05-09T09:55:57.299420+0000","last_became_active":"2024-05-09T09:55:41.514399+0000","last_became_peered":"2024-05-09T09:55:41.514399+0000","last_unstale":"2024-05-09T09:55:57.299420+0000","last_undegraded":"2024-05-09T09:55:57.299420+0000","last_fullsized":"2024-05-09T09:55:57.299420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:46.578164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"63'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015795+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:55:58.015795+0000","last_peered":"2024-05-09T09:55:58.015795+0000","last_clean":"2024-05-09T09:55:58.015795+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:55:58.015795+0000","last_undegraded":"2024-05-09T09:55:58.015795+0000","last_fullsized":"2024-05-09T09:55:58.015795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704832+0000","last_change":"2024-05-09T09:55:41.514279+0000","last_active":"2024-05-09T09:55:56.704832+0000","last_peered":"2024-05-09T09:55:56.704832+0000","last_clean":"2024-05-09T09:55:56.704832+0000","last_became_active":"2024-05-09T09:55:41.513724+0000","last_became_peered":"2024-05-09T09:55:41.513724+0000","last_unstale":"2024-05-09T09:55:56.704832+0000","last_undegraded":"2024-05-09T09:55:56.704832+0000","last_fullsized":"2024-05-09T09:55:56.704832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:53.879426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511499+0000","last_change":"2024-05-09T09:55:42.243360+0000","last_active":"2024-05-09T09:55:57.511499+0000","last_peered":"2024-05-09T09:55:57.511499+0000","last_clean":"2024-05-09T09:55:57.511499+0000","last_became_active":"2024-05-09T09:55:41.495012+0000","last_became_peered":"2024-05-09T09:55:41.495012+0000","last_unstale":"2024-05-09T09:55:57.511499+0000","last_undegraded":"2024-05-09T09:55:57.511499+0000","last_fullsized":"2024-05-09T09:55:57.511499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:55:30.669989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014988+0000","last_change":"2024-05-09T09:55:41.508232+0000","last_active":"2024-05-09T09:55:58.014988+0000","last_peered":"2024-05-09T09:55:58.014988+0000","last_clean":"2024-05-09T09:55:58.014988+0000","last_became_active":"2024-05-09T09:55:41.506905+0000","last_became_peered":"2024-05-09T09:55:41.506905+0000","last_unstale":"2024-05-09T09:55:58.014988+0000","last_undegraded":"2024-05-09T09:55:58.014988+0000","last_fullsized":"2024-05-09T09:55:58.014988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"73'24","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400581+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:55:57.400581+0000","last_peered":"2024-05-09T09:55:57.400581+0000","last_clean":"2024-05-09T09:55:57.400581+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:55:57.400581+0000","last_undegraded":"2024-05-09T09:55:57.400581+0000","last_fullsized":"2024-05-09T09:55:57.400581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701605+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:55:56.701605+0000","last_peered":"2024-05-09T09:55:56.701605+0000","last_clean":"2024-05-09T09:55:56.701605+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:55:56.701605+0000","last_undegraded":"2024-05-09T09:55:56.701605+0000","last_fullsized":"2024-05-09T09:55:56.701605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015572+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:55:58.015572+0000","last_peered":"2024-05-09T09:55:58.015572+0000","last_clean":"2024-05-09T09:55:58.015572+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:55:58.015572+0000","last_undegraded":"2024-05-09T09:55:58.015572+0000","last_fullsized":"2024-05-09T09:55:58.015572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705208+0000","last_change":"2024-05-09T09:55:41.513633+0000","last_active":"2024-05-09T09:55:56.705208+0000","last_peered":"2024-05-09T09:55:56.705208+0000","last_clean":"2024-05-09T09:55:56.705208+0000","last_became_active":"2024-05-09T09:55:41.512176+0000","last_became_peered":"2024-05-09T09:55:41.512176+0000","last_unstale":"2024-05-09T09:55:56.705208+0000","last_undegraded":"2024-05-09T09:55:56.705208+0000","last_fullsized":"2024-05-09T09:55:56.705208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"68'9","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402348+0000","last_change":"2024-05-09T09:55:42.801375+0000","last_active":"2024-05-09T09:55:57.402348+0000","last_peered":"2024-05-09T09:55:57.402348+0000","last_clean":"2024-05-09T09:55:57.402348+0000","last_became_active":"2024-05-09T09:55:41.495260+0000","last_became_peered":"2024-05-09T09:55:41.495260+0000","last_unstale":"2024-05-09T09:55:57.402348+0000","last_undegraded":"2024-05-09T09:55:57.402348+0000","last_fullsized":"2024-05-09T09:55:57.402348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:20.725921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32774,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401363+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:55:57.401363+0000","last_peered":"2024-05-09T09:55:57.401363+0000","last_clean":"2024-05-09T09:55:57.401363+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:55:57.401363+0000","last_undegraded":"2024-05-09T09:55:57.401363+0000","last_fullsized":"2024-05-09T09:55:57.401363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"73'13","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701493+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:55:56.701493+0000","last_peered":"2024-05-09T09:55:56.701493+0000","last_clean":"2024-05-09T09:55:56.701493+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:55:56.701493+0000","last_undegraded":"2024-05-09T09:55:56.701493+0000","last_fullsized":"2024-05-09T09:55:56.701493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297877+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:55:57.297877+0000","last_peered":"2024-05-09T09:55:57.297877+0000","last_clean":"2024-05-09T09:55:57.297877+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:55:57.297877+0000","last_undegraded":"2024-05-09T09:55:57.297877+0000","last_fullsized":"2024-05-09T09:55:57.297877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017891+0000","last_change":"2024-05-09T09:55:10.502456+0000","last_active":"2024-05-09T09:55:58.017891+0000","last_peered":"2024-05-09T09:55:58.017891+0000","last_clean":"2024-05-09T09:55:58.017891+0000","last_became_active":"2024-05-09T09:55:10.502015+0000","last_became_peered":"2024-05-09T09:55:10.502015+0000","last_unstale":"2024-05-09T09:55:58.017891+0000","last_undegraded":"2024-05-09T09:55:58.017891+0000","last_fullsized":"2024-05-09T09:55:58.017891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:01.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"75'46","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016669+0000","last_change":"2024-05-09T09:55:10.787056+0000","last_active":"2024-05-09T09:55:58.016669+0000","last_peered":"2024-05-09T09:55:58.016669+0000","last_clean":"2024-05-09T09:55:58.016669+0000","last_became_active":"2024-05-09T09:55:10.503704+0000","last_became_peered":"2024-05-09T09:55:10.503704+0000","last_unstale":"2024-05-09T09:55:58.016669+0000","last_undegraded":"2024-05-09T09:55:58.016669+0000","last_fullsized":"2024-05-09T09:55:58.016669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:07.882920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'4","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017899+0000","last_change":"2024-05-09T09:55:11.105873+0000","last_active":"2024-05-09T09:55:58.017899+0000","last_peered":"2024-05-09T09:55:58.017899+0000","last_clean":"2024-05-09T09:55:58.017899+0000","last_became_active":"2024-05-09T09:55:10.511777+0000","last_became_peered":"2024-05-09T09:55:10.511777+0000","last_unstale":"2024-05-09T09:55:58.017899+0000","last_undegraded":"2024-05-09T09:55:58.017899+0000","last_fullsized":"2024-05-09T09:55:58.017899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:49.719909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8196,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704012+0000","last_change":"2024-05-09T09:55:41.504930+0000","last_active":"2024-05-09T09:55:56.704012+0000","last_peered":"2024-05-09T09:55:56.704012+0000","last_clean":"2024-05-09T09:55:56.704012+0000","last_became_active":"2024-05-09T09:55:41.503996+0000","last_became_peered":"2024-05-09T09:55:41.503996+0000","last_unstale":"2024-05-09T09:55:56.704012+0000","last_undegraded":"2024-05-09T09:55:56.704012+0000","last_fullsized":"2024-05-09T09:55:56.704012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:17.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"73'12","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013352+0000","last_change":"2024-05-09T09:55:11.754129+0000","last_active":"2024-05-09T09:55:58.013352+0000","last_peered":"2024-05-09T09:55:58.013352+0000","last_clean":"2024-05-09T09:55:58.013352+0000","last_became_active":"2024-05-09T09:55:10.525384+0000","last_became_peered":"2024-05-09T09:55:10.525384+0000","last_unstale":"2024-05-09T09:55:58.013352+0000","last_undegraded":"2024-05-09T09:55:58.013352+0000","last_fullsized":"2024-05-09T09:55:58.013352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:56.439887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":18,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704813+0000","last_change":"2024-05-09T09:55:41.503227+0000","last_active":"2024-05-09T09:55:56.704813+0000","last_peered":"2024-05-09T09:55:56.704813+0000","last_clean":"2024-05-09T09:55:56.704813+0000","last_became_active":"2024-05-09T09:55:41.502389+0000","last_became_peered":"2024-05-09T09:55:41.502389+0000","last_unstale":"2024-05-09T09:55:56.704813+0000","last_undegraded":"2024-05-09T09:55:56.704813+0000","last_fullsized":"2024-05-09T09:55:56.704813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:58.478317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015740+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:55:58.015740+0000","last_peered":"2024-05-09T09:55:58.015740+0000","last_clean":"2024-05-09T09:55:58.015740+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:55:58.015740+0000","last_undegraded":"2024-05-09T09:55:58.015740+0000","last_fullsized":"2024-05-09T09:55:58.015740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703739+0000","last_change":"2024-05-09T09:55:41.504669+0000","last_active":"2024-05-09T09:55:56.703739+0000","last_peered":"2024-05-09T09:55:56.703739+0000","last_clean":"2024-05-09T09:55:56.703739+0000","last_became_active":"2024-05-09T09:55:41.503132+0000","last_became_peered":"2024-05-09T09:55:41.503132+0000","last_unstale":"2024-05-09T09:55:56.703739+0000","last_undegraded":"2024-05-09T09:55:56.703739+0000","last_fullsized":"2024-05-09T09:55:56.703739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:40.768463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'12","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706462+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:55:56.706462+0000","last_peered":"2024-05-09T09:55:56.706462+0000","last_clean":"2024-05-09T09:55:56.706462+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:55:56.706462+0000","last_undegraded":"2024-05-09T09:55:56.706462+0000","last_fullsized":"2024-05-09T09:55:56.706462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":36882,"num_write":42,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702636+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:55:56.702636+0000","last_peered":"2024-05-09T09:55:56.702636+0000","last_clean":"2024-05-09T09:55:56.702636+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:55:56.702636+0000","last_undegraded":"2024-05-09T09:55:56.702636+0000","last_fullsized":"2024-05-09T09:55:56.702636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"73'15","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704375+0000","last_change":"2024-05-09T09:55:41.528075+0000","last_active":"2024-05-09T09:55:56.704375+0000","last_peered":"2024-05-09T09:55:56.704375+0000","last_clean":"2024-05-09T09:55:56.704375+0000","last_became_active":"2024-05-09T09:55:41.453982+0000","last_became_peered":"2024-05-09T09:55:41.453982+0000","last_unstale":"2024-05-09T09:55:56.704375+0000","last_undegraded":"2024-05-09T09:55:56.704375+0000","last_fullsized":"2024-05-09T09:55:56.704375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:30.849980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703788+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:55:56.703788+0000","last_peered":"2024-05-09T09:55:56.703788+0000","last_clean":"2024-05-09T09:55:56.703788+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:55:56.703788+0000","last_undegraded":"2024-05-09T09:55:56.703788+0000","last_fullsized":"2024-05-09T09:55:56.703788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705754+0000","last_change":"2024-05-09T09:55:41.488023+0000","last_active":"2024-05-09T09:55:56.705754+0000","last_peered":"2024-05-09T09:55:56.705754+0000","last_clean":"2024-05-09T09:55:56.705754+0000","last_became_active":"2024-05-09T09:55:41.478429+0000","last_became_peered":"2024-05-09T09:55:41.478429+0000","last_unstale":"2024-05-09T09:55:56.705754+0000","last_undegraded":"2024-05-09T09:55:56.705754+0000","last_fullsized":"2024-05-09T09:55:56.705754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:21.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703865+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:55:56.703865+0000","last_peered":"2024-05-09T09:55:56.703865+0000","last_clean":"2024-05-09T09:55:56.703865+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:55:56.703865+0000","last_undegraded":"2024-05-09T09:55:56.703865+0000","last_fullsized":"2024-05-09T09:55:56.703865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":76,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'8","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298338+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:55:57.298338+0000","last_peered":"2024-05-09T09:55:57.298338+0000","last_clean":"2024-05-09T09:55:57.298338+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:55:57.298338+0000","last_undegraded":"2024-05-09T09:55:57.298338+0000","last_fullsized":"2024-05-09T09:55:57.298338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28678,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'16","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511896+0000","last_change":"2024-05-09T09:53:54.474568+0000","last_active":"2024-05-09T09:55:57.511896+0000","last_peered":"2024-05-09T09:55:57.511896+0000","last_clean":"2024-05-09T09:55:57.511896+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:55:57.511896+0000","last_undegraded":"2024-05-09T09:55:57.511896+0000","last_fullsized":"2024-05-09T09:55:57.511896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:31.979515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":38936,"num_write":56,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401833+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:55:57.401833+0000","last_peered":"2024-05-09T09:55:57.401833+0000","last_clean":"2024-05-09T09:55:57.401833+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:55:57.401833+0000","last_undegraded":"2024-05-09T09:55:57.401833+0000","last_fullsized":"2024-05-09T09:55:57.401833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401072+0000","last_change":"2024-05-09T09:55:11.421625+0000","last_active":"2024-05-09T09:55:57.401072+0000","last_peered":"2024-05-09T09:55:57.401072+0000","last_clean":"2024-05-09T09:55:57.401072+0000","last_became_active":"2024-05-09T09:55:10.518812+0000","last_became_peered":"2024-05-09T09:55:10.518812+0000","last_unstale":"2024-05-09T09:55:57.401072+0000","last_undegraded":"2024-05-09T09:55:57.401072+0000","last_fullsized":"2024-05-09T09:55:57.401072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:01.935968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":30726,"num_write":20,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703042+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:55:56.703042+0000","last_peered":"2024-05-09T09:55:56.703042+0000","last_clean":"2024-05-09T09:55:56.703042+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:55:56.703042+0000","last_undegraded":"2024-05-09T09:55:56.703042+0000","last_fullsized":"2024-05-09T09:55:56.703042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'10","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704515+0000","last_change":"2024-05-09T09:55:11.272479+0000","last_active":"2024-05-09T09:55:56.704515+0000","last_peered":"2024-05-09T09:55:56.704515+0000","last_clean":"2024-05-09T09:55:56.704515+0000","last_became_active":"2024-05-09T09:55:10.507500+0000","last_became_peered":"2024-05-09T09:55:10.507500+0000","last_unstale":"2024-05-09T09:55:56.704515+0000","last_undegraded":"2024-05-09T09:55:56.704515+0000","last_fullsized":"2024-05-09T09:55:56.704515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:01.473207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":24594,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013452+0000","last_change":"2024-05-09T09:55:10.524923+0000","last_active":"2024-05-09T09:55:58.013452+0000","last_peered":"2024-05-09T09:55:58.013452+0000","last_clean":"2024-05-09T09:55:58.013452+0000","last_became_active":"2024-05-09T09:55:10.523552+0000","last_became_peered":"2024-05-09T09:55:10.523552+0000","last_unstale":"2024-05-09T09:55:58.013452+0000","last_undegraded":"2024-05-09T09:55:58.013452+0000","last_fullsized":"2024-05-09T09:55:58.013452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:43.486340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'15","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013377+0000","last_change":"2024-05-09T09:55:42.061427+0000","last_active":"2024-05-09T09:55:58.013377+0000","last_peered":"2024-05-09T09:55:58.013377+0000","last_clean":"2024-05-09T09:55:58.013377+0000","last_became_active":"2024-05-09T09:55:41.504165+0000","last_became_peered":"2024-05-09T09:55:41.504165+0000","last_unstale":"2024-05-09T09:55:58.013377+0000","last_undegraded":"2024-05-09T09:55:58.013377+0000","last_fullsized":"2024-05-09T09:55:58.013377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:23.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":13,"num_read_kb":12298,"num_write":35,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":113246208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704514+0000","last_change":"2024-05-09T09:55:41.501384+0000","last_active":"2024-05-09T09:55:56.704514+0000","last_peered":"2024-05-09T09:55:56.704514+0000","last_clean":"2024-05-09T09:55:56.704514+0000","last_became_active":"2024-05-09T09:55:41.500371+0000","last_became_peered":"2024-05-09T09:55:41.500371+0000","last_unstale":"2024-05-09T09:55:56.704514+0000","last_undegraded":"2024-05-09T09:55:56.704514+0000","last_fullsized":"2024-05-09T09:55:56.704514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:40.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'20","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703337+0000","last_change":"2024-05-09T09:55:10.940790+0000","last_active":"2024-05-09T09:55:56.703337+0000","last_peered":"2024-05-09T09:55:56.703337+0000","last_clean":"2024-05-09T09:55:56.703337+0000","last_became_active":"2024-05-09T09:55:10.497720+0000","last_became_peered":"2024-05-09T09:55:10.497720+0000","last_unstale":"2024-05-09T09:55:56.703337+0000","last_undegraded":"2024-05-09T09:55:56.703337+0000","last_fullsized":"2024-05-09T09:55:56.703337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":40,"num_read_kb":51230,"num_write":70,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013352+0000","last_change":"2024-05-09T09:55:10.522327+0000","last_active":"2024-05-09T09:55:58.013352+0000","last_peered":"2024-05-09T09:55:58.013352+0000","last_clean":"2024-05-09T09:55:58.013352+0000","last_became_active":"2024-05-09T09:55:10.520654+0000","last_became_peered":"2024-05-09T09:55:10.520654+0000","last_unstale":"2024-05-09T09:55:58.013352+0000","last_undegraded":"2024-05-09T09:55:58.013352+0000","last_fullsized":"2024-05-09T09:55:58.013352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299280+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:55:57.299280+0000","last_peered":"2024-05-09T09:55:57.299280+0000","last_clean":"2024-05-09T09:55:57.299280+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:55:57.299280+0000","last_undegraded":"2024-05-09T09:55:57.299280+0000","last_fullsized":"2024-05-09T09:55:57.299280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297786+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:55:57.297786+0000","last_peered":"2024-05-09T09:55:57.297786+0000","last_clean":"2024-05-09T09:55:57.297786+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:55:57.297786+0000","last_undegraded":"2024-05-09T09:55:57.297786+0000","last_fullsized":"2024-05-09T09:55:57.297786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"67'7","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013217+0000","last_change":"2024-05-09T09:55:43.542093+0000","last_active":"2024-05-09T09:55:58.013217+0000","last_peered":"2024-05-09T09:55:58.013217+0000","last_clean":"2024-05-09T09:55:58.013217+0000","last_became_active":"2024-05-09T09:55:41.504555+0000","last_became_peered":"2024-05-09T09:55:41.504555+0000","last_unstale":"2024-05-09T09:55:58.013217+0000","last_undegraded":"2024-05-09T09:55:58.013217+0000","last_fullsized":"2024-05-09T09:55:58.013217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:48:05.626495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"75'34","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706338+0000","last_change":"2024-05-09T09:55:11.694902+0000","last_active":"2024-05-09T09:55:56.706338+0000","last_peered":"2024-05-09T09:55:56.706338+0000","last_clean":"2024-05-09T09:55:56.706338+0000","last_became_active":"2024-05-09T09:55:10.515872+0000","last_became_peered":"2024-05-09T09:55:10.515872+0000","last_unstale":"2024-05-09T09:55:56.706338+0000","last_undegraded":"2024-05-09T09:55:56.706338+0000","last_fullsized":"2024-05-09T09:55:56.706338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"67'8","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401104+0000","last_change":"2024-05-09T09:55:11.200964+0000","last_active":"2024-05-09T09:55:57.401104+0000","last_peered":"2024-05-09T09:55:57.401104+0000","last_clean":"2024-05-09T09:55:57.401104+0000","last_became_active":"2024-05-09T09:55:10.506370+0000","last_became_peered":"2024-05-09T09:55:10.506370+0000","last_unstale":"2024-05-09T09:55:57.401104+0000","last_undegraded":"2024-05-09T09:55:57.401104+0000","last_fullsized":"2024-05-09T09:55:57.401104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:45.803361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":16388,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706695+0000","last_change":"2024-05-09T09:55:41.494250+0000","last_active":"2024-05-09T09:55:56.706695+0000","last_peered":"2024-05-09T09:55:56.706695+0000","last_clean":"2024-05-09T09:55:56.706695+0000","last_became_active":"2024-05-09T09:55:41.492423+0000","last_became_peered":"2024-05-09T09:55:41.492423+0000","last_unstale":"2024-05-09T09:55:56.706695+0000","last_undegraded":"2024-05-09T09:55:56.706695+0000","last_fullsized":"2024-05-09T09:55:56.706695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'9","reported_seq":88,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.012993+0000","last_change":"2024-05-09T09:55:44.733118+0000","last_active":"2024-05-09T09:55:58.012993+0000","last_peered":"2024-05-09T09:55:58.012993+0000","last_clean":"2024-05-09T09:55:58.012993+0000","last_became_active":"2024-05-09T09:55:41.505078+0000","last_became_peered":"2024-05-09T09:55:41.505078+0000","last_unstale":"2024-05-09T09:55:58.012993+0000","last_undegraded":"2024-05-09T09:55:58.012993+0000","last_fullsized":"2024-05-09T09:55:58.012993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:36.404862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512634+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:55:57.512634+0000","last_peered":"2024-05-09T09:55:57.512634+0000","last_clean":"2024-05-09T09:55:57.512634+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:55:57.512634+0000","last_undegraded":"2024-05-09T09:55:57.512634+0000","last_fullsized":"2024-05-09T09:55:57.512634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'18","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401073+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:55:57.401073+0000","last_peered":"2024-05-09T09:55:57.401073+0000","last_clean":"2024-05-09T09:55:57.401073+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:55:57.401073+0000","last_undegraded":"2024-05-09T09:55:57.401073+0000","last_fullsized":"2024-05-09T09:55:57.401073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":63494,"num_write":28,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'34","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705523+0000","last_change":"2024-05-09T09:55:42.435861+0000","last_active":"2024-05-09T09:55:56.705523+0000","last_peered":"2024-05-09T09:55:56.705523+0000","last_clean":"2024-05-09T09:55:56.705523+0000","last_became_active":"2024-05-09T09:55:41.516340+0000","last_became_peered":"2024-05-09T09:55:41.516340+0000","last_unstale":"2024-05-09T09:55:56.705523+0000","last_undegraded":"2024-05-09T09:55:56.705523+0000","last_fullsized":"2024-05-09T09:55:56.705523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'12","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512299+0000","last_change":"2024-05-09T09:53:54.475107+0000","last_active":"2024-05-09T09:55:57.512299+0000","last_peered":"2024-05-09T09:55:57.512299+0000","last_clean":"2024-05-09T09:55:57.512299+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:55:57.512299+0000","last_undegraded":"2024-05-09T09:55:57.512299+0000","last_fullsized":"2024-05-09T09:55:57.512299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:07.978606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":40972,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'10","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017071+0000","last_change":"2024-05-09T09:55:55.725591+0000","last_active":"2024-05-09T09:55:58.017071+0000","last_peered":"2024-05-09T09:55:58.017071+0000","last_clean":"2024-05-09T09:55:58.017071+0000","last_became_active":"2024-05-09T09:55:55.721121+0000","last_became_peered":"2024-05-09T09:55:55.721121+0000","last_unstale":"2024-05-09T09:55:58.017071+0000","last_undegraded":"2024-05-09T09:55:58.017071+0000","last_fullsized":"2024-05-09T09:55:58.017071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298788+0000","last_change":"2024-05-09T09:55:43.389559+0000","last_active":"2024-05-09T09:55:57.298788+0000","last_peered":"2024-05-09T09:55:57.298788+0000","last_clean":"2024-05-09T09:55:57.298788+0000","last_became_active":"2024-05-09T09:55:41.513564+0000","last_became_peered":"2024-05-09T09:55:41.513564+0000","last_unstale":"2024-05-09T09:55:57.298788+0000","last_undegraded":"2024-05-09T09:55:57.298788+0000","last_fullsized":"2024-05-09T09:55:57.298788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:27.560582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"63'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702094+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:55:56.702094+0000","last_peered":"2024-05-09T09:55:56.702094+0000","last_clean":"2024-05-09T09:55:56.702094+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:55:56.702094+0000","last_undegraded":"2024-05-09T09:55:56.702094+0000","last_fullsized":"2024-05-09T09:55:56.702094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'9","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017954+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:55:58.017954+0000","last_peered":"2024-05-09T09:55:58.017954+0000","last_clean":"2024-05-09T09:55:58.017954+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:55:58.017954+0000","last_undegraded":"2024-05-09T09:55:58.017954+0000","last_fullsized":"2024-05-09T09:55:58.017954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"63'6","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016486+0000","last_change":"2024-05-09T09:55:10.683098+0000","last_active":"2024-05-09T09:55:58.016486+0000","last_peered":"2024-05-09T09:55:58.016486+0000","last_clean":"2024-05-09T09:55:58.016486+0000","last_became_active":"2024-05-09T09:55:10.495708+0000","last_became_peered":"2024-05-09T09:55:10.495708+0000","last_unstale":"2024-05-09T09:55:58.016486+0000","last_undegraded":"2024-05-09T09:55:58.016486+0000","last_fullsized":"2024-05-09T09:55:58.016486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:35.537784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'19","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513097+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:55:57.513097+0000","last_peered":"2024-05-09T09:55:57.513097+0000","last_clean":"2024-05-09T09:55:57.513097+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:55:57.513097+0000","last_undegraded":"2024-05-09T09:55:57.513097+0000","last_fullsized":"2024-05-09T09:55:57.513097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":39,"num_read_kb":53278,"num_write":69,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'6","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016640+0000","last_change":"2024-05-09T09:55:10.943382+0000","last_active":"2024-05-09T09:55:58.016640+0000","last_peered":"2024-05-09T09:55:58.016640+0000","last_clean":"2024-05-09T09:55:58.016640+0000","last_became_active":"2024-05-09T09:55:10.500255+0000","last_became_peered":"2024-05-09T09:55:10.500255+0000","last_unstale":"2024-05-09T09:55:58.016640+0000","last_undegraded":"2024-05-09T09:55:58.016640+0000","last_fullsized":"2024-05-09T09:55:58.016640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"68'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402011+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:55:57.402011+0000","last_peered":"2024-05-09T09:55:57.402011+0000","last_clean":"2024-05-09T09:55:57.402011+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:55:57.402011+0000","last_undegraded":"2024-05-09T09:55:57.402011+0000","last_fullsized":"2024-05-09T09:55:57.402011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"69'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400979+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:55:57.400979+0000","last_peered":"2024-05-09T09:55:57.400979+0000","last_clean":"2024-05-09T09:55:57.400979+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:55:57.400979+0000","last_undegraded":"2024-05-09T09:55:57.400979+0000","last_fullsized":"2024-05-09T09:55:57.400979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706291+0000","last_change":"2024-05-09T09:55:10.507173+0000","last_active":"2024-05-09T09:55:56.706291+0000","last_peered":"2024-05-09T09:55:56.706291+0000","last_clean":"2024-05-09T09:55:56.706291+0000","last_became_active":"2024-05-09T09:55:10.506690+0000","last_became_peered":"2024-05-09T09:55:10.506690+0000","last_unstale":"2024-05-09T09:55:56.706291+0000","last_undegraded":"2024-05-09T09:55:56.706291+0000","last_fullsized":"2024-05-09T09:55:56.706291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'10","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702042+0000","last_change":"2024-05-09T09:55:41.773438+0000","last_active":"2024-05-09T09:55:56.702042+0000","last_peered":"2024-05-09T09:55:56.702042+0000","last_clean":"2024-05-09T09:55:56.702042+0000","last_became_active":"2024-05-09T09:55:41.504558+0000","last_became_peered":"2024-05-09T09:55:41.504558+0000","last_unstale":"2024-05-09T09:55:56.702042+0000","last_undegraded":"2024-05-09T09:55:56.702042+0000","last_fullsized":"2024-05-09T09:55:56.702042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26642,"num_write":40,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399757+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:55:57.399757+0000","last_peered":"2024-05-09T09:55:57.399757+0000","last_clean":"2024-05-09T09:55:57.399757+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:55:57.399757+0000","last_undegraded":"2024-05-09T09:55:57.399757+0000","last_fullsized":"2024-05-09T09:55:57.399757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":634,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":234941,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":916,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":46305,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":230722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":641,"ondisk_log_size":641,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1642,"num_read_kb":1223,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1022,"num_read_kb":1804930,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":1302331392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504000,"kb_used_data":472824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93867840,"statfs":{"total":96636764160,"available":96120668160,"internally_reserved":0,"allocated":484171776,"data_stored":483628948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":392780,"kb_used_data":361604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93979060,"statfs":{"total":96636764160,"available":96234557440,"internally_reserved":0,"allocated":370282496,"data_stored":369785753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":526004,"kb_used_data":494828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93845836,"statfs":{"total":96636764160,"available":96098136064,"internally_reserved":0,"allocated":506703872,"data_stored":506143223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505404,"kb_used_data":474220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866436,"statfs":{"total":96636764160,"available":96119230464,"internally_reserved":0,"allocated":485601280,"data_stored":485118321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462516,"kb_used_data":427180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93909324,"statfs":{"total":96636764160,"available":96163147776,"internally_reserved":0,"allocated":437432320,"data_stored":436912303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":331372,"kb_used_data":296036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94040468,"statfs":{"total":96636764160,"available":96297439232,"internally_reserved":0,"allocated":303140864,"data_stored":302661910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315068,"kb_used_data":279732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94056772,"statfs":{"total":96636764160,"available":96314134528,"internally_reserved":0,"allocated":286445568,"data_stored":285929009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434400,"kb_used_data":399056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93937440,"statfs":{"total":96636764160,"available":96191938560,"internally_reserved":0,"allocated":408633344,"data_stored":408125441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":406847488,"data_stored":406847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":285212672,"data_stored":285212672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":301989888,"data_stored":301989888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":436207616,"data_stored":436207616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":505413632,"data_stored":505413632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":369098752,"data_stored":369098752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":20947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":49653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":38049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":62333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":25989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:56:09.465 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:56:09.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-09T09:56:09.808 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:09.808 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"ab394f08-fac0-4b9b-8c5e-bce336e83e29","created":"2024-05-09T09:52:48.405333+0000","modified":"2024-05-09T09:55:56.687899+0000","last_up_change":"2024-05-09T09:52:59.026796+0000","last_in_change":"2024-05-09T09:55:40.422563+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:52:59.315438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-09T09:52:59.577014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-09T09:53:05.894004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-09T09:53:07.438032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-09T09:53:09.330585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-09T09:53:11.250677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-09T09:53:13.151617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-09T09:53:15.304851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b6d1a399-da26-41fd-8eed-493a7286aa6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6801","nonce":396091358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6803","nonce":396091358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6807","nonce":396091358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":396091358},{"type":"v1","addr":"172.21.15.32:6805","nonce":396091358}]},"public_addr":"172.21.15.32:6801/396091358","cluster_addr":"172.21.15.32:6803/396091358","heartbeat_back_addr":"172.21.15.32:6807/396091358","heartbeat_front_addr":"172.21.15.32:6805/396091358","state":["exists","up"]},{"osd":1,"uuid":"6ddbcdcf-d0b5-4f1e-8cfe-1af663dd2f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6825","nonce":3047693294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6827","nonce":3047693294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6831","nonce":3047693294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":3047693294},{"type":"v1","addr":"172.21.15.32:6829","nonce":3047693294}]},"public_addr":"172.21.15.32:6825/3047693294","cluster_addr":"172.21.15.32:6827/3047693294","heartbeat_back_addr":"172.21.15.32:6831/3047693294","heartbeat_front_addr":"172.21.15.32:6829/3047693294","state":["exists","up"]},{"osd":2,"uuid":"097e00bf-5d58-4fe5-8909-8d453783b9e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6809","nonce":2852540861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6811","nonce":2852540861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6815","nonce":2852540861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":2852540861},{"type":"v1","addr":"172.21.15.32:6813","nonce":2852540861}]},"public_addr":"172.21.15.32:6809/2852540861","cluster_addr":"172.21.15.32:6811/2852540861","heartbeat_back_addr":"172.21.15.32:6815/2852540861","heartbeat_front_addr":"172.21.15.32:6813/2852540861","state":["exists","up"]},{"osd":3,"uuid":"ef14f326-2a6d-4bbb-9cce-e984a09db334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6817","nonce":1396699085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6819","nonce":1396699085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6823","nonce":1396699085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":1396699085},{"type":"v1","addr":"172.21.15.32:6821","nonce":1396699085}]},"public_addr":"172.21.15.32:6817/1396699085","cluster_addr":"172.21.15.32:6819/1396699085","heartbeat_back_addr":"172.21.15.32:6823/1396699085","heartbeat_front_addr":"172.21.15.32:6821/1396699085","state":["exists","up"]},{"osd":4,"uuid":"b609b2b6-6fec-4d82-8126-4c109f53093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6801","nonce":2270167873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6803","nonce":2270167873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6807","nonce":2270167873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":2270167873},{"type":"v1","addr":"172.21.15.80:6805","nonce":2270167873}]},"public_addr":"172.21.15.80:6801/2270167873","cluster_addr":"172.21.15.80:6803/2270167873","heartbeat_back_addr":"172.21.15.80:6807/2270167873","heartbeat_front_addr":"172.21.15.80:6805/2270167873","state":["exists","up"]},{"osd":5,"uuid":"a8f7aea9-0c6f-4c2e-9541-b8780d58ec01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6809","nonce":1502875008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6811","nonce":1502875008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6815","nonce":1502875008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1502875008},{"type":"v1","addr":"172.21.15.80:6813","nonce":1502875008}]},"public_addr":"172.21.15.80:6809/1502875008","cluster_addr":"172.21.15.80:6811/1502875008","heartbeat_back_addr":"172.21.15.80:6815/1502875008","heartbeat_front_addr":"172.21.15.80:6813/1502875008","state":["exists","up"]},{"osd":6,"uuid":"ff6b8c21-0fb4-46b1-a7d2-8302d86b1ab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6817","nonce":2011375001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6819","nonce":2011375001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6823","nonce":2011375001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2011375001},{"type":"v1","addr":"172.21.15.80:6821","nonce":2011375001}]},"public_addr":"172.21.15.80:6817/2011375001","cluster_addr":"172.21.15.80:6819/2011375001","heartbeat_back_addr":"172.21.15.80:6823/2011375001","heartbeat_front_addr":"172.21.15.80:6821/2011375001","state":["exists","up"]},{"osd":7,"uuid":"777809d6-0cf6-4020-8efb-9f9df7bcea08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6825","nonce":4069183898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6827","nonce":4069183898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6831","nonce":4069183898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":4069183898},{"type":"v1","addr":"172.21.15.80:6829","nonce":4069183898}]},"public_addr":"172.21.15.80:6825/4069183898","cluster_addr":"172.21.15.80:6827/4069183898","heartbeat_back_addr":"172.21.15.80:6831/4069183898","heartbeat_front_addr":"172.21.15.80:6829/4069183898","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.252744+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.355061+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.322435+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.394680+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.304104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.434142+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.028140+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:52:56.015696+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.3a","mappings":[{"from":0,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.6","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":7}]},{"pgid":"4.2b","mappings":[{"from":3,"to":5}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:56:10.830 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T09:56:10.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:56:10.999 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:56:10.999 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:56:10.999 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:56:11.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T09:56:11.314 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T09:56:11.333 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T09:56:11.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:56:11.480 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:56:11.480 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:56:11.480 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:56:11.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T09:56:11.783 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T09:56:11.803 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T09:56:11.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:56:11.955 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:56:11.955 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:56:11.955 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:56:11.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T09:56:12.260 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T09:56:12.278 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T09:56:12.279 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:56:12.423 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:56:12.423 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:56:12.423 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:56:12.438 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T09:56:12.712 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T09:56:12.730 INFO:tasks.ceph:Scrubbing osd.4 2024-05-09T09:56:12.731 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:56:12.885 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:56:12.886 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:56:12.886 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:56:12.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-09T09:56:13.200 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 4 to deep-scrub 2024-05-09T09:56:13.220 INFO:tasks.ceph:Scrubbing osd.5 2024-05-09T09:56:13.220 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:56:13.365 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:56:13.365 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:56:13.366 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:56:13.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-09T09:56:13.665 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 5 to deep-scrub 2024-05-09T09:56:13.684 INFO:tasks.ceph:Scrubbing osd.6 2024-05-09T09:56:13.684 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:56:13.840 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:56:13.840 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:56:13.840 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:56:13.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-09T09:56:14.135 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 6 to deep-scrub 2024-05-09T09:56:14.153 INFO:tasks.ceph:Scrubbing osd.7 2024-05-09T09:56:14.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:56:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-05-09T09:56:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:56:14.305 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-05-09T09:56:14.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-09T09:56:14.614 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 7 to deep-scrub 2024-05-09T09:56:14.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:56:14.979 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:14.988 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:56:15.000 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-05-09T09:56:13.351200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":715263,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4507,"num_read_kb":1807912,"num_write":3892,"num_write_kb":2051112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":598,"num_bytes_recovered":1302381373,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2655,"ondisk_log_size":2655,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":280808,"kb_used_data":10248,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754693912,"statfs":{"total":773094113280,"available":772806565888,"internally_reserved":0,"allocated":10493952,"data_stored":6524470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":276614707},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1635890219,"num_objects":-440,"num_object_clones":0,"num_object_copies":-880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-440,"num_whiteouts":0,"num_read":735,"num_read_kb":669,"num_write":564,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005504"},"pg_stats":[{"pgid":"3.3f","version":"95'24","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.165807+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:56:08.165807+0000","last_peered":"2024-05-09T09:56:08.165807+0000","last_clean":"2024-05-09T09:56:08.165807+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:56:08.165807+0000","last_undegraded":"2024-05-09T09:56:08.165807+0000","last_fullsized":"2024-05-09T09:56:08.165807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:16.048304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":47116,"num_write":44,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400553+0000","last_change":"2024-05-09T09:55:41.485053+0000","last_active":"2024-05-09T09:55:57.400553+0000","last_peered":"2024-05-09T09:55:57.400553+0000","last_clean":"2024-05-09T09:55:57.400553+0000","last_became_active":"2024-05-09T09:55:41.484367+0000","last_became_peered":"2024-05-09T09:55:41.484367+0000","last_unstale":"2024-05-09T09:55:57.400553+0000","last_undegraded":"2024-05-09T09:55:57.400553+0000","last_fullsized":"2024-05-09T09:55:57.400553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:39.155356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'14","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.184294+0000","last_change":"2024-05-09T09:53:07.101005+0000","last_active":"2024-05-09T09:56:08.184294+0000","last_peered":"2024-05-09T09:56:08.184294+0000","last_clean":"2024-05-09T09:56:08.184294+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:56:08.184294+0000","last_undegraded":"2024-05-09T09:56:08.184294+0000","last_fullsized":"2024-05-09T09:56:08.184294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'40","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015392+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:55:58.015392+0000","last_peered":"2024-05-09T09:55:58.015392+0000","last_clean":"2024-05-09T09:55:58.015392+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:55:58.015392+0000","last_undegraded":"2024-05-09T09:55:58.015392+0000","last_fullsized":"2024-05-09T09:55:58.015392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:46.445066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'22","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.161532+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:56:08.161532+0000","last_peered":"2024-05-09T09:56:08.161532+0000","last_clean":"2024-05-09T09:56:08.161532+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:56:08.161532+0000","last_undegraded":"2024-05-09T09:56:08.161532+0000","last_fullsized":"2024-05-09T09:56:08.161532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:38.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":38918,"num_write":32,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705052+0000","last_change":"2024-05-09T09:55:41.476462+0000","last_active":"2024-05-09T09:55:56.705052+0000","last_peered":"2024-05-09T09:55:56.705052+0000","last_clean":"2024-05-09T09:55:56.705052+0000","last_became_active":"2024-05-09T09:55:41.474847+0000","last_became_peered":"2024-05-09T09:55:41.474847+0000","last_unstale":"2024-05-09T09:55:56.705052+0000","last_undegraded":"2024-05-09T09:55:56.705052+0000","last_fullsized":"2024-05-09T09:55:56.705052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'16","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.212832+0000","last_change":"2024-05-09T09:55:11.074408+0000","last_active":"2024-05-09T09:56:08.212832+0000","last_peered":"2024-05-09T09:56:08.212832+0000","last_clean":"2024-05-09T09:56:08.212832+0000","last_became_active":"2024-05-09T09:55:10.495355+0000","last_became_peered":"2024-05-09T09:55:10.495355+0000","last_unstale":"2024-05-09T09:56:08.212832+0000","last_undegraded":"2024-05-09T09:56:08.212832+0000","last_fullsized":"2024-05-09T09:56:08.212832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:16:55.087662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24588,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704348+0000","last_change":"2024-05-09T09:55:10.508149+0000","last_active":"2024-05-09T09:55:56.704348+0000","last_peered":"2024-05-09T09:55:56.704348+0000","last_clean":"2024-05-09T09:55:56.704348+0000","last_became_active":"2024-05-09T09:55:10.506740+0000","last_became_peered":"2024-05-09T09:55:10.506740+0000","last_unstale":"2024-05-09T09:55:56.704348+0000","last_undegraded":"2024-05-09T09:55:56.704348+0000","last_fullsized":"2024-05-09T09:55:56.704348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:15.213068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'20","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.186019+0000","last_change":"2024-05-09T09:53:54.477992+0000","last_active":"2024-05-09T09:56:08.186019+0000","last_peered":"2024-05-09T09:56:08.186019+0000","last_clean":"2024-05-09T09:56:08.186019+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:56:08.186019+0000","last_undegraded":"2024-05-09T09:56:08.186019+0000","last_fullsized":"2024-05-09T09:56:08.186019+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:38.501294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.129510+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:54.735707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'20","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.763515+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:56:07.763515+0000","last_peered":"2024-05-09T09:56:07.763515+0000","last_clean":"2024-05-09T09:56:07.763515+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:56:07.763515+0000","last_undegraded":"2024-05-09T09:56:07.763515+0000","last_fullsized":"2024-05-09T09:56:07.763515+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:45:31.509591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":34840,"num_write":60,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'38","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706070+0000","last_change":"2024-05-09T09:55:41.723376+0000","last_active":"2024-05-09T09:55:56.706070+0000","last_peered":"2024-05-09T09:55:56.706070+0000","last_clean":"2024-05-09T09:55:56.706070+0000","last_became_active":"2024-05-09T09:55:41.470370+0000","last_became_peered":"2024-05-09T09:55:41.470370+0000","last_unstale":"2024-05-09T09:55:56.706070+0000","last_undegraded":"2024-05-09T09:55:56.706070+0000","last_fullsized":"2024-05-09T09:55:56.706070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:01.442445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'18","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.207113+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:56:08.207113+0000","last_peered":"2024-05-09T09:56:08.207113+0000","last_clean":"2024-05-09T09:56:08.207113+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:56:08.207113+0000","last_undegraded":"2024-05-09T09:56:08.207113+0000","last_fullsized":"2024-05-09T09:56:08.207113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":34816,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399784+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:55:57.399784+0000","last_peered":"2024-05-09T09:55:57.399784+0000","last_clean":"2024-05-09T09:55:57.399784+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:55:57.399784+0000","last_undegraded":"2024-05-09T09:55:57.399784+0000","last_fullsized":"2024-05-09T09:55:57.399784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:24.867970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'20","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.816195+0000","last_change":"2024-05-09T09:55:11.513082+0000","last_active":"2024-05-09T09:56:07.816195+0000","last_peered":"2024-05-09T09:56:07.816195+0000","last_clean":"2024-05-09T09:56:07.816195+0000","last_became_active":"2024-05-09T09:55:10.517657+0000","last_became_peered":"2024-05-09T09:55:10.517657+0000","last_unstale":"2024-05-09T09:56:07.816195+0000","last_undegraded":"2024-05-09T09:56:07.816195+0000","last_fullsized":"2024-05-09T09:56:07.816195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:28.563341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22558,"num_write":70,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513158+0000","last_change":"2024-05-09T09:55:10.525459+0000","last_active":"2024-05-09T09:55:57.513158+0000","last_peered":"2024-05-09T09:55:57.513158+0000","last_clean":"2024-05-09T09:55:57.513158+0000","last_became_active":"2024-05-09T09:55:10.525051+0000","last_became_peered":"2024-05-09T09:55:10.525051+0000","last_unstale":"2024-05-09T09:55:57.513158+0000","last_undegraded":"2024-05-09T09:55:57.513158+0000","last_fullsized":"2024-05-09T09:55:57.513158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:08.309277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704076+0000","last_change":"2024-05-09T09:55:41.727656+0000","last_active":"2024-05-09T09:55:56.704076+0000","last_peered":"2024-05-09T09:55:56.704076+0000","last_clean":"2024-05-09T09:55:56.704076+0000","last_became_active":"2024-05-09T09:55:41.468227+0000","last_became_peered":"2024-05-09T09:55:41.468227+0000","last_unstale":"2024-05-09T09:55:56.704076+0000","last_undegraded":"2024-05-09T09:55:56.704076+0000","last_fullsized":"2024-05-09T09:55:56.704076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'14","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.195812+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:56:08.195812+0000","last_peered":"2024-05-09T09:56:08.195812+0000","last_clean":"2024-05-09T09:56:08.195812+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:56:08.195812+0000","last_undegraded":"2024-05-09T09:56:08.195812+0000","last_fullsized":"2024-05-09T09:56:08.195812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:56.183000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014983+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:55:58.014983+0000","last_peered":"2024-05-09T09:55:58.014983+0000","last_clean":"2024-05-09T09:55:58.014983+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:55:58.014983+0000","last_undegraded":"2024-05-09T09:55:58.014983+0000","last_fullsized":"2024-05-09T09:55:58.014983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:58.971929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'12","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.836365+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:56:07.836365+0000","last_peered":"2024-05-09T09:56:07.836365+0000","last_clean":"2024-05-09T09:56:07.836365+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:56:07.836365+0000","last_undegraded":"2024-05-09T09:56:07.836365+0000","last_fullsized":"2024-05-09T09:56:07.836365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400770+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:55:57.400770+0000","last_peered":"2024-05-09T09:55:57.400770+0000","last_clean":"2024-05-09T09:55:57.400770+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:55:57.400770+0000","last_undegraded":"2024-05-09T09:55:57.400770+0000","last_fullsized":"2024-05-09T09:55:57.400770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:55.185841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'18","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.153352+0000","last_change":"2024-05-09T09:53:07.130455+0000","last_active":"2024-05-09T09:56:08.153352+0000","last_peered":"2024-05-09T09:56:08.153352+0000","last_clean":"2024-05-09T09:56:08.153352+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:56:08.153352+0000","last_undegraded":"2024-05-09T09:56:08.153352+0000","last_fullsized":"2024-05-09T09:56:08.153352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:09:50.123852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512589+0000","last_change":"2024-05-09T09:55:10.502036+0000","last_active":"2024-05-09T09:55:57.512589+0000","last_peered":"2024-05-09T09:55:57.512589+0000","last_clean":"2024-05-09T09:55:57.512589+0000","last_became_active":"2024-05-09T09:55:10.501517+0000","last_became_peered":"2024-05-09T09:55:10.501517+0000","last_unstale":"2024-05-09T09:55:57.512589+0000","last_undegraded":"2024-05-09T09:55:57.512589+0000","last_fullsized":"2024-05-09T09:55:57.512589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:30.945254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'8","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.565083+0000","last_change":"2024-05-09T09:55:42.549939+0000","last_active":"2024-05-09T09:56:07.565083+0000","last_peered":"2024-05-09T09:56:07.565083+0000","last_clean":"2024-05-09T09:56:07.565083+0000","last_became_active":"2024-05-09T09:55:41.517108+0000","last_became_peered":"2024-05-09T09:55:41.517108+0000","last_unstale":"2024-05-09T09:56:07.565083+0000","last_undegraded":"2024-05-09T09:56:07.565083+0000","last_fullsized":"2024-05-09T09:56:07.565083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:39.522749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511344+0000","last_change":"2024-05-09T09:55:41.495787+0000","last_active":"2024-05-09T09:55:57.511344+0000","last_peered":"2024-05-09T09:55:57.511344+0000","last_clean":"2024-05-09T09:55:57.511344+0000","last_became_active":"2024-05-09T09:55:41.495217+0000","last_became_peered":"2024-05-09T09:55:41.495217+0000","last_unstale":"2024-05-09T09:55:57.511344+0000","last_undegraded":"2024-05-09T09:55:57.511344+0000","last_fullsized":"2024-05-09T09:55:57.511344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:19.303237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'24","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.220718+0000","last_change":"2024-05-09T09:55:11.744028+0000","last_active":"2024-05-09T09:56:08.220718+0000","last_peered":"2024-05-09T09:56:08.220718+0000","last_clean":"2024-05-09T09:56:08.220718+0000","last_became_active":"2024-05-09T09:55:10.515515+0000","last_became_peered":"2024-05-09T09:55:10.515515+0000","last_unstale":"2024-05-09T09:56:08.220718+0000","last_undegraded":"2024-05-09T09:56:08.220718+0000","last_fullsized":"2024-05-09T09:56:08.220718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:26:21.134168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":77594624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706053+0000","last_change":"2024-05-09T09:55:41.471993+0000","last_active":"2024-05-09T09:55:56.706053+0000","last_peered":"2024-05-09T09:55:56.706053+0000","last_clean":"2024-05-09T09:55:56.706053+0000","last_became_active":"2024-05-09T09:55:41.469463+0000","last_became_peered":"2024-05-09T09:55:41.469463+0000","last_unstale":"2024-05-09T09:55:56.706053+0000","last_undegraded":"2024-05-09T09:55:56.706053+0000","last_fullsized":"2024-05-09T09:55:56.706053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:09.428329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.173963+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:56:08.173963+0000","last_peered":"2024-05-09T09:56:08.173963+0000","last_clean":"2024-05-09T09:56:08.173963+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:56:08.173963+0000","last_undegraded":"2024-05-09T09:56:08.173963+0000","last_fullsized":"2024-05-09T09:56:08.173963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703760+0000","last_change":"2024-05-09T09:55:41.489025+0000","last_active":"2024-05-09T09:55:56.703760+0000","last_peered":"2024-05-09T09:55:56.703760+0000","last_clean":"2024-05-09T09:55:56.703760+0000","last_became_active":"2024-05-09T09:55:41.479825+0000","last_became_peered":"2024-05-09T09:55:41.479825+0000","last_unstale":"2024-05-09T09:55:56.703760+0000","last_undegraded":"2024-05-09T09:55:56.703760+0000","last_fullsized":"2024-05-09T09:55:56.703760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017517+0000","last_change":"2024-05-09T09:55:10.499813+0000","last_active":"2024-05-09T09:55:58.017517+0000","last_peered":"2024-05-09T09:55:58.017517+0000","last_clean":"2024-05-09T09:55:58.017517+0000","last_became_active":"2024-05-09T09:55:10.499014+0000","last_became_peered":"2024-05-09T09:55:10.499014+0000","last_unstale":"2024-05-09T09:55:58.017517+0000","last_undegraded":"2024-05-09T09:55:58.017517+0000","last_fullsized":"2024-05-09T09:55:58.017517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:12.558724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'18","reported_seq":219,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.176853+0000","last_change":"2024-05-09T09:55:43.099041+0000","last_active":"2024-05-09T09:56:08.176853+0000","last_peered":"2024-05-09T09:56:08.176853+0000","last_clean":"2024-05-09T09:56:08.176853+0000","last_became_active":"2024-05-09T09:55:41.507252+0000","last_became_peered":"2024-05-09T09:55:41.507252+0000","last_unstale":"2024-05-09T09:56:08.176853+0000","last_undegraded":"2024-05-09T09:56:08.176853+0000","last_fullsized":"2024-05-09T09:56:08.176853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30720,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401721+0000","last_change":"2024-05-09T09:53:11.125374+0000","last_active":"2024-05-09T09:55:57.401721+0000","last_peered":"2024-05-09T09:55:57.401721+0000","last_clean":"2024-05-09T09:55:57.401721+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:55:57.401721+0000","last_undegraded":"2024-05-09T09:55:57.401721+0000","last_fullsized":"2024-05-09T09:55:57.401721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:19:35.120534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'20","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.903611+0000","last_change":"2024-05-09T09:53:13.125398+0000","last_active":"2024-05-09T09:56:07.903611+0000","last_peered":"2024-05-09T09:56:07.903611+0000","last_clean":"2024-05-09T09:56:07.903611+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:56:07.903611+0000","last_undegraded":"2024-05-09T09:56:07.903611+0000","last_fullsized":"2024-05-09T09:56:07.903611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":37,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017272+0000","last_change":"2024-05-09T09:53:15.166981+0000","last_active":"2024-05-09T09:55:58.017272+0000","last_peered":"2024-05-09T09:55:58.017272+0000","last_clean":"2024-05-09T09:55:58.017272+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:55:58.017272+0000","last_undegraded":"2024-05-09T09:55:58.017272+0000","last_fullsized":"2024-05-09T09:55:58.017272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400280+0000","last_change":"2024-05-09T09:55:41.487851+0000","last_active":"2024-05-09T09:55:57.400280+0000","last_peered":"2024-05-09T09:55:57.400280+0000","last_clean":"2024-05-09T09:55:57.400280+0000","last_became_active":"2024-05-09T09:55:41.487060+0000","last_became_peered":"2024-05-09T09:55:41.487060+0000","last_unstale":"2024-05-09T09:55:57.400280+0000","last_undegraded":"2024-05-09T09:55:57.400280+0000","last_fullsized":"2024-05-09T09:55:57.400280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:54:51.000892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402309+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:55:57.402309+0000","last_peered":"2024-05-09T09:55:57.402309+0000","last_clean":"2024-05-09T09:55:57.402309+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:55:57.402309+0000","last_undegraded":"2024-05-09T09:55:57.402309+0000","last_fullsized":"2024-05-09T09:55:57.402309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:51.170023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'6","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.482114+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:56:07.482114+0000","last_peered":"2024-05-09T09:56:07.482114+0000","last_clean":"2024-05-09T09:56:07.482114+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:56:07.482114+0000","last_undegraded":"2024-05-09T09:56:07.482114+0000","last_fullsized":"2024-05-09T09:56:07.482114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":12294,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018013+0000","last_change":"2024-05-09T09:55:10.509010+0000","last_active":"2024-05-09T09:55:58.018013+0000","last_peered":"2024-05-09T09:55:58.018013+0000","last_clean":"2024-05-09T09:55:58.018013+0000","last_became_active":"2024-05-09T09:55:10.506778+0000","last_became_peered":"2024-05-09T09:55:10.506778+0000","last_unstale":"2024-05-09T09:55:58.018013+0000","last_undegraded":"2024-05-09T09:55:58.018013+0000","last_fullsized":"2024-05-09T09:55:58.018013+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706557+0000","last_change":"2024-05-09T09:55:41.534680+0000","last_active":"2024-05-09T09:55:56.706557+0000","last_peered":"2024-05-09T09:55:56.706557+0000","last_clean":"2024-05-09T09:55:56.706557+0000","last_became_active":"2024-05-09T09:55:41.467079+0000","last_became_peered":"2024-05-09T09:55:41.467079+0000","last_unstale":"2024-05-09T09:55:56.706557+0000","last_undegraded":"2024-05-09T09:55:56.706557+0000","last_fullsized":"2024-05-09T09:55:56.706557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:22.934731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706204+0000","last_change":"2024-05-09T09:55:41.468769+0000","last_active":"2024-05-09T09:55:56.706204+0000","last_peered":"2024-05-09T09:55:56.706204+0000","last_clean":"2024-05-09T09:55:56.706204+0000","last_became_active":"2024-05-09T09:55:41.467929+0000","last_became_peered":"2024-05-09T09:55:41.467929+0000","last_unstale":"2024-05-09T09:55:56.706204+0000","last_undegraded":"2024-05-09T09:55:56.706204+0000","last_fullsized":"2024-05-09T09:55:56.706204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:02.390946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702279+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:55:56.702279+0000","last_peered":"2024-05-09T09:55:56.702279+0000","last_clean":"2024-05-09T09:55:56.702279+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:55:56.702279+0000","last_undegraded":"2024-05-09T09:55:56.702279+0000","last_fullsized":"2024-05-09T09:55:56.702279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:47:35.960993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705924+0000","last_change":"2024-05-09T09:55:10.483103+0000","last_active":"2024-05-09T09:55:56.705924+0000","last_peered":"2024-05-09T09:55:56.705924+0000","last_clean":"2024-05-09T09:55:56.705924+0000","last_became_active":"2024-05-09T09:55:10.482649+0000","last_became_peered":"2024-05-09T09:55:10.482649+0000","last_unstale":"2024-05-09T09:55:56.705924+0000","last_undegraded":"2024-05-09T09:55:56.705924+0000","last_fullsized":"2024-05-09T09:55:56.705924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:15.175574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'20","reported_seq":228,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.155340+0000","last_change":"2024-05-09T09:55:45.036128+0000","last_active":"2024-05-09T09:56:08.155340+0000","last_peered":"2024-05-09T09:56:08.155340+0000","last_clean":"2024-05-09T09:56:08.155340+0000","last_became_active":"2024-05-09T09:55:41.508695+0000","last_became_peered":"2024-05-09T09:55:41.508695+0000","last_unstale":"2024-05-09T09:56:08.155340+0000","last_undegraded":"2024-05-09T09:56:08.155340+0000","last_fullsized":"2024-05-09T09:56:08.155340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":38936,"num_write":60,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018240+0000","last_change":"2024-05-09T09:55:10.510105+0000","last_active":"2024-05-09T09:55:58.018240+0000","last_peered":"2024-05-09T09:55:58.018240+0000","last_clean":"2024-05-09T09:55:58.018240+0000","last_became_active":"2024-05-09T09:55:10.508122+0000","last_became_peered":"2024-05-09T09:55:10.508122+0000","last_unstale":"2024-05-09T09:55:58.018240+0000","last_undegraded":"2024-05-09T09:55:58.018240+0000","last_fullsized":"2024-05-09T09:55:58.018240+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"63'11","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511453+0000","last_change":"2024-05-09T09:55:43.116362+0000","last_active":"2024-05-09T09:55:57.511453+0000","last_peered":"2024-05-09T09:55:57.511453+0000","last_clean":"2024-05-09T09:55:57.511453+0000","last_became_active":"2024-05-09T09:55:41.506785+0000","last_became_peered":"2024-05-09T09:55:41.506785+0000","last_unstale":"2024-05-09T09:55:57.511453+0000","last_undegraded":"2024-05-09T09:55:57.511453+0000","last_fullsized":"2024-05-09T09:55:57.511453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:10:30.446781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'18","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.348460+0000","last_change":"2024-05-09T09:53:15.170322+0000","last_active":"2024-05-09T09:56:07.348460+0000","last_peered":"2024-05-09T09:56:07.348460+0000","last_clean":"2024-05-09T09:56:07.348460+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:56:07.348460+0000","last_undegraded":"2024-05-09T09:56:07.348460+0000","last_fullsized":"2024-05-09T09:56:07.348460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705111+0000","last_change":"2024-05-09T09:55:42.211684+0000","last_active":"2024-05-09T09:55:56.705111+0000","last_peered":"2024-05-09T09:55:56.705111+0000","last_clean":"2024-05-09T09:55:56.705111+0000","last_became_active":"2024-05-09T09:55:41.492528+0000","last_became_peered":"2024-05-09T09:55:41.492528+0000","last_unstale":"2024-05-09T09:55:56.705111+0000","last_undegraded":"2024-05-09T09:55:56.705111+0000","last_fullsized":"2024-05-09T09:55:56.705111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:23.272525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018549+0000","last_change":"2024-05-09T09:55:10.510510+0000","last_active":"2024-05-09T09:55:58.018549+0000","last_peered":"2024-05-09T09:55:58.018549+0000","last_clean":"2024-05-09T09:55:58.018549+0000","last_became_active":"2024-05-09T09:55:10.508721+0000","last_became_peered":"2024-05-09T09:55:10.508721+0000","last_unstale":"2024-05-09T09:55:58.018549+0000","last_undegraded":"2024-05-09T09:55:58.018549+0000","last_fullsized":"2024-05-09T09:55:58.018549+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'12","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.057591+0000","last_change":"2024-05-09T09:53:07.133704+0000","last_active":"2024-05-09T09:56:08.057591+0000","last_peered":"2024-05-09T09:56:08.057591+0000","last_clean":"2024-05-09T09:56:08.057591+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:56:08.057591+0000","last_undegraded":"2024-05-09T09:56:08.057591+0000","last_fullsized":"2024-05-09T09:56:08.057591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:38.104932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401894+0000","last_change":"2024-05-09T09:55:10.508180+0000","last_active":"2024-05-09T09:55:57.401894+0000","last_peered":"2024-05-09T09:55:57.401894+0000","last_clean":"2024-05-09T09:55:57.401894+0000","last_became_active":"2024-05-09T09:55:10.507504+0000","last_became_peered":"2024-05-09T09:55:10.507504+0000","last_unstale":"2024-05-09T09:55:57.401894+0000","last_undegraded":"2024-05-09T09:55:57.401894+0000","last_fullsized":"2024-05-09T09:55:57.401894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:26.131778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'18","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.782654+0000","last_change":"2024-05-09T09:53:13.149890+0000","last_active":"2024-05-09T09:56:07.782654+0000","last_peered":"2024-05-09T09:56:07.782654+0000","last_clean":"2024-05-09T09:56:07.782654+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:56:07.782654+0000","last_undegraded":"2024-05-09T09:56:07.782654+0000","last_fullsized":"2024-05-09T09:56:07.782654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:28.381397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'21","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.354875+0000","last_change":"2024-05-09T09:55:10.785031+0000","last_active":"2024-05-09T09:56:07.354875+0000","last_peered":"2024-05-09T09:56:07.354875+0000","last_clean":"2024-05-09T09:56:07.354875+0000","last_became_active":"2024-05-09T09:55:10.502644+0000","last_became_peered":"2024-05-09T09:55:10.502644+0000","last_unstale":"2024-05-09T09:56:07.354875+0000","last_undegraded":"2024-05-09T09:56:07.354875+0000","last_fullsized":"2024-05-09T09:56:07.354875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:33:14.036784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400855+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:55:57.400855+0000","last_peered":"2024-05-09T09:55:57.400855+0000","last_clean":"2024-05-09T09:55:57.400855+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:55:57.400855+0000","last_undegraded":"2024-05-09T09:55:57.400855+0000","last_fullsized":"2024-05-09T09:55:57.400855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:16.344612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'20","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.250064+0000","last_change":"2024-05-09T09:55:44.175359+0000","last_active":"2024-05-09T09:56:08.250064+0000","last_peered":"2024-05-09T09:56:08.250064+0000","last_clean":"2024-05-09T09:56:08.250064+0000","last_became_active":"2024-05-09T09:55:41.507201+0000","last_became_peered":"2024-05-09T09:55:41.507201+0000","last_unstale":"2024-05-09T09:56:08.250064+0000","last_undegraded":"2024-05-09T09:56:08.250064+0000","last_fullsized":"2024-05-09T09:56:08.250064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:07.511876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34828,"num_write":40,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016355+0000","last_change":"2024-05-09T09:53:11.120711+0000","last_active":"2024-05-09T09:55:58.016355+0000","last_peered":"2024-05-09T09:55:58.016355+0000","last_clean":"2024-05-09T09:55:58.016355+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:55:58.016355+0000","last_undegraded":"2024-05-09T09:55:58.016355+0000","last_fullsized":"2024-05-09T09:55:58.016355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'31","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.982508+0000","last_change":"2024-05-09T09:53:13.150621+0000","last_active":"2024-05-09T09:56:07.982508+0000","last_peered":"2024-05-09T09:56:07.982508+0000","last_clean":"2024-05-09T09:56:07.982508+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:56:07.982508+0000","last_undegraded":"2024-05-09T09:56:07.982508+0000","last_fullsized":"2024-05-09T09:56:07.982508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:49.450743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":57,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704309+0000","last_change":"2024-05-09T09:53:15.174724+0000","last_active":"2024-05-09T09:55:56.704309+0000","last_peered":"2024-05-09T09:55:56.704309+0000","last_clean":"2024-05-09T09:55:56.704309+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:55:56.704309+0000","last_undegraded":"2024-05-09T09:55:56.704309+0000","last_fullsized":"2024-05-09T09:55:56.704309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:16.613688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401424+0000","last_change":"2024-05-09T09:55:41.485193+0000","last_active":"2024-05-09T09:55:57.401424+0000","last_peered":"2024-05-09T09:55:57.401424+0000","last_clean":"2024-05-09T09:55:57.401424+0000","last_became_active":"2024-05-09T09:55:41.484312+0000","last_became_peered":"2024-05-09T09:55:41.484312+0000","last_unstale":"2024-05-09T09:55:57.401424+0000","last_undegraded":"2024-05-09T09:55:57.401424+0000","last_fullsized":"2024-05-09T09:55:57.401424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:59.737104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704125+0000","last_change":"2024-05-09T09:55:41.479720+0000","last_active":"2024-05-09T09:55:56.704125+0000","last_peered":"2024-05-09T09:55:56.704125+0000","last_clean":"2024-05-09T09:55:56.704125+0000","last_became_active":"2024-05-09T09:55:41.472133+0000","last_became_peered":"2024-05-09T09:55:41.472133+0000","last_unstale":"2024-05-09T09:55:56.704125+0000","last_undegraded":"2024-05-09T09:55:56.704125+0000","last_fullsized":"2024-05-09T09:55:56.704125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:55.564231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'8","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.174697+0000","last_change":"2024-05-09T09:55:44.852684+0000","last_active":"2024-05-09T09:56:08.174697+0000","last_peered":"2024-05-09T09:56:08.174697+0000","last_clean":"2024-05-09T09:56:08.174697+0000","last_became_active":"2024-05-09T09:55:41.507751+0000","last_became_peered":"2024-05-09T09:55:41.507751+0000","last_unstale":"2024-05-09T09:56:08.174697+0000","last_undegraded":"2024-05-09T09:56:08.174697+0000","last_fullsized":"2024-05-09T09:56:08.174697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:13.201219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511904+0000","last_change":"2024-05-09T09:53:11.114087+0000","last_active":"2024-05-09T09:55:57.511904+0000","last_peered":"2024-05-09T09:55:57.511904+0000","last_clean":"2024-05-09T09:55:57.511904+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:55:57.511904+0000","last_undegraded":"2024-05-09T09:55:57.511904+0000","last_fullsized":"2024-05-09T09:55:57.511904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:00.201815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'16","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.521564+0000","last_change":"2024-05-09T09:55:11.749967+0000","last_active":"2024-05-09T09:56:07.521564+0000","last_peered":"2024-05-09T09:56:07.521564+0000","last_clean":"2024-05-09T09:56:07.521564+0000","last_became_active":"2024-05-09T09:55:10.522763+0000","last_became_peered":"2024-05-09T09:55:10.522763+0000","last_unstale":"2024-05-09T09:56:07.521564+0000","last_undegraded":"2024-05-09T09:56:07.521564+0000","last_fullsized":"2024-05-09T09:56:07.521564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:03.450608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013669+0000","last_change":"2024-05-09T09:55:10.505759+0000","last_active":"2024-05-09T09:55:58.013669+0000","last_peered":"2024-05-09T09:55:58.013669+0000","last_clean":"2024-05-09T09:55:58.013669+0000","last_became_active":"2024-05-09T09:55:10.504789+0000","last_became_peered":"2024-05-09T09:55:10.504789+0000","last_unstale":"2024-05-09T09:55:58.013669+0000","last_undegraded":"2024-05-09T09:55:58.013669+0000","last_fullsized":"2024-05-09T09:55:58.013669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:53.805557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298207+0000","last_change":"2024-05-09T09:55:41.506430+0000","last_active":"2024-05-09T09:55:57.298207+0000","last_peered":"2024-05-09T09:55:57.298207+0000","last_clean":"2024-05-09T09:55:57.298207+0000","last_became_active":"2024-05-09T09:55:41.505745+0000","last_became_peered":"2024-05-09T09:55:41.505745+0000","last_unstale":"2024-05-09T09:55:57.298207+0000","last_undegraded":"2024-05-09T09:55:57.298207+0000","last_fullsized":"2024-05-09T09:55:57.298207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:18.090362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297031+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:55:57.297031+0000","last_peered":"2024-05-09T09:55:57.297031+0000","last_clean":"2024-05-09T09:55:57.297031+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:55:57.297031+0000","last_undegraded":"2024-05-09T09:55:57.297031+0000","last_fullsized":"2024-05-09T09:55:57.297031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:33.429469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.975564+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:56:07.975564+0000","last_peered":"2024-05-09T09:56:07.975564+0000","last_clean":"2024-05-09T09:56:07.975564+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:56:07.975564+0000","last_undegraded":"2024-05-09T09:56:07.975564+0000","last_fullsized":"2024-05-09T09:56:07.975564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:35.336921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34828,"num_write":40,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512208+0000","last_change":"2024-05-09T09:53:11.106203+0000","last_active":"2024-05-09T09:55:57.512208+0000","last_peered":"2024-05-09T09:55:57.512208+0000","last_clean":"2024-05-09T09:55:57.512208+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:55:57.512208+0000","last_undegraded":"2024-05-09T09:55:57.512208+0000","last_fullsized":"2024-05-09T09:55:57.512208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:20.067119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'25","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.020074+0000","last_change":"2024-05-09T09:53:13.139301+0000","last_active":"2024-05-09T09:56:08.020074+0000","last_peered":"2024-05-09T09:56:08.020074+0000","last_clean":"2024-05-09T09:56:08.020074+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:56:08.020074+0000","last_undegraded":"2024-05-09T09:56:08.020074+0000","last_fullsized":"2024-05-09T09:56:08.020074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:05.425287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'18","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.356194+0000","last_change":"2024-05-09T09:53:15.171381+0000","last_active":"2024-05-09T09:56:07.356194+0000","last_peered":"2024-05-09T09:56:07.356194+0000","last_clean":"2024-05-09T09:56:07.356194+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:56:07.356194+0000","last_undegraded":"2024-05-09T09:56:07.356194+0000","last_fullsized":"2024-05-09T09:56:07.356194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706729+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:55:56.706729+0000","last_peered":"2024-05-09T09:55:56.706729+0000","last_clean":"2024-05-09T09:55:56.706729+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:55:56.706729+0000","last_undegraded":"2024-05-09T09:55:56.706729+0000","last_fullsized":"2024-05-09T09:55:56.706729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:10.295581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705393+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:55:56.705393+0000","last_peered":"2024-05-09T09:55:56.705393+0000","last_clean":"2024-05-09T09:55:56.705393+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:55:56.705393+0000","last_undegraded":"2024-05-09T09:55:56.705393+0000","last_fullsized":"2024-05-09T09:55:56.705393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'20","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.187294+0000","last_change":"2024-05-09T09:55:11.694165+0000","last_active":"2024-05-09T09:56:08.187294+0000","last_peered":"2024-05-09T09:56:08.187294+0000","last_clean":"2024-05-09T09:56:08.187294+0000","last_became_active":"2024-05-09T09:55:10.521894+0000","last_became_peered":"2024-05-09T09:55:10.521894+0000","last_unstale":"2024-05-09T09:56:08.187294+0000","last_undegraded":"2024-05-09T09:56:08.187294+0000","last_fullsized":"2024-05-09T09:56:08.187294+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:04.661085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38924,"num_write":40,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511206+0000","last_change":"2024-05-09T09:55:41.484220+0000","last_active":"2024-05-09T09:55:57.511206+0000","last_peered":"2024-05-09T09:55:57.511206+0000","last_clean":"2024-05-09T09:55:57.511206+0000","last_became_active":"2024-05-09T09:55:41.483828+0000","last_became_peered":"2024-05-09T09:55:41.483828+0000","last_unstale":"2024-05-09T09:55:57.511206+0000","last_undegraded":"2024-05-09T09:55:57.511206+0000","last_fullsized":"2024-05-09T09:55:57.511206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:12.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'38","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.062474+0000","last_change":"2024-05-09T09:53:13.125170+0000","last_active":"2024-05-09T09:56:08.062474+0000","last_peered":"2024-05-09T09:56:08.062474+0000","last_clean":"2024-05-09T09:56:08.062474+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:56:08.062474+0000","last_undegraded":"2024-05-09T09:56:08.062474+0000","last_fullsized":"2024-05-09T09:56:08.062474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":100,"num_write":42,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511648+0000","last_change":"2024-05-09T09:53:15.183354+0000","last_active":"2024-05-09T09:55:57.511648+0000","last_peered":"2024-05-09T09:55:57.511648+0000","last_clean":"2024-05-09T09:55:57.511648+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:55:57.511648+0000","last_undegraded":"2024-05-09T09:55:57.511648+0000","last_fullsized":"2024-05-09T09:55:57.511648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:05.730617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703562+0000","last_change":"2024-05-09T09:55:10.518479+0000","last_active":"2024-05-09T09:55:56.703562+0000","last_peered":"2024-05-09T09:55:56.703562+0000","last_clean":"2024-05-09T09:55:56.703562+0000","last_became_active":"2024-05-09T09:55:10.518109+0000","last_became_peered":"2024-05-09T09:55:10.518109+0000","last_unstale":"2024-05-09T09:55:56.703562+0000","last_undegraded":"2024-05-09T09:55:56.703562+0000","last_fullsized":"2024-05-09T09:55:56.703562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:20.260703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705558+0000","last_change":"2024-05-09T09:55:41.491823+0000","last_active":"2024-05-09T09:55:56.705558+0000","last_peered":"2024-05-09T09:55:56.705558+0000","last_clean":"2024-05-09T09:55:56.705558+0000","last_became_active":"2024-05-09T09:55:41.488846+0000","last_became_peered":"2024-05-09T09:55:41.488846+0000","last_unstale":"2024-05-09T09:55:56.705558+0000","last_undegraded":"2024-05-09T09:55:56.705558+0000","last_fullsized":"2024-05-09T09:55:56.705558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:00.130607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'14","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.936231+0000","last_change":"2024-05-09T09:55:10.972117+0000","last_active":"2024-05-09T09:56:07.936231+0000","last_peered":"2024-05-09T09:56:07.936231+0000","last_clean":"2024-05-09T09:56:07.936231+0000","last_became_active":"2024-05-09T09:55:10.507132+0000","last_became_peered":"2024-05-09T09:55:10.507132+0000","last_unstale":"2024-05-09T09:56:07.936231+0000","last_undegraded":"2024-05-09T09:56:07.936231+0000","last_fullsized":"2024-05-09T09:56:07.936231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:59.211608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22550,"num_write":54,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512533+0000","last_change":"2024-05-09T09:53:11.115631+0000","last_active":"2024-05-09T09:55:57.512533+0000","last_peered":"2024-05-09T09:55:57.512533+0000","last_clean":"2024-05-09T09:55:57.512533+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:55:57.512533+0000","last_undegraded":"2024-05-09T09:55:57.512533+0000","last_fullsized":"2024-05-09T09:55:57.512533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:29.553784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'24","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.641876+0000","last_change":"2024-05-09T09:55:42.405072+0000","last_active":"2024-05-09T09:56:07.641876+0000","last_peered":"2024-05-09T09:56:07.641876+0000","last_clean":"2024-05-09T09:56:07.641876+0000","last_became_active":"2024-05-09T09:55:41.509467+0000","last_became_peered":"2024-05-09T09:55:41.509467+0000","last_unstale":"2024-05-09T09:56:07.641876+0000","last_undegraded":"2024-05-09T09:56:07.641876+0000","last_fullsized":"2024-05-09T09:56:07.641876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:31.891322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":55,"num_write":30,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":6936,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706227+0000","last_change":"2024-05-09T09:55:10.506676+0000","last_active":"2024-05-09T09:55:56.706227+0000","last_peered":"2024-05-09T09:55:56.706227+0000","last_clean":"2024-05-09T09:55:56.706227+0000","last_became_active":"2024-05-09T09:55:10.506376+0000","last_became_peered":"2024-05-09T09:55:10.506376+0000","last_unstale":"2024-05-09T09:55:56.706227+0000","last_undegraded":"2024-05-09T09:55:56.706227+0000","last_fullsized":"2024-05-09T09:55:56.706227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:18.706314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"63'2","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016084+0000","last_change":"2024-05-09T09:55:11.409285+0000","last_active":"2024-05-09T09:55:58.016084+0000","last_peered":"2024-05-09T09:55:58.016084+0000","last_clean":"2024-05-09T09:55:58.016084+0000","last_became_active":"2024-05-09T09:55:10.512509+0000","last_became_peered":"2024-05-09T09:55:10.512509+0000","last_unstale":"2024-05-09T09:55:58.016084+0000","last_undegraded":"2024-05-09T09:55:58.016084+0000","last_fullsized":"2024-05-09T09:55:58.016084+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:08.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706333+0000","last_change":"2024-05-09T09:55:41.477052+0000","last_active":"2024-05-09T09:55:56.706333+0000","last_peered":"2024-05-09T09:55:56.706333+0000","last_clean":"2024-05-09T09:55:56.706333+0000","last_became_active":"2024-05-09T09:55:41.471497+0000","last_became_peered":"2024-05-09T09:55:41.471497+0000","last_unstale":"2024-05-09T09:55:56.706333+0000","last_undegraded":"2024-05-09T09:55:56.706333+0000","last_fullsized":"2024-05-09T09:55:56.706333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:59:59.078912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'18","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.111889+0000","last_change":"2024-05-09T09:55:42.508840+0000","last_active":"2024-05-09T09:56:08.111889+0000","last_peered":"2024-05-09T09:56:08.111889+0000","last_clean":"2024-05-09T09:56:08.111889+0000","last_became_active":"2024-05-09T09:55:41.513259+0000","last_became_peered":"2024-05-09T09:55:41.513259+0000","last_unstale":"2024-05-09T09:56:08.111889+0000","last_undegraded":"2024-05-09T09:56:08.111889+0000","last_fullsized":"2024-05-09T09:56:08.111889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703127+0000","last_change":"2024-05-09T09:55:41.505012+0000","last_active":"2024-05-09T09:55:56.703127+0000","last_peered":"2024-05-09T09:55:56.703127+0000","last_clean":"2024-05-09T09:55:56.703127+0000","last_became_active":"2024-05-09T09:55:41.504609+0000","last_became_peered":"2024-05-09T09:55:41.504609+0000","last_unstale":"2024-05-09T09:55:56.703127+0000","last_undegraded":"2024-05-09T09:55:56.703127+0000","last_fullsized":"2024-05-09T09:55:56.703127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'28","reported_seq":233,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.466521+0000","last_change":"2024-05-09T09:55:10.818400+0000","last_active":"2024-05-09T09:56:07.466521+0000","last_peered":"2024-05-09T09:56:07.466521+0000","last_clean":"2024-05-09T09:56:07.466521+0000","last_became_active":"2024-05-09T09:55:10.520615+0000","last_became_peered":"2024-05-09T09:55:10.520615+0000","last_unstale":"2024-05-09T09:56:07.466521+0000","last_undegraded":"2024-05-09T09:56:07.466521+0000","last_fullsized":"2024-05-09T09:56:07.466521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:32.213479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":58,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":3002,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'18","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.350668+0000","last_change":"2024-05-09T09:53:15.176691+0000","last_active":"2024-05-09T09:56:07.350668+0000","last_peered":"2024-05-09T09:56:07.350668+0000","last_clean":"2024-05-09T09:56:07.350668+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:56:07.350668+0000","last_undegraded":"2024-05-09T09:56:07.350668+0000","last_fullsized":"2024-05-09T09:56:07.350668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:17:47.263922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702414+0000","last_change":"2024-05-09T09:53:17.176592+0000","last_active":"2024-05-09T09:55:56.702414+0000","last_peered":"2024-05-09T09:55:56.702414+0000","last_clean":"2024-05-09T09:55:56.702414+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:55:56.702414+0000","last_undegraded":"2024-05-09T09:55:56.702414+0000","last_fullsized":"2024-05-09T09:55:56.702414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:58.602155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706758+0000","last_change":"2024-05-09T09:55:42.572344+0000","last_active":"2024-05-09T09:55:56.706758+0000","last_peered":"2024-05-09T09:55:56.706758+0000","last_clean":"2024-05-09T09:55:56.706758+0000","last_became_active":"2024-05-09T09:55:41.517278+0000","last_became_peered":"2024-05-09T09:55:41.517278+0000","last_unstale":"2024-05-09T09:55:56.706758+0000","last_undegraded":"2024-05-09T09:55:56.706758+0000","last_fullsized":"2024-05-09T09:55:56.706758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'18","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.246989+0000","last_change":"2024-05-09T09:55:42.204305+0000","last_active":"2024-05-09T09:56:08.246989+0000","last_peered":"2024-05-09T09:56:08.246989+0000","last_clean":"2024-05-09T09:56:08.246989+0000","last_became_active":"2024-05-09T09:55:41.481490+0000","last_became_peered":"2024-05-09T09:55:41.481490+0000","last_unstale":"2024-05-09T09:56:08.246989+0000","last_undegraded":"2024-05-09T09:56:08.246989+0000","last_fullsized":"2024-05-09T09:56:08.246989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.336777+0000","last_change":"2024-05-09T09:55:41.651487+0000","last_active":"2024-05-09T09:56:07.336777+0000","last_peered":"2024-05-09T09:56:07.336777+0000","last_clean":"2024-05-09T09:56:07.336777+0000","last_became_active":"2024-05-09T09:55:41.495448+0000","last_became_peered":"2024-05-09T09:55:41.495448+0000","last_unstale":"2024-05-09T09:56:07.336777+0000","last_undegraded":"2024-05-09T09:56:07.336777+0000","last_fullsized":"2024-05-09T09:56:07.336777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:09.689288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017854+0000","last_change":"2024-05-09T09:55:11.115278+0000","last_active":"2024-05-09T09:55:58.017854+0000","last_peered":"2024-05-09T09:55:58.017854+0000","last_clean":"2024-05-09T09:55:58.017854+0000","last_became_active":"2024-05-09T09:55:10.512273+0000","last_became_peered":"2024-05-09T09:55:10.512273+0000","last_unstale":"2024-05-09T09:55:58.017854+0000","last_undegraded":"2024-05-09T09:55:58.017854+0000","last_fullsized":"2024-05-09T09:55:58.017854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:23:44.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'18","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.352472+0000","last_change":"2024-05-09T09:53:15.174136+0000","last_active":"2024-05-09T09:56:07.352472+0000","last_peered":"2024-05-09T09:56:07.352472+0000","last_clean":"2024-05-09T09:56:07.352472+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:56:07.352472+0000","last_undegraded":"2024-05-09T09:56:07.352472+0000","last_fullsized":"2024-05-09T09:56:07.352472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:18.879675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705087+0000","last_change":"2024-05-09T09:55:41.475763+0000","last_active":"2024-05-09T09:55:56.705087+0000","last_peered":"2024-05-09T09:55:56.705087+0000","last_clean":"2024-05-09T09:55:56.705087+0000","last_became_active":"2024-05-09T09:55:41.474020+0000","last_became_peered":"2024-05-09T09:55:41.474020+0000","last_unstale":"2024-05-09T09:55:56.705087+0000","last_undegraded":"2024-05-09T09:55:56.705087+0000","last_fullsized":"2024-05-09T09:55:56.705087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:59.415817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"75'42","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703965+0000","last_change":"2024-05-09T09:55:11.077756+0000","last_active":"2024-05-09T09:55:56.703965+0000","last_peered":"2024-05-09T09:55:56.703965+0000","last_clean":"2024-05-09T09:55:56.703965+0000","last_became_active":"2024-05-09T09:55:10.516407+0000","last_became_peered":"2024-05-09T09:55:10.516407+0000","last_unstale":"2024-05-09T09:55:56.703965+0000","last_undegraded":"2024-05-09T09:55:56.703965+0000","last_fullsized":"2024-05-09T09:55:56.703965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:29.572431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"95'12","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.098086+0000","last_change":"2024-05-09T09:55:11.190571+0000","last_active":"2024-05-09T09:56:08.098086+0000","last_peered":"2024-05-09T09:56:08.098086+0000","last_clean":"2024-05-09T09:56:08.098086+0000","last_became_active":"2024-05-09T09:55:10.516633+0000","last_became_peered":"2024-05-09T09:55:10.516633+0000","last_unstale":"2024-05-09T09:56:08.098086+0000","last_undegraded":"2024-05-09T09:56:08.098086+0000","last_fullsized":"2024-05-09T09:56:08.098086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:56.816319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12294,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706539+0000","last_change":"2024-05-09T09:55:41.480580+0000","last_active":"2024-05-09T09:55:56.706539+0000","last_peered":"2024-05-09T09:55:56.706539+0000","last_clean":"2024-05-09T09:55:56.706539+0000","last_became_active":"2024-05-09T09:55:41.479634+0000","last_became_peered":"2024-05-09T09:55:41.479634+0000","last_unstale":"2024-05-09T09:55:56.706539+0000","last_undegraded":"2024-05-09T09:55:56.706539+0000","last_fullsized":"2024-05-09T09:55:56.706539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:12.037871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'28","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.921730+0000","last_change":"2024-05-09T09:53:13.136682+0000","last_active":"2024-05-09T09:56:07.921730+0000","last_peered":"2024-05-09T09:56:07.921730+0000","last_clean":"2024-05-09T09:56:07.921730+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:56:07.921730+0000","last_undegraded":"2024-05-09T09:56:07.921730+0000","last_fullsized":"2024-05-09T09:56:07.921730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:07.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":48,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298448+0000","last_change":"2024-05-09T09:55:10.503163+0000","last_active":"2024-05-09T09:55:57.298448+0000","last_peered":"2024-05-09T09:55:57.298448+0000","last_clean":"2024-05-09T09:55:57.298448+0000","last_became_active":"2024-05-09T09:55:10.501658+0000","last_became_peered":"2024-05-09T09:55:10.501658+0000","last_unstale":"2024-05-09T09:55:57.298448+0000","last_undegraded":"2024-05-09T09:55:57.298448+0000","last_fullsized":"2024-05-09T09:55:57.298448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:02:16.963610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704206+0000","last_change":"2024-05-09T09:53:17.182931+0000","last_active":"2024-05-09T09:55:56.704206+0000","last_peered":"2024-05-09T09:55:56.704206+0000","last_clean":"2024-05-09T09:55:56.704206+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:55:56.704206+0000","last_undegraded":"2024-05-09T09:55:56.704206+0000","last_fullsized":"2024-05-09T09:55:56.704206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:17.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299020+0000","last_change":"2024-05-09T09:55:41.514105+0000","last_active":"2024-05-09T09:55:57.299020+0000","last_peered":"2024-05-09T09:55:57.299020+0000","last_clean":"2024-05-09T09:55:57.299020+0000","last_became_active":"2024-05-09T09:55:41.513454+0000","last_became_peered":"2024-05-09T09:55:41.513454+0000","last_unstale":"2024-05-09T09:55:57.299020+0000","last_undegraded":"2024-05-09T09:55:57.299020+0000","last_fullsized":"2024-05-09T09:55:57.299020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:12.201246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014983+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:55:58.014983+0000","last_peered":"2024-05-09T09:55:58.014983+0000","last_clean":"2024-05-09T09:55:58.014983+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:55:58.014983+0000","last_undegraded":"2024-05-09T09:55:58.014983+0000","last_fullsized":"2024-05-09T09:55:58.014983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:03.389387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401371+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:55:57.401371+0000","last_peered":"2024-05-09T09:55:57.401371+0000","last_clean":"2024-05-09T09:55:57.401371+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:55:57.401371+0000","last_undegraded":"2024-05-09T09:55:57.401371+0000","last_fullsized":"2024-05-09T09:55:57.401371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:56.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'16","reported_seq":73,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.036951+0000","last_change":"2024-05-09T09:55:10.921973+0000","last_active":"2024-05-09T09:56:08.036951+0000","last_peered":"2024-05-09T09:56:08.036951+0000","last_clean":"2024-05-09T09:56:08.036951+0000","last_became_active":"2024-05-09T09:55:10.505428+0000","last_became_peered":"2024-05-09T09:55:10.505428+0000","last_unstale":"2024-05-09T09:56:08.036951+0000","last_undegraded":"2024-05-09T09:56:08.036951+0000","last_fullsized":"2024-05-09T09:56:08.036951+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:11.081894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16396,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017491+0000","last_change":"2024-05-09T09:53:11.118855+0000","last_active":"2024-05-09T09:55:58.017491+0000","last_peered":"2024-05-09T09:55:58.017491+0000","last_clean":"2024-05-09T09:55:58.017491+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:55:58.017491+0000","last_undegraded":"2024-05-09T09:55:58.017491+0000","last_fullsized":"2024-05-09T09:55:58.017491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:01:14.846846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'48","reported_seq":255,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.256538+0000","last_change":"2024-05-09T09:55:11.706091+0000","last_active":"2024-05-09T09:56:08.256538+0000","last_peered":"2024-05-09T09:56:08.256538+0000","last_clean":"2024-05-09T09:56:08.256538+0000","last_became_active":"2024-05-09T09:55:10.522989+0000","last_became_peered":"2024-05-09T09:55:10.522989+0000","last_unstale":"2024-05-09T09:56:08.256538+0000","last_undegraded":"2024-05-09T09:56:08.256538+0000","last_fullsized":"2024-05-09T09:56:08.256538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:21.617588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":130,"num_write":50,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":11272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706558+0000","last_change":"2024-05-09T09:53:15.168272+0000","last_active":"2024-05-09T09:55:56.706558+0000","last_peered":"2024-05-09T09:55:56.706558+0000","last_clean":"2024-05-09T09:55:56.706558+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:55:56.706558+0000","last_undegraded":"2024-05-09T09:55:56.706558+0000","last_fullsized":"2024-05-09T09:55:56.706558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:26.548102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"75'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297460+0000","last_change":"2024-05-09T09:53:17.184693+0000","last_active":"2024-05-09T09:55:57.297460+0000","last_peered":"2024-05-09T09:55:57.297460+0000","last_clean":"2024-05-09T09:55:57.297460+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:55:57.297460+0000","last_undegraded":"2024-05-09T09:55:57.297460+0000","last_fullsized":"2024-05-09T09:55:57.297460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:33.980662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706199+0000","last_change":"2024-05-09T09:53:54.476843+0000","last_active":"2024-05-09T09:55:56.706199+0000","last_peered":"2024-05-09T09:55:56.706199+0000","last_clean":"2024-05-09T09:55:56.706199+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:55:56.706199+0000","last_undegraded":"2024-05-09T09:55:56.706199+0000","last_fullsized":"2024-05-09T09:55:56.706199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:04:48.486905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015011+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:55:58.015011+0000","last_peered":"2024-05-09T09:55:58.015011+0000","last_clean":"2024-05-09T09:55:58.015011+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:55:58.015011+0000","last_undegraded":"2024-05-09T09:55:58.015011+0000","last_fullsized":"2024-05-09T09:55:58.015011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:35.114967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'14","reported_seq":244,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.955864+0000","last_change":"2024-05-09T09:55:42.599407+0000","last_active":"2024-05-09T09:56:07.955864+0000","last_peered":"2024-05-09T09:56:07.955864+0000","last_clean":"2024-05-09T09:56:07.955864+0000","last_became_active":"2024-05-09T09:55:41.489210+0000","last_became_peered":"2024-05-09T09:55:41.489210+0000","last_unstale":"2024-05-09T09:56:07.955864+0000","last_undegraded":"2024-05-09T09:56:07.955864+0000","last_fullsized":"2024-05-09T09:56:07.955864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:36:38.674440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":14,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402446+0000","last_change":"2024-05-09T09:53:11.126258+0000","last_active":"2024-05-09T09:55:57.402446+0000","last_peered":"2024-05-09T09:55:57.402446+0000","last_clean":"2024-05-09T09:55:57.402446+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:55:57.402446+0000","last_undegraded":"2024-05-09T09:55:57.402446+0000","last_fullsized":"2024-05-09T09:55:57.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:53.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'74","reported_seq":293,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.943778+0000","last_change":"2024-05-09T09:53:13.142530+0000","last_active":"2024-05-09T09:56:07.943778+0000","last_peered":"2024-05-09T09:56:07.943778+0000","last_clean":"2024-05-09T09:56:07.943778+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:56:07.943778+0000","last_undegraded":"2024-05-09T09:56:07.943778+0000","last_fullsized":"2024-05-09T09:56:07.943778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.852482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":182,"num_write":70,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018988+0000","last_change":"2024-05-09T09:53:15.166721+0000","last_active":"2024-05-09T09:55:58.018988+0000","last_peered":"2024-05-09T09:55:58.018988+0000","last_clean":"2024-05-09T09:55:58.018988+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:55:58.018988+0000","last_undegraded":"2024-05-09T09:55:58.018988+0000","last_fullsized":"2024-05-09T09:55:58.018988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:40.227220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704712+0000","last_change":"2024-05-09T09:53:17.265648+0000","last_active":"2024-05-09T09:55:56.704712+0000","last_peered":"2024-05-09T09:55:56.704712+0000","last_clean":"2024-05-09T09:55:56.704712+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:55:56.704712+0000","last_undegraded":"2024-05-09T09:55:56.704712+0000","last_fullsized":"2024-05-09T09:55:56.704712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:42.246882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'46","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704619+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:55:56.704619+0000","last_peered":"2024-05-09T09:55:56.704619+0000","last_clean":"2024-05-09T09:55:56.704619+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:55:56.704619+0000","last_undegraded":"2024-05-09T09:55:56.704619+0000","last_fullsized":"2024-05-09T09:55:56.704619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:17:32.276134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512113+0000","last_change":"2024-05-09T09:55:10.500785+0000","last_active":"2024-05-09T09:55:57.512113+0000","last_peered":"2024-05-09T09:55:57.512113+0000","last_clean":"2024-05-09T09:55:57.512113+0000","last_became_active":"2024-05-09T09:55:10.500197+0000","last_became_peered":"2024-05-09T09:55:10.500197+0000","last_unstale":"2024-05-09T09:55:57.512113+0000","last_undegraded":"2024-05-09T09:55:57.512113+0000","last_fullsized":"2024-05-09T09:55:57.512113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:17.400807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'22","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.161985+0000","last_change":"2024-05-09T09:53:07.105822+0000","last_active":"2024-05-09T09:56:08.161985+0000","last_peered":"2024-05-09T09:56:08.161985+0000","last_clean":"2024-05-09T09:56:08.161985+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:56:08.161985+0000","last_undegraded":"2024-05-09T09:56:08.161985+0000","last_fullsized":"2024-05-09T09:56:08.161985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:36.920555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.513015+0000","last_change":"2024-05-09T09:53:11.126251+0000","last_active":"2024-05-09T09:55:57.513015+0000","last_peered":"2024-05-09T09:55:57.513015+0000","last_clean":"2024-05-09T09:55:57.513015+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:55:57.513015+0000","last_undegraded":"2024-05-09T09:55:57.513015+0000","last_fullsized":"2024-05-09T09:55:57.513015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:51.011262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018568+0000","last_change":"2024-05-09T09:53:13.146096+0000","last_active":"2024-05-09T09:55:58.018568+0000","last_peered":"2024-05-09T09:55:58.018568+0000","last_clean":"2024-05-09T09:55:58.018568+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:55:58.018568+0000","last_undegraded":"2024-05-09T09:55:58.018568+0000","last_fullsized":"2024-05-09T09:55:58.018568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:24.568955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704334+0000","last_change":"2024-05-09T09:55:41.486659+0000","last_active":"2024-05-09T09:55:56.704334+0000","last_peered":"2024-05-09T09:55:56.704334+0000","last_clean":"2024-05-09T09:55:56.704334+0000","last_became_active":"2024-05-09T09:55:41.486383+0000","last_became_peered":"2024-05-09T09:55:41.486383+0000","last_unstale":"2024-05-09T09:55:56.704334+0000","last_undegraded":"2024-05-09T09:55:56.704334+0000","last_fullsized":"2024-05-09T09:55:56.704334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:13.922715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"75'2","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013230+0000","last_change":"2024-05-09T09:55:44.856823+0000","last_active":"2024-05-09T09:55:58.013230+0000","last_peered":"2024-05-09T09:55:58.013230+0000","last_clean":"2024-05-09T09:55:58.013230+0000","last_became_active":"2024-05-09T09:55:41.512553+0000","last_became_peered":"2024-05-09T09:55:41.512553+0000","last_unstale":"2024-05-09T09:55:58.013230+0000","last_undegraded":"2024-05-09T09:55:58.013230+0000","last_fullsized":"2024-05-09T09:55:58.013230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.944736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401767+0000","last_change":"2024-05-09T09:54:55.401865+0000","last_active":"2024-05-09T09:55:57.401767+0000","last_peered":"2024-05-09T09:55:57.401767+0000","last_clean":"2024-05-09T09:55:57.401767+0000","last_became_active":"2024-05-09T09:54:55.401038+0000","last_became_peered":"2024-05-09T09:54:55.401038+0000","last_unstale":"2024-05-09T09:55:57.401767+0000","last_undegraded":"2024-05-09T09:55:57.401767+0000","last_fullsized":"2024-05-09T09:55:57.401767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:28:01.972187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399656+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:55:57.399656+0000","last_peered":"2024-05-09T09:55:57.399656+0000","last_clean":"2024-05-09T09:55:57.399656+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:55:57.399656+0000","last_undegraded":"2024-05-09T09:55:57.399656+0000","last_fullsized":"2024-05-09T09:55:57.399656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:54.825246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'16","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.199043+0000","last_change":"2024-05-09T09:55:41.719143+0000","last_active":"2024-05-09T09:56:08.199043+0000","last_peered":"2024-05-09T09:56:08.199043+0000","last_clean":"2024-05-09T09:56:08.199043+0000","last_became_active":"2024-05-09T09:55:41.469663+0000","last_became_peered":"2024-05-09T09:55:41.469663+0000","last_unstale":"2024-05-09T09:56:08.199043+0000","last_undegraded":"2024-05-09T09:56:08.199043+0000","last_fullsized":"2024-05-09T09:56:08.199043+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:45.753913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705749+0000","last_change":"2024-05-09T09:53:11.118551+0000","last_active":"2024-05-09T09:55:56.705749+0000","last_peered":"2024-05-09T09:55:56.705749+0000","last_clean":"2024-05-09T09:55:56.705749+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:55:56.705749+0000","last_undegraded":"2024-05-09T09:55:56.705749+0000","last_fullsized":"2024-05-09T09:55:56.705749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:34.196646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015389+0000","last_change":"2024-05-09T09:55:42.823551+0000","last_active":"2024-05-09T09:55:58.015389+0000","last_peered":"2024-05-09T09:55:58.015389+0000","last_clean":"2024-05-09T09:55:58.015389+0000","last_became_active":"2024-05-09T09:55:41.504368+0000","last_became_peered":"2024-05-09T09:55:41.504368+0000","last_unstale":"2024-05-09T09:55:58.015389+0000","last_undegraded":"2024-05-09T09:55:58.015389+0000","last_fullsized":"2024-05-09T09:55:58.015389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:38.841317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299096+0000","last_change":"2024-05-09T09:53:15.173073+0000","last_active":"2024-05-09T09:55:57.299096+0000","last_peered":"2024-05-09T09:55:57.299096+0000","last_clean":"2024-05-09T09:55:57.299096+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:55:57.299096+0000","last_undegraded":"2024-05-09T09:55:57.299096+0000","last_fullsized":"2024-05-09T09:55:57.299096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:34:38.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400161+0000","last_change":"2024-05-09T09:55:10.495545+0000","last_active":"2024-05-09T09:55:57.400161+0000","last_peered":"2024-05-09T09:55:57.400161+0000","last_clean":"2024-05-09T09:55:57.400161+0000","last_became_active":"2024-05-09T09:55:10.494741+0000","last_became_peered":"2024-05-09T09:55:10.494741+0000","last_unstale":"2024-05-09T09:55:57.400161+0000","last_undegraded":"2024-05-09T09:55:57.400161+0000","last_fullsized":"2024-05-09T09:55:57.400161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:36.220917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703539+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:55:56.703539+0000","last_peered":"2024-05-09T09:55:56.703539+0000","last_clean":"2024-05-09T09:55:56.703539+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:55:56.703539+0000","last_undegraded":"2024-05-09T09:55:56.703539+0000","last_fullsized":"2024-05-09T09:55:56.703539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:27.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'20","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.205609+0000","last_change":"2024-05-09T09:55:10.791937+0000","last_active":"2024-05-09T09:56:08.205609+0000","last_peered":"2024-05-09T09:56:08.205609+0000","last_clean":"2024-05-09T09:56:08.205609+0000","last_became_active":"2024-05-09T09:55:10.494626+0000","last_became_peered":"2024-05-09T09:55:10.494626+0000","last_unstale":"2024-05-09T09:56:08.205609+0000","last_undegraded":"2024-05-09T09:56:08.205609+0000","last_fullsized":"2024-05-09T09:56:08.205609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:06:49.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30738,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702746+0000","last_change":"2024-05-09T09:53:01.054567+0000","last_active":"2024-05-09T09:55:56.702746+0000","last_peered":"2024-05-09T09:55:56.702746+0000","last_clean":"2024-05-09T09:55:56.702746+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:55:56.702746+0000","last_undegraded":"2024-05-09T09:55:56.702746+0000","last_fullsized":"2024-05-09T09:55:56.702746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:04.354731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704736+0000","last_change":"2024-05-09T09:53:11.122470+0000","last_active":"2024-05-09T09:55:56.704736+0000","last_peered":"2024-05-09T09:55:56.704736+0000","last_clean":"2024-05-09T09:55:56.704736+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:55:56.704736+0000","last_undegraded":"2024-05-09T09:55:56.704736+0000","last_fullsized":"2024-05-09T09:55:56.704736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:06.214847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'40","reported_seq":259,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.798051+0000","last_change":"2024-05-09T09:55:10.807327+0000","last_active":"2024-05-09T09:56:07.798051+0000","last_peered":"2024-05-09T09:56:07.798051+0000","last_clean":"2024-05-09T09:56:07.798051+0000","last_became_active":"2024-05-09T09:55:10.495540+0000","last_became_peered":"2024-05-09T09:55:10.495540+0000","last_unstale":"2024-05-09T09:56:07.798051+0000","last_undegraded":"2024-05-09T09:56:07.798051+0000","last_fullsized":"2024-05-09T09:56:07.798051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:01.735473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":75,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":3221,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704004+0000","last_change":"2024-05-09T09:55:41.499842+0000","last_active":"2024-05-09T09:55:56.704004+0000","last_peered":"2024-05-09T09:55:56.704004+0000","last_clean":"2024-05-09T09:55:56.704004+0000","last_became_active":"2024-05-09T09:55:41.496466+0000","last_became_peered":"2024-05-09T09:55:41.496466+0000","last_unstale":"2024-05-09T09:55:56.704004+0000","last_undegraded":"2024-05-09T09:55:56.704004+0000","last_fullsized":"2024-05-09T09:55:56.704004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:35.612226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706873+0000","last_change":"2024-05-09T09:53:17.265739+0000","last_active":"2024-05-09T09:55:56.706873+0000","last_peered":"2024-05-09T09:55:56.706873+0000","last_clean":"2024-05-09T09:55:56.706873+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:55:56.706873+0000","last_undegraded":"2024-05-09T09:55:56.706873+0000","last_fullsized":"2024-05-09T09:55:56.706873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.423201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705288+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:55:56.705288+0000","last_peered":"2024-05-09T09:55:56.705288+0000","last_clean":"2024-05-09T09:55:56.705288+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:55:56.705288+0000","last_undegraded":"2024-05-09T09:55:56.705288+0000","last_fullsized":"2024-05-09T09:55:56.705288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'12","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.840877+0000","last_change":"2024-05-09T09:53:07.108847+0000","last_active":"2024-05-09T09:56:07.840877+0000","last_peered":"2024-05-09T09:56:07.840877+0000","last_clean":"2024-05-09T09:56:07.840877+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:56:07.840877+0000","last_undegraded":"2024-05-09T09:56:07.840877+0000","last_fullsized":"2024-05-09T09:56:07.840877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22546,"num_write":42,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015491+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:55:58.015491+0000","last_peered":"2024-05-09T09:55:58.015491+0000","last_clean":"2024-05-09T09:55:58.015491+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:55:58.015491+0000","last_undegraded":"2024-05-09T09:55:58.015491+0000","last_fullsized":"2024-05-09T09:55:58.015491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:05.672086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298282+0000","last_change":"2024-05-09T09:53:11.121660+0000","last_active":"2024-05-09T09:55:57.298282+0000","last_peered":"2024-05-09T09:55:57.298282+0000","last_clean":"2024-05-09T09:55:57.298282+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:55:57.298282+0000","last_undegraded":"2024-05-09T09:55:57.298282+0000","last_fullsized":"2024-05-09T09:55:57.298282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:45.092227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702821+0000","last_change":"2024-05-09T09:53:13.145073+0000","last_active":"2024-05-09T09:55:56.702821+0000","last_peered":"2024-05-09T09:55:56.702821+0000","last_clean":"2024-05-09T09:55:56.702821+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:55:56.702821+0000","last_undegraded":"2024-05-09T09:55:56.702821+0000","last_fullsized":"2024-05-09T09:55:56.702821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:40.313060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'18","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.346305+0000","last_change":"2024-05-09T09:53:15.172890+0000","last_active":"2024-05-09T09:56:07.346305+0000","last_peered":"2024-05-09T09:56:07.346305+0000","last_clean":"2024-05-09T09:56:07.346305+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:56:07.346305+0000","last_undegraded":"2024-05-09T09:56:07.346305+0000","last_fullsized":"2024-05-09T09:56:07.346305+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:02.060926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018320+0000","last_change":"2024-05-09T09:55:10.517397+0000","last_active":"2024-05-09T09:55:58.018320+0000","last_peered":"2024-05-09T09:55:58.018320+0000","last_clean":"2024-05-09T09:55:58.018320+0000","last_became_active":"2024-05-09T09:55:10.515588+0000","last_became_peered":"2024-05-09T09:55:10.515588+0000","last_unstale":"2024-05-09T09:55:58.018320+0000","last_undegraded":"2024-05-09T09:55:58.018320+0000","last_fullsized":"2024-05-09T09:55:58.018320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:07.130003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"75'44","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015984+0000","last_change":"2024-05-09T09:55:11.515278+0000","last_active":"2024-05-09T09:55:58.015984+0000","last_peered":"2024-05-09T09:55:58.015984+0000","last_clean":"2024-05-09T09:55:58.015984+0000","last_became_active":"2024-05-09T09:55:10.518766+0000","last_became_peered":"2024-05-09T09:55:10.518766+0000","last_unstale":"2024-05-09T09:55:58.015984+0000","last_undegraded":"2024-05-09T09:55:58.015984+0000","last_fullsized":"2024-05-09T09:55:58.015984+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:19.443320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":112,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"95'20","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.015999+0000","last_change":"2024-05-09T09:55:11.060481+0000","last_active":"2024-05-09T09:56:08.015999+0000","last_peered":"2024-05-09T09:56:08.015999+0000","last_clean":"2024-05-09T09:56:08.015999+0000","last_became_active":"2024-05-09T09:55:10.509265+0000","last_became_peered":"2024-05-09T09:55:10.509265+0000","last_unstale":"2024-05-09T09:56:08.015999+0000","last_undegraded":"2024-05-09T09:56:08.015999+0000","last_fullsized":"2024-05-09T09:56:08.015999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:58:29.838618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16398,"num_write":50,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704209+0000","last_change":"2024-05-09T09:53:01.052309+0000","last_active":"2024-05-09T09:55:56.704209+0000","last_peered":"2024-05-09T09:55:56.704209+0000","last_clean":"2024-05-09T09:55:56.704209+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:55:56.704209+0000","last_undegraded":"2024-05-09T09:55:56.704209+0000","last_fullsized":"2024-05-09T09:55:56.704209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:21.599238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704461+0000","last_change":"2024-05-09T09:55:41.502710+0000","last_active":"2024-05-09T09:55:56.704461+0000","last_peered":"2024-05-09T09:55:56.704461+0000","last_clean":"2024-05-09T09:55:56.704461+0000","last_became_active":"2024-05-09T09:55:41.498766+0000","last_became_peered":"2024-05-09T09:55:41.498766+0000","last_unstale":"2024-05-09T09:55:56.704461+0000","last_undegraded":"2024-05-09T09:55:56.704461+0000","last_fullsized":"2024-05-09T09:55:56.704461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:11.800372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705353+0000","last_change":"2024-05-09T09:55:42.422831+0000","last_active":"2024-05-09T09:55:56.705353+0000","last_peered":"2024-05-09T09:55:56.705353+0000","last_clean":"2024-05-09T09:55:56.705353+0000","last_became_active":"2024-05-09T09:55:41.513003+0000","last_became_peered":"2024-05-09T09:55:41.513003+0000","last_unstale":"2024-05-09T09:55:56.705353+0000","last_undegraded":"2024-05-09T09:55:56.705353+0000","last_fullsized":"2024-05-09T09:55:56.705353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:07.499148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'21","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.353798+0000","last_change":"2024-05-09T09:55:10.808760+0000","last_active":"2024-05-09T09:56:07.353798+0000","last_peered":"2024-05-09T09:56:07.353798+0000","last_clean":"2024-05-09T09:56:07.353798+0000","last_became_active":"2024-05-09T09:55:10.505477+0000","last_became_peered":"2024-05-09T09:55:10.505477+0000","last_unstale":"2024-05-09T09:56:07.353798+0000","last_undegraded":"2024-05-09T09:56:07.353798+0000","last_fullsized":"2024-05-09T09:56:07.353798+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:23:21.462968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704510+0000","last_change":"2024-05-09T09:55:10.495913+0000","last_active":"2024-05-09T09:55:56.704510+0000","last_peered":"2024-05-09T09:55:56.704510+0000","last_clean":"2024-05-09T09:55:56.704510+0000","last_became_active":"2024-05-09T09:55:10.494445+0000","last_became_peered":"2024-05-09T09:55:10.494445+0000","last_unstale":"2024-05-09T09:55:56.704510+0000","last_undegraded":"2024-05-09T09:55:56.704510+0000","last_fullsized":"2024-05-09T09:55:56.704510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:58.669871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'10","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704782+0000","last_change":"2024-05-09T09:55:42.207577+0000","last_active":"2024-05-09T09:55:56.704782+0000","last_peered":"2024-05-09T09:55:56.704782+0000","last_clean":"2024-05-09T09:55:56.704782+0000","last_became_active":"2024-05-09T09:55:41.480316+0000","last_became_peered":"2024-05-09T09:55:41.480316+0000","last_unstale":"2024-05-09T09:55:56.704782+0000","last_undegraded":"2024-05-09T09:55:56.704782+0000","last_fullsized":"2024-05-09T09:55:56.704782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'22","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.172454+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:56:08.172454+0000","last_peered":"2024-05-09T09:56:08.172454+0000","last_clean":"2024-05-09T09:56:08.172454+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:56:08.172454+0000","last_undegraded":"2024-05-09T09:56:08.172454+0000","last_fullsized":"2024-05-09T09:56:08.172454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:55.689531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299647+0000","last_change":"2024-05-09T09:53:01.052498+0000","last_active":"2024-05-09T09:55:57.299647+0000","last_peered":"2024-05-09T09:55:57.299647+0000","last_clean":"2024-05-09T09:55:57.299647+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:55:57.299647+0000","last_undegraded":"2024-05-09T09:55:57.299647+0000","last_fullsized":"2024-05-09T09:55:57.299647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:29.673553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015902+0000","last_change":"2024-05-09T09:55:10.517926+0000","last_active":"2024-05-09T09:55:58.015902+0000","last_peered":"2024-05-09T09:55:58.015902+0000","last_clean":"2024-05-09T09:55:58.015902+0000","last_became_active":"2024-05-09T09:55:10.505544+0000","last_became_peered":"2024-05-09T09:55:10.505544+0000","last_unstale":"2024-05-09T09:55:58.015902+0000","last_undegraded":"2024-05-09T09:55:58.015902+0000","last_fullsized":"2024-05-09T09:55:58.015902+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:13.161392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'50","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.886225+0000","last_change":"2024-05-09T09:53:13.146271+0000","last_active":"2024-05-09T09:56:07.886225+0000","last_peered":"2024-05-09T09:56:07.886225+0000","last_clean":"2024-05-09T09:56:07.886225+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:56:07.886225+0000","last_undegraded":"2024-05-09T09:56:07.886225+0000","last_fullsized":"2024-05-09T09:56:07.886225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:14.587986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":80,"num_read_kb":110,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013580+0000","last_change":"2024-05-09T09:55:10.498516+0000","last_active":"2024-05-09T09:55:58.013580+0000","last_peered":"2024-05-09T09:55:58.013580+0000","last_clean":"2024-05-09T09:55:58.013580+0000","last_became_active":"2024-05-09T09:55:10.498080+0000","last_became_peered":"2024-05-09T09:55:10.498080+0000","last_unstale":"2024-05-09T09:55:58.013580+0000","last_undegraded":"2024-05-09T09:55:58.013580+0000","last_fullsized":"2024-05-09T09:55:58.013580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:21.659232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'2","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401538+0000","last_change":"2024-05-09T09:53:17.190251+0000","last_active":"2024-05-09T09:55:57.401538+0000","last_peered":"2024-05-09T09:55:57.401538+0000","last_clean":"2024-05-09T09:55:57.401538+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:55:57.401538+0000","last_undegraded":"2024-05-09T09:55:57.401538+0000","last_fullsized":"2024-05-09T09:55:57.401538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:43:58.719262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706114+0000","last_change":"2024-05-09T09:53:17.184530+0000","last_active":"2024-05-09T09:55:56.706114+0000","last_peered":"2024-05-09T09:55:56.706114+0000","last_clean":"2024-05-09T09:55:56.706114+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:55:56.706114+0000","last_undegraded":"2024-05-09T09:55:56.706114+0000","last_fullsized":"2024-05-09T09:55:56.706114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:48.572600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704880+0000","last_change":"2024-05-09T09:55:42.429944+0000","last_active":"2024-05-09T09:55:56.704880+0000","last_peered":"2024-05-09T09:55:56.704880+0000","last_clean":"2024-05-09T09:55:56.704880+0000","last_became_active":"2024-05-09T09:55:41.516290+0000","last_became_peered":"2024-05-09T09:55:41.516290+0000","last_unstale":"2024-05-09T09:55:56.704880+0000","last_undegraded":"2024-05-09T09:55:56.704880+0000","last_fullsized":"2024-05-09T09:55:56.704880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:59.070546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'16","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.211544+0000","last_change":"2024-05-09T09:55:42.380229+0000","last_active":"2024-05-09T09:56:08.211544+0000","last_peered":"2024-05-09T09:56:08.211544+0000","last_clean":"2024-05-09T09:56:08.211544+0000","last_became_active":"2024-05-09T09:55:41.489973+0000","last_became_peered":"2024-05-09T09:55:41.489973+0000","last_unstale":"2024-05-09T09:56:08.211544+0000","last_undegraded":"2024-05-09T09:56:08.211544+0000","last_fullsized":"2024-05-09T09:56:08.211544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:55.709532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":30736,"num_write":46,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703216+0000","last_change":"2024-05-09T09:53:11.128222+0000","last_active":"2024-05-09T09:55:56.703216+0000","last_peered":"2024-05-09T09:55:56.703216+0000","last_clean":"2024-05-09T09:55:56.703216+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:55:56.703216+0000","last_undegraded":"2024-05-09T09:55:56.703216+0000","last_fullsized":"2024-05-09T09:55:56.703216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'23","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.001014+0000","last_change":"2024-05-09T09:55:10.932387+0000","last_active":"2024-05-09T09:56:08.001014+0000","last_peered":"2024-05-09T09:56:08.001014+0000","last_clean":"2024-05-09T09:56:08.001014+0000","last_became_active":"2024-05-09T09:55:10.507307+0000","last_became_peered":"2024-05-09T09:55:10.507307+0000","last_unstale":"2024-05-09T09:56:08.001014+0000","last_undegraded":"2024-05-09T09:56:08.001014+0000","last_fullsized":"2024-05-09T09:56:08.001014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:44.904375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":48,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016206+0000","last_change":"2024-05-09T09:55:10.519133+0000","last_active":"2024-05-09T09:55:58.016206+0000","last_peered":"2024-05-09T09:55:58.016206+0000","last_clean":"2024-05-09T09:55:58.016206+0000","last_became_active":"2024-05-09T09:55:10.518305+0000","last_became_peered":"2024-05-09T09:55:10.518305+0000","last_unstale":"2024-05-09T09:55:58.016206+0000","last_undegraded":"2024-05-09T09:55:58.016206+0000","last_fullsized":"2024-05-09T09:55:58.016206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:56.110070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018014+0000","last_change":"2024-05-09T09:55:10.505287+0000","last_active":"2024-05-09T09:55:58.018014+0000","last_peered":"2024-05-09T09:55:58.018014+0000","last_clean":"2024-05-09T09:55:58.018014+0000","last_became_active":"2024-05-09T09:55:10.504822+0000","last_became_peered":"2024-05-09T09:55:10.504822+0000","last_unstale":"2024-05-09T09:55:58.018014+0000","last_undegraded":"2024-05-09T09:55:58.018014+0000","last_fullsized":"2024-05-09T09:55:58.018014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:26.980095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016322+0000","last_change":"2024-05-09T09:54:55.399423+0000","last_active":"2024-05-09T09:55:58.016322+0000","last_peered":"2024-05-09T09:55:58.016322+0000","last_clean":"2024-05-09T09:55:58.016322+0000","last_became_active":"2024-05-09T09:54:55.398970+0000","last_became_peered":"2024-05-09T09:54:55.398970+0000","last_unstale":"2024-05-09T09:55:58.016322+0000","last_undegraded":"2024-05-09T09:55:58.016322+0000","last_fullsized":"2024-05-09T09:55:58.016322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:46.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"95'14","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.154431+0000","last_change":"2024-05-09T09:55:10.626412+0000","last_active":"2024-05-09T09:56:08.154431+0000","last_peered":"2024-05-09T09:56:08.154431+0000","last_clean":"2024-05-09T09:56:08.154431+0000","last_became_active":"2024-05-09T09:55:10.499847+0000","last_became_peered":"2024-05-09T09:55:10.499847+0000","last_unstale":"2024-05-09T09:56:08.154431+0000","last_undegraded":"2024-05-09T09:56:08.154431+0000","last_fullsized":"2024-05-09T09:56:08.154431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28690,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016797+0000","last_change":"2024-05-09T09:55:10.508325+0000","last_active":"2024-05-09T09:55:58.016797+0000","last_peered":"2024-05-09T09:55:58.016797+0000","last_clean":"2024-05-09T09:55:58.016797+0000","last_became_active":"2024-05-09T09:55:10.506831+0000","last_became_peered":"2024-05-09T09:55:10.506831+0000","last_unstale":"2024-05-09T09:55:58.016797+0000","last_undegraded":"2024-05-09T09:55:58.016797+0000","last_fullsized":"2024-05-09T09:55:58.016797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:03.449411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"38'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700895+0000","last_change":"2024-05-09T09:53:13.129927+0000","last_active":"2024-05-09T09:55:56.700895+0000","last_peered":"2024-05-09T09:55:56.700895+0000","last_clean":"2024-05-09T09:55:56.700895+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:55:56.700895+0000","last_undegraded":"2024-05-09T09:55:56.700895+0000","last_fullsized":"2024-05-09T09:55:56.700895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:08.996084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017129+0000","last_change":"2024-05-09T09:53:15.180618+0000","last_active":"2024-05-09T09:55:58.017129+0000","last_peered":"2024-05-09T09:55:58.017129+0000","last_clean":"2024-05-09T09:55:58.017129+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:55:58.017129+0000","last_undegraded":"2024-05-09T09:55:58.017129+0000","last_fullsized":"2024-05-09T09:55:58.017129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:43:56.582493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700775+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:55:56.700775+0000","last_peered":"2024-05-09T09:55:56.700775+0000","last_clean":"2024-05-09T09:55:56.700775+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:55:56.700775+0000","last_undegraded":"2024-05-09T09:55:56.700775+0000","last_fullsized":"2024-05-09T09:55:56.700775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:10:30.730579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013446+0000","last_change":"2024-05-09T09:55:10.514293+0000","last_active":"2024-05-09T09:55:58.013446+0000","last_peered":"2024-05-09T09:55:58.013446+0000","last_clean":"2024-05-09T09:55:58.013446+0000","last_became_active":"2024-05-09T09:55:10.513915+0000","last_became_peered":"2024-05-09T09:55:10.513915+0000","last_unstale":"2024-05-09T09:55:58.013446+0000","last_undegraded":"2024-05-09T09:55:58.013446+0000","last_fullsized":"2024-05-09T09:55:58.013446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:03.485055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'18","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.177874+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:56:08.177874+0000","last_peered":"2024-05-09T09:56:08.177874+0000","last_clean":"2024-05-09T09:56:08.177874+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:56:08.177874+0000","last_undegraded":"2024-05-09T09:56:08.177874+0000","last_fullsized":"2024-05-09T09:56:08.177874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:11:42.097122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.296170+0000","last_change":"2024-05-09T09:55:42.066725+0000","last_active":"2024-05-09T09:56:07.296170+0000","last_peered":"2024-05-09T09:56:07.296170+0000","last_clean":"2024-05-09T09:56:07.296170+0000","last_became_active":"2024-05-09T09:55:41.506927+0000","last_became_peered":"2024-05-09T09:55:41.506927+0000","last_unstale":"2024-05-09T09:56:07.296170+0000","last_undegraded":"2024-05-09T09:56:07.296170+0000","last_fullsized":"2024-05-09T09:56:07.296170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:52.617380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'25","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.766996+0000","last_change":"2024-05-09T09:55:11.122289+0000","last_active":"2024-05-09T09:56:07.766996+0000","last_peered":"2024-05-09T09:56:07.766996+0000","last_clean":"2024-05-09T09:56:07.766996+0000","last_became_active":"2024-05-09T09:55:10.507511+0000","last_became_peered":"2024-05-09T09:55:10.507511+0000","last_unstale":"2024-05-09T09:56:07.766996+0000","last_undegraded":"2024-05-09T09:56:07.766996+0000","last_fullsized":"2024-05-09T09:56:07.766996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:55:29.227840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":70,"num_write":28,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297997+0000","last_change":"2024-05-09T09:53:15.174866+0000","last_active":"2024-05-09T09:55:57.297997+0000","last_peered":"2024-05-09T09:55:57.297997+0000","last_clean":"2024-05-09T09:55:57.297997+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:55:57.297997+0000","last_undegraded":"2024-05-09T09:55:57.297997+0000","last_fullsized":"2024-05-09T09:55:57.297997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:39.394456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401098+0000","last_change":"2024-05-09T09:53:17.191286+0000","last_active":"2024-05-09T09:55:57.401098+0000","last_peered":"2024-05-09T09:55:57.401098+0000","last_clean":"2024-05-09T09:55:57.401098+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:55:57.401098+0000","last_undegraded":"2024-05-09T09:55:57.401098+0000","last_fullsized":"2024-05-09T09:55:57.401098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:58:04.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'38","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015759+0000","last_change":"2024-05-09T09:55:11.526822+0000","last_active":"2024-05-09T09:55:58.015759+0000","last_peered":"2024-05-09T09:55:58.015759+0000","last_clean":"2024-05-09T09:55:58.015759+0000","last_became_active":"2024-05-09T09:55:10.520941+0000","last_became_peered":"2024-05-09T09:55:10.520941+0000","last_unstale":"2024-05-09T09:55:58.015759+0000","last_undegraded":"2024-05-09T09:55:58.015759+0000","last_fullsized":"2024-05-09T09:55:58.015759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:25.981081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'16","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.109020+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:56:08.109020+0000","last_peered":"2024-05-09T09:56:08.109020+0000","last_clean":"2024-05-09T09:56:08.109020+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:56:08.109020+0000","last_undegraded":"2024-05-09T09:56:08.109020+0000","last_fullsized":"2024-05-09T09:56:08.109020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:44.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298179+0000","last_change":"2024-05-09T09:55:41.515909+0000","last_active":"2024-05-09T09:55:57.298179+0000","last_peered":"2024-05-09T09:55:57.298179+0000","last_clean":"2024-05-09T09:55:57.298179+0000","last_became_active":"2024-05-09T09:55:41.514849+0000","last_became_peered":"2024-05-09T09:55:41.514849+0000","last_unstale":"2024-05-09T09:55:57.298179+0000","last_undegraded":"2024-05-09T09:55:57.298179+0000","last_fullsized":"2024-05-09T09:55:57.298179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:02.137573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'19","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.671926+0000","last_change":"2024-05-09T09:53:13.137353+0000","last_active":"2024-05-09T09:56:07.671926+0000","last_peered":"2024-05-09T09:56:07.671926+0000","last_clean":"2024-05-09T09:56:07.671926+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:56:07.671926+0000","last_undegraded":"2024-05-09T09:56:07.671926+0000","last_fullsized":"2024-05-09T09:56:07.671926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:55.285583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703964+0000","last_change":"2024-05-09T09:53:15.167559+0000","last_active":"2024-05-09T09:55:56.703964+0000","last_peered":"2024-05-09T09:55:56.703964+0000","last_clean":"2024-05-09T09:55:56.703964+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:55:56.703964+0000","last_undegraded":"2024-05-09T09:55:56.703964+0000","last_fullsized":"2024-05-09T09:55:56.703964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:39.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299559+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:55:57.299559+0000","last_peered":"2024-05-09T09:55:57.299559+0000","last_clean":"2024-05-09T09:55:57.299559+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:55:57.299559+0000","last_undegraded":"2024-05-09T09:55:57.299559+0000","last_fullsized":"2024-05-09T09:55:57.299559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:58.194849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'20","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.199048+0000","last_change":"2024-05-09T09:55:55.809479+0000","last_active":"2024-05-09T09:56:08.199048+0000","last_peered":"2024-05-09T09:56:08.199048+0000","last_clean":"2024-05-09T09:56:08.199048+0000","last_became_active":"2024-05-09T09:55:55.677234+0000","last_became_peered":"2024-05-09T09:55:55.677234+0000","last_unstale":"2024-05-09T09:56:08.199048+0000","last_undegraded":"2024-05-09T09:56:08.199048+0000","last_fullsized":"2024-05-09T09:56:08.199048+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:44.116858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8196,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706475+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:55:56.706475+0000","last_peered":"2024-05-09T09:55:56.706475+0000","last_clean":"2024-05-09T09:55:56.706475+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:55:56.706475+0000","last_undegraded":"2024-05-09T09:55:56.706475+0000","last_fullsized":"2024-05-09T09:55:56.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:58.391175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'34","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.223256+0000","last_change":"2024-05-09T09:53:13.142250+0000","last_active":"2024-05-09T09:56:08.223256+0000","last_peered":"2024-05-09T09:56:08.223256+0000","last_clean":"2024-05-09T09:56:08.223256+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:56:08.223256+0000","last_undegraded":"2024-05-09T09:56:08.223256+0000","last_fullsized":"2024-05-09T09:56:08.223256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:19.555464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":104,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401447+0000","last_change":"2024-05-09T09:55:10.495749+0000","last_active":"2024-05-09T09:55:57.401447+0000","last_peered":"2024-05-09T09:55:57.401447+0000","last_clean":"2024-05-09T09:55:57.401447+0000","last_became_active":"2024-05-09T09:55:10.494186+0000","last_became_peered":"2024-05-09T09:55:10.494186+0000","last_unstale":"2024-05-09T09:55:57.401447+0000","last_undegraded":"2024-05-09T09:55:57.401447+0000","last_fullsized":"2024-05-09T09:55:57.401447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:53:44.097211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016703+0000","last_change":"2024-05-09T09:55:10.505728+0000","last_active":"2024-05-09T09:55:58.016703+0000","last_peered":"2024-05-09T09:55:58.016703+0000","last_clean":"2024-05-09T09:55:58.016703+0000","last_became_active":"2024-05-09T09:55:10.504907+0000","last_became_peered":"2024-05-09T09:55:10.504907+0000","last_unstale":"2024-05-09T09:55:58.016703+0000","last_undegraded":"2024-05-09T09:55:58.016703+0000","last_fullsized":"2024-05-09T09:55:58.016703+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:34.895344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706201+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:55:56.706201+0000","last_peered":"2024-05-09T09:55:56.706201+0000","last_clean":"2024-05-09T09:55:56.706201+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:55:56.706201+0000","last_undegraded":"2024-05-09T09:55:56.706201+0000","last_fullsized":"2024-05-09T09:55:56.706201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'6","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.595730+0000","last_change":"2024-05-09T09:55:10.559316+0000","last_active":"2024-05-09T09:56:07.595730+0000","last_peered":"2024-05-09T09:56:07.595730+0000","last_clean":"2024-05-09T09:56:07.595730+0000","last_became_active":"2024-05-09T09:55:10.497596+0000","last_became_peered":"2024-05-09T09:55:10.497596+0000","last_unstale":"2024-05-09T09:56:07.595730+0000","last_undegraded":"2024-05-09T09:56:07.595730+0000","last_fullsized":"2024-05-09T09:56:07.595730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:58.118759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299240+0000","last_change":"2024-05-09T09:55:41.513826+0000","last_active":"2024-05-09T09:55:57.299240+0000","last_peered":"2024-05-09T09:55:57.299240+0000","last_clean":"2024-05-09T09:55:57.299240+0000","last_became_active":"2024-05-09T09:55:41.513248+0000","last_became_peered":"2024-05-09T09:55:41.513248+0000","last_unstale":"2024-05-09T09:55:57.299240+0000","last_undegraded":"2024-05-09T09:55:57.299240+0000","last_fullsized":"2024-05-09T09:55:57.299240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:15.704381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'31","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.699980+0000","last_change":"2024-05-09T09:53:13.137291+0000","last_active":"2024-05-09T09:56:07.699980+0000","last_peered":"2024-05-09T09:56:07.699980+0000","last_clean":"2024-05-09T09:56:07.699980+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:56:07.699980+0000","last_undegraded":"2024-05-09T09:56:07.699980+0000","last_fullsized":"2024-05-09T09:56:07.699980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:38.265691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":51,"num_read_kb":77,"num_write":36,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703868+0000","last_change":"2024-05-09T09:53:15.179536+0000","last_active":"2024-05-09T09:55:56.703868+0000","last_peered":"2024-05-09T09:55:56.703868+0000","last_clean":"2024-05-09T09:55:56.703868+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:55:56.703868+0000","last_undegraded":"2024-05-09T09:55:56.703868+0000","last_fullsized":"2024-05-09T09:55:56.703868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:30.407099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"63'4","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297673+0000","last_change":"2024-05-09T09:53:17.179813+0000","last_active":"2024-05-09T09:55:57.297673+0000","last_peered":"2024-05-09T09:55:57.297673+0000","last_clean":"2024-05-09T09:55:57.297673+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:55:57.297673+0000","last_undegraded":"2024-05-09T09:55:57.297673+0000","last_fullsized":"2024-05-09T09:55:57.297673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:13.041449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017690+0000","last_change":"2024-05-09T09:55:10.500134+0000","last_active":"2024-05-09T09:55:58.017690+0000","last_peered":"2024-05-09T09:55:58.017690+0000","last_clean":"2024-05-09T09:55:58.017690+0000","last_became_active":"2024-05-09T09:55:10.499690+0000","last_became_peered":"2024-05-09T09:55:10.499690+0000","last_unstale":"2024-05-09T09:55:58.017690+0000","last_undegraded":"2024-05-09T09:55:58.017690+0000","last_fullsized":"2024-05-09T09:55:58.017690+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'24","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.175502+0000","last_change":"2024-05-09T09:55:42.033924+0000","last_active":"2024-05-09T09:56:08.175502+0000","last_peered":"2024-05-09T09:56:08.175502+0000","last_clean":"2024-05-09T09:56:08.175502+0000","last_became_active":"2024-05-09T09:55:41.481073+0000","last_became_peered":"2024-05-09T09:55:41.481073+0000","last_unstale":"2024-05-09T09:56:08.175502+0000","last_undegraded":"2024-05-09T09:56:08.175502+0000","last_fullsized":"2024-05-09T09:56:08.175502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:27:48.598565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":45062,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706054+0000","last_change":"2024-05-09T09:55:41.513074+0000","last_active":"2024-05-09T09:55:56.706054+0000","last_peered":"2024-05-09T09:55:56.706054+0000","last_clean":"2024-05-09T09:55:56.706054+0000","last_became_active":"2024-05-09T09:55:41.512431+0000","last_became_peered":"2024-05-09T09:55:41.512431+0000","last_unstale":"2024-05-09T09:55:56.706054+0000","last_undegraded":"2024-05-09T09:55:56.706054+0000","last_fullsized":"2024-05-09T09:55:56.706054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:14.565690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'24","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.117136+0000","last_change":"2024-05-09T09:55:11.526104+0000","last_active":"2024-05-09T09:56:08.117136+0000","last_peered":"2024-05-09T09:56:08.117136+0000","last_clean":"2024-05-09T09:56:08.117136+0000","last_became_active":"2024-05-09T09:55:10.517760+0000","last_became_peered":"2024-05-09T09:55:10.517760+0000","last_unstale":"2024-05-09T09:56:08.117136+0000","last_undegraded":"2024-05-09T09:56:08.117136+0000","last_fullsized":"2024-05-09T09:56:08.117136+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:24.084847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":63,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703148+0000","last_change":"2024-05-09T09:55:10.485758+0000","last_active":"2024-05-09T09:55:56.703148+0000","last_peered":"2024-05-09T09:55:56.703148+0000","last_clean":"2024-05-09T09:55:56.703148+0000","last_became_active":"2024-05-09T09:55:10.485167+0000","last_became_peered":"2024-05-09T09:55:10.485167+0000","last_unstale":"2024-05-09T09:55:56.703148+0000","last_undegraded":"2024-05-09T09:55:56.703148+0000","last_fullsized":"2024-05-09T09:55:56.703148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:07:16.070700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400396+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:55:57.400396+0000","last_peered":"2024-05-09T09:55:57.400396+0000","last_clean":"2024-05-09T09:55:57.400396+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:55:57.400396+0000","last_undegraded":"2024-05-09T09:55:57.400396+0000","last_fullsized":"2024-05-09T09:55:57.400396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:52.299994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511241+0000","last_change":"2024-05-09T09:53:09.102696+0000","last_active":"2024-05-09T09:55:57.511241+0000","last_peered":"2024-05-09T09:55:57.511241+0000","last_clean":"2024-05-09T09:55:57.511241+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:55:57.511241+0000","last_undegraded":"2024-05-09T09:55:57.511241+0000","last_fullsized":"2024-05-09T09:55:57.511241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:46.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'16","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.083667+0000","last_change":"2024-05-09T09:55:41.638527+0000","last_active":"2024-05-09T09:56:08.083667+0000","last_peered":"2024-05-09T09:56:08.083667+0000","last_clean":"2024-05-09T09:56:08.083667+0000","last_became_active":"2024-05-09T09:55:41.470350+0000","last_became_peered":"2024-05-09T09:55:41.470350+0000","last_unstale":"2024-05-09T09:56:08.083667+0000","last_undegraded":"2024-05-09T09:56:08.083667+0000","last_fullsized":"2024-05-09T09:56:08.083667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.602333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":26636,"num_write":36,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:55:41.504749+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:55:41.504290+0000","last_became_peered":"2024-05-09T09:55:41.504290+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706444+0000","last_change":"2024-05-09T09:55:42.568315+0000","last_active":"2024-05-09T09:55:56.706444+0000","last_peered":"2024-05-09T09:55:56.706444+0000","last_clean":"2024-05-09T09:55:56.706444+0000","last_became_active":"2024-05-09T09:55:41.517072+0000","last_became_peered":"2024-05-09T09:55:41.517072+0000","last_unstale":"2024-05-09T09:55:56.706444+0000","last_undegraded":"2024-05-09T09:55:56.706444+0000","last_fullsized":"2024-05-09T09:55:56.706444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:54.084368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'23","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.344209+0000","last_change":"2024-05-09T09:55:44.549663+0000","last_active":"2024-05-09T09:56:07.344209+0000","last_peered":"2024-05-09T09:56:07.344209+0000","last_clean":"2024-05-09T09:56:07.344209+0000","last_became_active":"2024-05-09T09:55:41.514399+0000","last_became_peered":"2024-05-09T09:55:41.514399+0000","last_unstale":"2024-05-09T09:56:07.344209+0000","last_undegraded":"2024-05-09T09:56:07.344209+0000","last_fullsized":"2024-05-09T09:56:07.344209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:46.578164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"63'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015795+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:55:58.015795+0000","last_peered":"2024-05-09T09:55:58.015795+0000","last_clean":"2024-05-09T09:55:58.015795+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:55:58.015795+0000","last_undegraded":"2024-05-09T09:55:58.015795+0000","last_fullsized":"2024-05-09T09:55:58.015795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:42.336164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704832+0000","last_change":"2024-05-09T09:55:41.514279+0000","last_active":"2024-05-09T09:55:56.704832+0000","last_peered":"2024-05-09T09:55:56.704832+0000","last_clean":"2024-05-09T09:55:56.704832+0000","last_became_active":"2024-05-09T09:55:41.513724+0000","last_became_peered":"2024-05-09T09:55:41.513724+0000","last_unstale":"2024-05-09T09:55:56.704832+0000","last_undegraded":"2024-05-09T09:55:56.704832+0000","last_fullsized":"2024-05-09T09:55:56.704832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:53.879426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'14","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.825859+0000","last_change":"2024-05-09T09:55:42.243360+0000","last_active":"2024-05-09T09:56:07.825859+0000","last_peered":"2024-05-09T09:56:07.825859+0000","last_clean":"2024-05-09T09:56:07.825859+0000","last_became_active":"2024-05-09T09:55:41.495012+0000","last_became_peered":"2024-05-09T09:55:41.495012+0000","last_unstale":"2024-05-09T09:56:07.825859+0000","last_undegraded":"2024-05-09T09:56:07.825859+0000","last_fullsized":"2024-05-09T09:56:07.825859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:55:30.669989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.014988+0000","last_change":"2024-05-09T09:55:41.508232+0000","last_active":"2024-05-09T09:55:58.014988+0000","last_peered":"2024-05-09T09:55:58.014988+0000","last_clean":"2024-05-09T09:55:58.014988+0000","last_became_active":"2024-05-09T09:55:41.506905+0000","last_became_peered":"2024-05-09T09:55:41.506905+0000","last_unstale":"2024-05-09T09:55:58.014988+0000","last_undegraded":"2024-05-09T09:55:58.014988+0000","last_fullsized":"2024-05-09T09:55:58.014988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:17.182540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'28","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.510253+0000","last_change":"2024-05-09T09:53:13.136584+0000","last_active":"2024-05-09T09:56:07.510253+0000","last_peered":"2024-05-09T09:56:07.510253+0000","last_clean":"2024-05-09T09:56:07.510253+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:56:07.510253+0000","last_undegraded":"2024-05-09T09:56:07.510253+0000","last_fullsized":"2024-05-09T09:56:07.510253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:24:38.553971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":68,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.701605+0000","last_change":"2024-05-09T09:53:15.174834+0000","last_active":"2024-05-09T09:55:56.701605+0000","last_peered":"2024-05-09T09:55:56.701605+0000","last_clean":"2024-05-09T09:55:56.701605+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:55:56.701605+0000","last_undegraded":"2024-05-09T09:55:56.701605+0000","last_fullsized":"2024-05-09T09:55:56.701605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:15.037256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015572+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:55:58.015572+0000","last_peered":"2024-05-09T09:55:58.015572+0000","last_clean":"2024-05-09T09:55:58.015572+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:55:58.015572+0000","last_undegraded":"2024-05-09T09:55:58.015572+0000","last_fullsized":"2024-05-09T09:55:58.015572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:26:16.872810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705208+0000","last_change":"2024-05-09T09:55:41.513633+0000","last_active":"2024-05-09T09:55:56.705208+0000","last_peered":"2024-05-09T09:55:56.705208+0000","last_clean":"2024-05-09T09:55:56.705208+0000","last_became_active":"2024-05-09T09:55:41.512176+0000","last_became_peered":"2024-05-09T09:55:41.512176+0000","last_unstale":"2024-05-09T09:55:56.705208+0000","last_undegraded":"2024-05-09T09:55:56.705208+0000","last_fullsized":"2024-05-09T09:55:56.705208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:08.283157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'16","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.194158+0000","last_change":"2024-05-09T09:55:42.801375+0000","last_active":"2024-05-09T09:56:08.194158+0000","last_peered":"2024-05-09T09:56:08.194158+0000","last_clean":"2024-05-09T09:56:08.194158+0000","last_became_active":"2024-05-09T09:55:41.495260+0000","last_became_peered":"2024-05-09T09:55:41.495260+0000","last_unstale":"2024-05-09T09:56:08.194158+0000","last_undegraded":"2024-05-09T09:56:08.194158+0000","last_fullsized":"2024-05-09T09:56:08.194158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:20.725921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401363+0000","last_change":"2024-05-09T09:53:11.126678+0000","last_active":"2024-05-09T09:55:57.401363+0000","last_peered":"2024-05-09T09:55:57.401363+0000","last_clean":"2024-05-09T09:55:57.401363+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:55:57.401363+0000","last_undegraded":"2024-05-09T09:55:57.401363+0000","last_fullsized":"2024-05-09T09:55:57.401363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:28.182409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'16","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.515814+0000","last_change":"2024-05-09T09:53:13.127447+0000","last_active":"2024-05-09T09:56:07.515814+0000","last_peered":"2024-05-09T09:56:07.515814+0000","last_clean":"2024-05-09T09:56:07.515814+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:56:07.515814+0000","last_undegraded":"2024-05-09T09:56:07.515814+0000","last_fullsized":"2024-05-09T09:56:07.515814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:27.931441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297877+0000","last_change":"2024-05-09T09:53:15.172416+0000","last_active":"2024-05-09T09:55:57.297877+0000","last_peered":"2024-05-09T09:55:57.297877+0000","last_clean":"2024-05-09T09:55:57.297877+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:55:57.297877+0000","last_undegraded":"2024-05-09T09:55:57.297877+0000","last_fullsized":"2024-05-09T09:55:57.297877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:06.191858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017891+0000","last_change":"2024-05-09T09:55:10.502456+0000","last_active":"2024-05-09T09:55:58.017891+0000","last_peered":"2024-05-09T09:55:58.017891+0000","last_clean":"2024-05-09T09:55:58.017891+0000","last_became_active":"2024-05-09T09:55:10.502015+0000","last_became_peered":"2024-05-09T09:55:10.502015+0000","last_unstale":"2024-05-09T09:55:58.017891+0000","last_undegraded":"2024-05-09T09:55:58.017891+0000","last_fullsized":"2024-05-09T09:55:58.017891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:01.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"75'46","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016669+0000","last_change":"2024-05-09T09:55:10.787056+0000","last_active":"2024-05-09T09:55:58.016669+0000","last_peered":"2024-05-09T09:55:58.016669+0000","last_clean":"2024-05-09T09:55:58.016669+0000","last_became_active":"2024-05-09T09:55:10.503704+0000","last_became_peered":"2024-05-09T09:55:10.503704+0000","last_unstale":"2024-05-09T09:55:58.016669+0000","last_undegraded":"2024-05-09T09:55:58.016669+0000","last_fullsized":"2024-05-09T09:55:58.016669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:07.882920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'6","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.555417+0000","last_change":"2024-05-09T09:55:11.105873+0000","last_active":"2024-05-09T09:56:07.555417+0000","last_peered":"2024-05-09T09:56:07.555417+0000","last_clean":"2024-05-09T09:56:07.555417+0000","last_became_active":"2024-05-09T09:55:10.511777+0000","last_became_peered":"2024-05-09T09:55:10.511777+0000","last_unstale":"2024-05-09T09:56:07.555417+0000","last_undegraded":"2024-05-09T09:56:07.555417+0000","last_fullsized":"2024-05-09T09:56:07.555417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:49.719909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8196,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704012+0000","last_change":"2024-05-09T09:55:41.504930+0000","last_active":"2024-05-09T09:55:56.704012+0000","last_peered":"2024-05-09T09:55:56.704012+0000","last_clean":"2024-05-09T09:55:56.704012+0000","last_became_active":"2024-05-09T09:55:41.503996+0000","last_became_peered":"2024-05-09T09:55:41.503996+0000","last_unstale":"2024-05-09T09:55:56.704012+0000","last_undegraded":"2024-05-09T09:55:56.704012+0000","last_fullsized":"2024-05-09T09:55:56.704012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:17.626403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'16","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.044326+0000","last_change":"2024-05-09T09:55:11.754129+0000","last_active":"2024-05-09T09:56:08.044326+0000","last_peered":"2024-05-09T09:56:08.044326+0000","last_clean":"2024-05-09T09:56:08.044326+0000","last_became_active":"2024-05-09T09:55:10.525384+0000","last_became_peered":"2024-05-09T09:55:10.525384+0000","last_unstale":"2024-05-09T09:56:08.044326+0000","last_undegraded":"2024-05-09T09:56:08.044326+0000","last_fullsized":"2024-05-09T09:56:08.044326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:56.439887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":35,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704813+0000","last_change":"2024-05-09T09:55:41.503227+0000","last_active":"2024-05-09T09:55:56.704813+0000","last_peered":"2024-05-09T09:55:56.704813+0000","last_clean":"2024-05-09T09:55:56.704813+0000","last_became_active":"2024-05-09T09:55:41.502389+0000","last_became_peered":"2024-05-09T09:55:41.502389+0000","last_unstale":"2024-05-09T09:55:56.704813+0000","last_undegraded":"2024-05-09T09:55:56.704813+0000","last_fullsized":"2024-05-09T09:55:56.704813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:58.478317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015740+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:55:58.015740+0000","last_peered":"2024-05-09T09:55:58.015740+0000","last_clean":"2024-05-09T09:55:58.015740+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:55:58.015740+0000","last_undegraded":"2024-05-09T09:55:58.015740+0000","last_fullsized":"2024-05-09T09:55:58.015740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:06.382037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703739+0000","last_change":"2024-05-09T09:55:41.504669+0000","last_active":"2024-05-09T09:55:56.703739+0000","last_peered":"2024-05-09T09:55:56.703739+0000","last_clean":"2024-05-09T09:55:56.703739+0000","last_became_active":"2024-05-09T09:55:41.503132+0000","last_became_peered":"2024-05-09T09:55:41.503132+0000","last_unstale":"2024-05-09T09:55:56.703739+0000","last_undegraded":"2024-05-09T09:55:56.703739+0000","last_fullsized":"2024-05-09T09:55:56.703739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:40.768463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'18","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.166670+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:56:08.166670+0000","last_peered":"2024-05-09T09:56:08.166670+0000","last_clean":"2024-05-09T09:56:08.166670+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:56:08.166670+0000","last_undegraded":"2024-05-09T09:56:08.166670+0000","last_fullsized":"2024-05-09T09:56:08.166670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:53.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":36882,"num_write":48,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702636+0000","last_change":"2024-05-09T09:53:11.128035+0000","last_active":"2024-05-09T09:55:56.702636+0000","last_peered":"2024-05-09T09:55:56.702636+0000","last_clean":"2024-05-09T09:55:56.702636+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:55:56.702636+0000","last_undegraded":"2024-05-09T09:55:56.702636+0000","last_fullsized":"2024-05-09T09:55:56.702636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:34:02.159029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'19","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.135088+0000","last_change":"2024-05-09T09:55:41.528075+0000","last_active":"2024-05-09T09:56:08.135088+0000","last_peered":"2024-05-09T09:56:08.135088+0000","last_clean":"2024-05-09T09:56:08.135088+0000","last_became_active":"2024-05-09T09:55:41.453982+0000","last_became_peered":"2024-05-09T09:55:41.453982+0000","last_unstale":"2024-05-09T09:56:08.135088+0000","last_undegraded":"2024-05-09T09:56:08.135088+0000","last_fullsized":"2024-05-09T09:56:08.135088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:57:30.849980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":34,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703788+0000","last_change":"2024-05-09T09:53:15.179341+0000","last_active":"2024-05-09T09:55:56.703788+0000","last_peered":"2024-05-09T09:55:56.703788+0000","last_clean":"2024-05-09T09:55:56.703788+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:55:56.703788+0000","last_undegraded":"2024-05-09T09:55:56.703788+0000","last_fullsized":"2024-05-09T09:55:56.703788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:47.475239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705754+0000","last_change":"2024-05-09T09:55:41.488023+0000","last_active":"2024-05-09T09:55:56.705754+0000","last_peered":"2024-05-09T09:55:56.705754+0000","last_clean":"2024-05-09T09:55:56.705754+0000","last_became_active":"2024-05-09T09:55:41.478429+0000","last_became_peered":"2024-05-09T09:55:41.478429+0000","last_unstale":"2024-05-09T09:55:56.705754+0000","last_undegraded":"2024-05-09T09:55:56.705754+0000","last_fullsized":"2024-05-09T09:55:56.705754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:21.756872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"75'30","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703865+0000","last_change":"2024-05-09T09:53:09.115964+0000","last_active":"2024-05-09T09:55:56.703865+0000","last_peered":"2024-05-09T09:55:56.703865+0000","last_clean":"2024-05-09T09:55:56.703865+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:55:56.703865+0000","last_undegraded":"2024-05-09T09:55:56.703865+0000","last_fullsized":"2024-05-09T09:55:56.703865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:53.329425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":76,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'14","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.220279+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:56:08.220279+0000","last_peered":"2024-05-09T09:56:08.220279+0000","last_clean":"2024-05-09T09:56:08.220279+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:56:08.220279+0000","last_undegraded":"2024-05-09T09:56:08.220279+0000","last_fullsized":"2024-05-09T09:56:08.220279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:02:21.227417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703573+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:55:56.703573+0000","last_peered":"2024-05-09T09:55:56.703573+0000","last_clean":"2024-05-09T09:55:56.703573+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:55:56.703573+0000","last_undegraded":"2024-05-09T09:55:56.703573+0000","last_fullsized":"2024-05-09T09:55:56.703573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:21.515644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'24","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.976626+0000","last_change":"2024-05-09T09:53:54.474568+0000","last_active":"2024-05-09T09:56:07.976626+0000","last_peered":"2024-05-09T09:56:07.976626+0000","last_clean":"2024-05-09T09:56:07.976626+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:56:07.976626+0000","last_undegraded":"2024-05-09T09:56:07.976626+0000","last_fullsized":"2024-05-09T09:56:07.976626+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:31.979515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":38936,"num_write":64,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401833+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:55:57.401833+0000","last_peered":"2024-05-09T09:55:57.401833+0000","last_clean":"2024-05-09T09:55:57.401833+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:55:57.401833+0000","last_undegraded":"2024-05-09T09:55:57.401833+0000","last_fullsized":"2024-05-09T09:55:57.401833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:59.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'18","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.096526+0000","last_change":"2024-05-09T09:55:11.421625+0000","last_active":"2024-05-09T09:56:08.096526+0000","last_peered":"2024-05-09T09:56:08.096526+0000","last_clean":"2024-05-09T09:56:08.096526+0000","last_became_active":"2024-05-09T09:55:10.518812+0000","last_became_peered":"2024-05-09T09:55:10.518812+0000","last_unstale":"2024-05-09T09:56:08.096526+0000","last_undegraded":"2024-05-09T09:56:08.096526+0000","last_fullsized":"2024-05-09T09:56:08.096526+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:01.935968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":30726,"num_write":28,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703042+0000","last_change":"2024-05-09T09:53:09.125642+0000","last_active":"2024-05-09T09:55:56.703042+0000","last_peered":"2024-05-09T09:55:56.703042+0000","last_clean":"2024-05-09T09:55:56.703042+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:55:56.703042+0000","last_undegraded":"2024-05-09T09:55:56.703042+0000","last_fullsized":"2024-05-09T09:55:56.703042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:57.190769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'14","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.173588+0000","last_change":"2024-05-09T09:55:11.272479+0000","last_active":"2024-05-09T09:56:08.173588+0000","last_peered":"2024-05-09T09:56:08.173588+0000","last_clean":"2024-05-09T09:56:08.173588+0000","last_became_active":"2024-05-09T09:55:10.507500+0000","last_became_peered":"2024-05-09T09:55:10.507500+0000","last_unstale":"2024-05-09T09:56:08.173588+0000","last_undegraded":"2024-05-09T09:56:08.173588+0000","last_fullsized":"2024-05-09T09:56:08.173588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:55:01.473207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24594,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013452+0000","last_change":"2024-05-09T09:55:10.524923+0000","last_active":"2024-05-09T09:55:58.013452+0000","last_peered":"2024-05-09T09:55:58.013452+0000","last_clean":"2024-05-09T09:55:58.013452+0000","last_became_active":"2024-05-09T09:55:10.523552+0000","last_became_peered":"2024-05-09T09:55:10.523552+0000","last_unstale":"2024-05-09T09:55:58.013452+0000","last_undegraded":"2024-05-09T09:55:58.013452+0000","last_fullsized":"2024-05-09T09:55:58.013452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:43.486340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'26","reported_seq":121,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.083329+0000","last_change":"2024-05-09T09:55:42.061427+0000","last_active":"2024-05-09T09:56:08.083329+0000","last_peered":"2024-05-09T09:56:08.083329+0000","last_clean":"2024-05-09T09:56:08.083329+0000","last_became_active":"2024-05-09T09:55:41.504165+0000","last_became_peered":"2024-05-09T09:55:41.504165+0000","last_unstale":"2024-05-09T09:56:08.083329+0000","last_undegraded":"2024-05-09T09:56:08.083329+0000","last_fullsized":"2024-05-09T09:56:08.083329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:23.087548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12298,"num_write":46,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":113246208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704514+0000","last_change":"2024-05-09T09:55:41.501384+0000","last_active":"2024-05-09T09:55:56.704514+0000","last_peered":"2024-05-09T09:55:56.704514+0000","last_clean":"2024-05-09T09:55:56.704514+0000","last_became_active":"2024-05-09T09:55:41.500371+0000","last_became_peered":"2024-05-09T09:55:41.500371+0000","last_unstale":"2024-05-09T09:55:56.704514+0000","last_undegraded":"2024-05-09T09:55:56.704514+0000","last_fullsized":"2024-05-09T09:55:56.704514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:50:40.538369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'30","reported_seq":263,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.236208+0000","last_change":"2024-05-09T09:55:10.940790+0000","last_active":"2024-05-09T09:56:08.236208+0000","last_peered":"2024-05-09T09:56:08.236208+0000","last_clean":"2024-05-09T09:56:08.236208+0000","last_became_active":"2024-05-09T09:55:10.497720+0000","last_became_peered":"2024-05-09T09:55:10.497720+0000","last_unstale":"2024-05-09T09:56:08.236208+0000","last_undegraded":"2024-05-09T09:56:08.236208+0000","last_fullsized":"2024-05-09T09:56:08.236208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:16.547485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":51230,"num_write":80,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013352+0000","last_change":"2024-05-09T09:55:10.522327+0000","last_active":"2024-05-09T09:55:58.013352+0000","last_peered":"2024-05-09T09:55:58.013352+0000","last_clean":"2024-05-09T09:55:58.013352+0000","last_became_active":"2024-05-09T09:55:10.520654+0000","last_became_peered":"2024-05-09T09:55:10.520654+0000","last_unstale":"2024-05-09T09:55:58.013352+0000","last_undegraded":"2024-05-09T09:55:58.013352+0000","last_fullsized":"2024-05-09T09:55:58.013352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:58.639493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.864311+0000","last_change":"2024-05-09T09:53:07.130679+0000","last_active":"2024-05-09T09:56:07.864311+0000","last_peered":"2024-05-09T09:56:07.864311+0000","last_clean":"2024-05-09T09:56:07.864311+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:56:07.864311+0000","last_undegraded":"2024-05-09T09:56:07.864311+0000","last_fullsized":"2024-05-09T09:56:07.864311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:22.522986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297786+0000","last_change":"2024-05-09T09:53:09.123008+0000","last_active":"2024-05-09T09:55:57.297786+0000","last_peered":"2024-05-09T09:55:57.297786+0000","last_clean":"2024-05-09T09:55:57.297786+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:55:57.297786+0000","last_undegraded":"2024-05-09T09:55:57.297786+0000","last_fullsized":"2024-05-09T09:55:57.297786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:37.348770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'12","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.189531+0000","last_change":"2024-05-09T09:55:43.542093+0000","last_active":"2024-05-09T09:56:08.189531+0000","last_peered":"2024-05-09T09:56:08.189531+0000","last_clean":"2024-05-09T09:56:08.189531+0000","last_became_active":"2024-05-09T09:55:41.504555+0000","last_became_peered":"2024-05-09T09:55:41.504555+0000","last_unstale":"2024-05-09T09:56:08.189531+0000","last_undegraded":"2024-05-09T09:56:08.189531+0000","last_fullsized":"2024-05-09T09:56:08.189531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:48:05.626495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6148,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"75'34","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706338+0000","last_change":"2024-05-09T09:55:11.694902+0000","last_active":"2024-05-09T09:55:56.706338+0000","last_peered":"2024-05-09T09:55:56.706338+0000","last_clean":"2024-05-09T09:55:56.706338+0000","last_became_active":"2024-05-09T09:55:10.515872+0000","last_became_peered":"2024-05-09T09:55:10.515872+0000","last_unstale":"2024-05-09T09:55:56.706338+0000","last_undegraded":"2024-05-09T09:55:56.706338+0000","last_fullsized":"2024-05-09T09:55:56.706338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'14","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.863865+0000","last_change":"2024-05-09T09:55:11.200964+0000","last_active":"2024-05-09T09:56:07.863865+0000","last_peered":"2024-05-09T09:56:07.863865+0000","last_clean":"2024-05-09T09:56:07.863865+0000","last_became_active":"2024-05-09T09:55:10.506370+0000","last_became_peered":"2024-05-09T09:55:10.506370+0000","last_unstale":"2024-05-09T09:56:07.863865+0000","last_undegraded":"2024-05-09T09:56:07.863865+0000","last_fullsized":"2024-05-09T09:56:07.863865+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:45.803361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16388,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706695+0000","last_change":"2024-05-09T09:55:41.494250+0000","last_active":"2024-05-09T09:55:56.706695+0000","last_peered":"2024-05-09T09:55:56.706695+0000","last_clean":"2024-05-09T09:55:56.706695+0000","last_became_active":"2024-05-09T09:55:41.492423+0000","last_became_peered":"2024-05-09T09:55:41.492423+0000","last_unstale":"2024-05-09T09:55:56.706695+0000","last_undegraded":"2024-05-09T09:55:56.706695+0000","last_fullsized":"2024-05-09T09:55:56.706695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'16","reported_seq":95,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.838550+0000","last_change":"2024-05-09T09:55:44.733118+0000","last_active":"2024-05-09T09:56:07.838550+0000","last_peered":"2024-05-09T09:56:07.838550+0000","last_clean":"2024-05-09T09:56:07.838550+0000","last_became_active":"2024-05-09T09:55:41.505078+0000","last_became_peered":"2024-05-09T09:55:41.505078+0000","last_unstale":"2024-05-09T09:56:07.838550+0000","last_undegraded":"2024-05-09T09:56:07.838550+0000","last_fullsized":"2024-05-09T09:56:07.838550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:36.404862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":18438,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.512634+0000","last_change":"2024-05-09T09:53:09.119581+0000","last_active":"2024-05-09T09:55:57.512634+0000","last_peered":"2024-05-09T09:55:57.512634+0000","last_clean":"2024-05-09T09:55:57.512634+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:55:57.512634+0000","last_undegraded":"2024-05-09T09:55:57.512634+0000","last_fullsized":"2024-05-09T09:55:57.512634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:27:40.170270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'34","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.205035+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:56:08.205035+0000","last_peered":"2024-05-09T09:56:08.205035+0000","last_clean":"2024-05-09T09:56:08.205035+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:56:08.205035+0000","last_undegraded":"2024-05-09T09:56:08.205035+0000","last_fullsized":"2024-05-09T09:56:08.205035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:04:08.569465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":63494,"num_write":44,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'34","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705523+0000","last_change":"2024-05-09T09:55:42.435861+0000","last_active":"2024-05-09T09:55:56.705523+0000","last_peered":"2024-05-09T09:55:56.705523+0000","last_clean":"2024-05-09T09:55:56.705523+0000","last_became_active":"2024-05-09T09:55:41.516340+0000","last_became_peered":"2024-05-09T09:55:41.516340+0000","last_unstale":"2024-05-09T09:55:56.705523+0000","last_undegraded":"2024-05-09T09:55:56.705523+0000","last_fullsized":"2024-05-09T09:55:56.705523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'20","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.199061+0000","last_change":"2024-05-09T09:53:54.475107+0000","last_active":"2024-05-09T09:56:08.199061+0000","last_peered":"2024-05-09T09:56:08.199061+0000","last_clean":"2024-05-09T09:56:08.199061+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:56:08.199061+0000","last_undegraded":"2024-05-09T09:56:08.199061+0000","last_fullsized":"2024-05-09T09:56:08.199061+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:07.978606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":40972,"num_write":40,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'10","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017071+0000","last_change":"2024-05-09T09:55:55.725591+0000","last_active":"2024-05-09T09:55:58.017071+0000","last_peered":"2024-05-09T09:55:58.017071+0000","last_clean":"2024-05-09T09:55:58.017071+0000","last_became_active":"2024-05-09T09:55:55.721121+0000","last_became_peered":"2024-05-09T09:55:55.721121+0000","last_unstale":"2024-05-09T09:55:58.017071+0000","last_undegraded":"2024-05-09T09:55:58.017071+0000","last_fullsized":"2024-05-09T09:55:58.017071+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:16:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'24","reported_seq":236,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.215262+0000","last_change":"2024-05-09T09:55:43.389559+0000","last_active":"2024-05-09T09:56:08.215262+0000","last_peered":"2024-05-09T09:56:08.215262+0000","last_clean":"2024-05-09T09:56:08.215262+0000","last_became_active":"2024-05-09T09:55:41.513564+0000","last_became_peered":"2024-05-09T09:55:41.513564+0000","last_unstale":"2024-05-09T09:56:08.215262+0000","last_undegraded":"2024-05-09T09:56:08.215262+0000","last_fullsized":"2024-05-09T09:56:08.215262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:27.560582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45068,"num_write":44,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"63'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702094+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:55:56.702094+0000","last_peered":"2024-05-09T09:55:56.702094+0000","last_clean":"2024-05-09T09:55:56.702094+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:55:56.702094+0000","last_undegraded":"2024-05-09T09:55:56.702094+0000","last_fullsized":"2024-05-09T09:55:56.702094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:49.004296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'14","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.668071+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:56:07.668071+0000","last_peered":"2024-05-09T09:56:07.668071+0000","last_clean":"2024-05-09T09:56:07.668071+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:56:07.668071+0000","last_undegraded":"2024-05-09T09:56:07.668071+0000","last_fullsized":"2024-05-09T09:56:07.668071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:52.723859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"63'6","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016486+0000","last_change":"2024-05-09T09:55:10.683098+0000","last_active":"2024-05-09T09:55:58.016486+0000","last_peered":"2024-05-09T09:55:58.016486+0000","last_clean":"2024-05-09T09:55:58.016486+0000","last_became_active":"2024-05-09T09:55:10.495708+0000","last_became_peered":"2024-05-09T09:55:10.495708+0000","last_unstale":"2024-05-09T09:55:58.016486+0000","last_undegraded":"2024-05-09T09:55:58.016486+0000","last_fullsized":"2024-05-09T09:55:58.016486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:35.537784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'28","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.883673+0000","last_change":"2024-05-09T09:53:07.131548+0000","last_active":"2024-05-09T09:56:07.883673+0000","last_peered":"2024-05-09T09:56:07.883673+0000","last_clean":"2024-05-09T09:56:07.883673+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:56:07.883673+0000","last_undegraded":"2024-05-09T09:56:07.883673+0000","last_fullsized":"2024-05-09T09:56:07.883673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.846376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":53278,"num_write":78,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'6","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016640+0000","last_change":"2024-05-09T09:55:10.943382+0000","last_active":"2024-05-09T09:55:58.016640+0000","last_peered":"2024-05-09T09:55:58.016640+0000","last_clean":"2024-05-09T09:55:58.016640+0000","last_became_active":"2024-05-09T09:55:10.500255+0000","last_became_peered":"2024-05-09T09:55:10.500255+0000","last_unstale":"2024-05-09T09:55:58.016640+0000","last_undegraded":"2024-05-09T09:55:58.016640+0000","last_fullsized":"2024-05-09T09:55:58.016640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:43:18.559334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.166805+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:56:08.166805+0000","last_peered":"2024-05-09T09:56:08.166805+0000","last_clean":"2024-05-09T09:56:08.166805+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:56:08.166805+0000","last_undegraded":"2024-05-09T09:56:08.166805+0000","last_fullsized":"2024-05-09T09:56:08.166805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:46.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.997040+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:56:07.997040+0000","last_peered":"2024-05-09T09:56:07.997040+0000","last_clean":"2024-05-09T09:56:07.997040+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:56:07.997040+0000","last_undegraded":"2024-05-09T09:56:07.997040+0000","last_fullsized":"2024-05-09T09:56:07.997040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:08.238363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16384,"num_write":12,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706291+0000","last_change":"2024-05-09T09:55:10.507173+0000","last_active":"2024-05-09T09:55:56.706291+0000","last_peered":"2024-05-09T09:55:56.706291+0000","last_clean":"2024-05-09T09:55:56.706291+0000","last_became_active":"2024-05-09T09:55:10.506690+0000","last_became_peered":"2024-05-09T09:55:10.506690+0000","last_unstale":"2024-05-09T09:55:56.706291+0000","last_undegraded":"2024-05-09T09:55:56.706291+0000","last_fullsized":"2024-05-09T09:55:56.706291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:59:09.523724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'14","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.973166+0000","last_change":"2024-05-09T09:55:41.773438+0000","last_active":"2024-05-09T09:56:07.973166+0000","last_peered":"2024-05-09T09:56:07.973166+0000","last_clean":"2024-05-09T09:56:07.973166+0000","last_became_active":"2024-05-09T09:55:41.504558+0000","last_became_peered":"2024-05-09T09:55:41.504558+0000","last_unstale":"2024-05-09T09:56:07.973166+0000","last_undegraded":"2024-05-09T09:56:07.973166+0000","last_fullsized":"2024-05-09T09:56:07.973166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:10.654670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26642,"num_write":44,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399757+0000","last_change":"2024-05-09T09:53:09.129113+0000","last_active":"2024-05-09T09:55:57.399757+0000","last_peered":"2024-05-09T09:55:57.399757+0000","last_clean":"2024-05-09T09:55:57.399757+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:55:57.399757+0000","last_undegraded":"2024-05-09T09:55:57.399757+0000","last_fullsized":"2024-05-09T09:55:57.399757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:17.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":634,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":123282,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1201,"num_read_kb":1574,"num_write":775,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":46305,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":769,"ondisk_log_size":769,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1642,"num_read_kb":1223,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1462,"num_read_kb":1804930,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":1302331392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32960,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1773568,"data_stored":1259473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1150976,"data_stored":667452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1200128,"data_stored":668716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1146880,"data_stored":668379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36532,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335308,"statfs":{"total":96636764160,"available":96599355392,"internally_reserved":0,"allocated":1167360,"data_stored":667848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36460,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335380,"statfs":{"total":96636764160,"available":96599429120,"internally_reserved":0,"allocated":1138688,"data_stored":667014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36540,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335300,"statfs":{"total":96636764160,"available":96599347200,"internally_reserved":0,"allocated":1167360,"data_stored":667702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37080,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334760,"statfs":{"total":96636764160,"available":96598794240,"internally_reserved":0,"allocated":1748992,"data_stored":1257886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:56:15.016 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.017 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.018 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.019 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.020 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.021 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.022 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.023 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.024 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.025 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.026 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.027 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.028 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.029 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.030 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.031 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.032 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.033 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.034 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.035 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.036 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.037 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.038 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.039 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.040 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.041 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.042 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.043 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.044 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.045 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.045 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.045 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.045 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:15.045 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T09:56:35.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:56:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:35.399 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:56:35.413 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-05-09T09:56:33.362049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":715263,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4507,"num_read_kb":1807912,"num_write":3892,"num_write_kb":2051112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":598,"num_bytes_recovered":1302381373,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1146,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2762,"ondisk_log_size":2762,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":280456,"kb_used_data":10248,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754694264,"statfs":{"total":773094113280,"available":772806926336,"internally_reserved":0,"allocated":10493952,"data_stored":6524470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":276614707},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":852,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007463"},"pg_stats":[{"pgid":"3.3f","version":"95'24","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.175895+0000","last_change":"2024-05-09T09:53:07.138749+0000","last_active":"2024-05-09T09:56:08.175895+0000","last_peered":"2024-05-09T09:56:08.175895+0000","last_clean":"2024-05-09T09:56:08.175895+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:56:08.175895+0000","last_undegraded":"2024-05-09T09:56:08.175895+0000","last_fullsized":"2024-05-09T09:56:08.175895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":47116,"num_write":44,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400703+0000","last_change":"2024-05-09T09:55:41.485053+0000","last_active":"2024-05-09T09:55:57.400703+0000","last_peered":"2024-05-09T09:55:57.400703+0000","last_clean":"2024-05-09T09:55:57.400703+0000","last_became_active":"2024-05-09T09:55:41.484367+0000","last_became_peered":"2024-05-09T09:55:41.484367+0000","last_unstale":"2024-05-09T09:55:57.400703+0000","last_undegraded":"2024-05-09T09:55:57.400703+0000","last_fullsized":"2024-05-09T09:55:57.400703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'14","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.523828+0000","last_change":"2024-05-09T09:56:26.523888+0000","last_active":"2024-05-09T09:56:26.523828+0000","last_peered":"2024-05-09T09:56:26.523828+0000","last_clean":"2024-05-09T09:56:26.523828+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:56:26.523828+0000","last_undegraded":"2024-05-09T09:56:26.523828+0000","last_fullsized":"2024-05-09T09:56:26.523828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:26.523620+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:26.523620+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.523620+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:36:58.479614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'40","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015526+0000","last_change":"2024-05-09T09:53:09.135416+0000","last_active":"2024-05-09T09:55:58.015526+0000","last_peered":"2024-05-09T09:55:58.015526+0000","last_clean":"2024-05-09T09:55:58.015526+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:55:58.015526+0000","last_undegraded":"2024-05-09T09:55:58.015526+0000","last_fullsized":"2024-05-09T09:55:58.015526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'22","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.185636+0000","last_change":"2024-05-09T09:53:07.096061+0000","last_active":"2024-05-09T09:56:08.185636+0000","last_peered":"2024-05-09T09:56:08.185636+0000","last_clean":"2024-05-09T09:56:08.185636+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:56:08.185636+0000","last_undegraded":"2024-05-09T09:56:08.185636+0000","last_fullsized":"2024-05-09T09:56:08.185636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":38918,"num_write":32,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705126+0000","last_change":"2024-05-09T09:55:41.476462+0000","last_active":"2024-05-09T09:55:56.705126+0000","last_peered":"2024-05-09T09:55:56.705126+0000","last_clean":"2024-05-09T09:55:56.705126+0000","last_became_active":"2024-05-09T09:55:41.474847+0000","last_became_peered":"2024-05-09T09:55:41.474847+0000","last_unstale":"2024-05-09T09:55:56.705126+0000","last_undegraded":"2024-05-09T09:55:56.705126+0000","last_fullsized":"2024-05-09T09:55:56.705126+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'16","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.978993+0000","last_change":"2024-05-09T09:56:14.979053+0000","last_active":"2024-05-09T09:56:14.978993+0000","last_peered":"2024-05-09T09:56:14.978993+0000","last_clean":"2024-05-09T09:56:14.978993+0000","last_became_active":"2024-05-09T09:55:10.495355+0000","last_became_peered":"2024-05-09T09:55:10.495355+0000","last_unstale":"2024-05-09T09:56:14.978993+0000","last_undegraded":"2024-05-09T09:56:14.978993+0000","last_fullsized":"2024-05-09T09:56:14.978993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:14.978801+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:14.978801+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.978801+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:24.538534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24588,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704422+0000","last_change":"2024-05-09T09:55:10.508149+0000","last_active":"2024-05-09T09:55:56.704422+0000","last_peered":"2024-05-09T09:55:56.704422+0000","last_clean":"2024-05-09T09:55:56.704422+0000","last_became_active":"2024-05-09T09:55:10.506740+0000","last_became_peered":"2024-05-09T09:55:10.506740+0000","last_unstale":"2024-05-09T09:55:56.704422+0000","last_undegraded":"2024-05-09T09:55:56.704422+0000","last_fullsized":"2024-05-09T09:55:56.704422+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'20","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.793617+0000","last_change":"2024-05-09T09:56:22.793617+0000","last_active":"2024-05-09T09:56:22.793617+0000","last_peered":"2024-05-09T09:56:22.793617+0000","last_clean":"2024-05-09T09:56:22.793617+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:56:22.793617+0000","last_undegraded":"2024-05-09T09:56:22.793617+0000","last_fullsized":"2024-05-09T09:56:22.793617+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:22.793329+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:22.793329+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.793329+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:23.328347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.763987+0000","last_change":"2024-05-09T09:56:21.764045+0000","last_active":"2024-05-09T09:56:21.763987+0000","last_peered":"2024-05-09T09:56:21.763987+0000","last_clean":"2024-05-09T09:56:21.763987+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:56:21.763987+0000","last_undegraded":"2024-05-09T09:56:21.763987+0000","last_fullsized":"2024-05-09T09:56:21.763987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.763779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.763779+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.763779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:36:21.681605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'20","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.218231+0000","last_change":"2024-05-09T09:53:54.470432+0000","last_active":"2024-05-09T09:56:08.218231+0000","last_peered":"2024-05-09T09:56:08.218231+0000","last_clean":"2024-05-09T09:56:08.218231+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:56:08.218231+0000","last_undegraded":"2024-05-09T09:56:08.218231+0000","last_fullsized":"2024-05-09T09:56:08.218231+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":34840,"num_write":60,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'38","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706215+0000","last_change":"2024-05-09T09:55:41.723376+0000","last_active":"2024-05-09T09:55:56.706215+0000","last_peered":"2024-05-09T09:55:56.706215+0000","last_clean":"2024-05-09T09:55:56.706215+0000","last_became_active":"2024-05-09T09:55:41.470370+0000","last_became_peered":"2024-05-09T09:55:41.470370+0000","last_unstale":"2024-05-09T09:55:56.706215+0000","last_undegraded":"2024-05-09T09:55:56.706215+0000","last_fullsized":"2024-05-09T09:55:56.706215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'18","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.246861+0000","last_change":"2024-05-09T09:53:07.135511+0000","last_active":"2024-05-09T09:56:08.246861+0000","last_peered":"2024-05-09T09:56:08.246861+0000","last_clean":"2024-05-09T09:56:08.246861+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:56:08.246861+0000","last_undegraded":"2024-05-09T09:56:08.246861+0000","last_fullsized":"2024-05-09T09:56:08.246861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":34816,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.399913+0000","last_change":"2024-05-09T09:53:09.112427+0000","last_active":"2024-05-09T09:55:57.399913+0000","last_peered":"2024-05-09T09:55:57.399913+0000","last_clean":"2024-05-09T09:55:57.399913+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:55:57.399913+0000","last_undegraded":"2024-05-09T09:55:57.399913+0000","last_fullsized":"2024-05-09T09:55:57.399913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'20","reported_seq":83,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.304402+0000","last_change":"2024-05-09T09:56:15.304473+0000","last_active":"2024-05-09T09:56:15.304402+0000","last_peered":"2024-05-09T09:56:15.304402+0000","last_clean":"2024-05-09T09:56:15.304402+0000","last_became_active":"2024-05-09T09:55:10.517657+0000","last_became_peered":"2024-05-09T09:55:10.517657+0000","last_unstale":"2024-05-09T09:56:15.304402+0000","last_undegraded":"2024-05-09T09:56:15.304402+0000","last_fullsized":"2024-05-09T09:56:15.304402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:15.304198+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:15.304198+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.304198+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:08.516906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22558,"num_write":70,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.538654+0000","last_change":"2024-05-09T09:56:25.538714+0000","last_active":"2024-05-09T09:56:25.538654+0000","last_peered":"2024-05-09T09:56:25.538654+0000","last_clean":"2024-05-09T09:56:25.538654+0000","last_became_active":"2024-05-09T09:55:10.525051+0000","last_became_peered":"2024-05-09T09:55:10.525051+0000","last_unstale":"2024-05-09T09:56:25.538654+0000","last_undegraded":"2024-05-09T09:56:25.538654+0000","last_fullsized":"2024-05-09T09:56:25.538654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:25.538414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:25.538414+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.538414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:31:41.714094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704208+0000","last_change":"2024-05-09T09:55:41.727656+0000","last_active":"2024-05-09T09:55:56.704208+0000","last_peered":"2024-05-09T09:55:56.704208+0000","last_clean":"2024-05-09T09:55:56.704208+0000","last_became_active":"2024-05-09T09:55:41.468227+0000","last_became_peered":"2024-05-09T09:55:41.468227+0000","last_unstale":"2024-05-09T09:55:56.704208+0000","last_undegraded":"2024-05-09T09:55:56.704208+0000","last_fullsized":"2024-05-09T09:55:56.704208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'14","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.253020+0000","last_change":"2024-05-09T09:53:07.138738+0000","last_active":"2024-05-09T09:56:08.253020+0000","last_peered":"2024-05-09T09:56:08.253020+0000","last_clean":"2024-05-09T09:56:08.253020+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:56:08.253020+0000","last_undegraded":"2024-05-09T09:56:08.253020+0000","last_fullsized":"2024-05-09T09:56:08.253020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015168+0000","last_change":"2024-05-09T09:53:09.134385+0000","last_active":"2024-05-09T09:55:58.015168+0000","last_peered":"2024-05-09T09:55:58.015168+0000","last_clean":"2024-05-09T09:55:58.015168+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:55:58.015168+0000","last_undegraded":"2024-05-09T09:55:58.015168+0000","last_fullsized":"2024-05-09T09:55:58.015168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'12","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.889069+0000","last_change":"2024-05-09T09:56:27.889249+0000","last_active":"2024-05-09T09:56:27.889069+0000","last_peered":"2024-05-09T09:56:27.889069+0000","last_clean":"2024-05-09T09:56:27.889069+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:56:27.889069+0000","last_undegraded":"2024-05-09T09:56:27.889069+0000","last_fullsized":"2024-05-09T09:56:27.889069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:27.888750+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:27.888750+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.888750+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:43.250871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400884+0000","last_change":"2024-05-09T09:53:09.122491+0000","last_active":"2024-05-09T09:55:57.400884+0000","last_peered":"2024-05-09T09:55:57.400884+0000","last_clean":"2024-05-09T09:55:57.400884+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:55:57.400884+0000","last_undegraded":"2024-05-09T09:55:57.400884+0000","last_fullsized":"2024-05-09T09:55:57.400884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'18","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.827450+0000","last_change":"2024-05-09T09:56:25.827509+0000","last_active":"2024-05-09T09:56:25.827450+0000","last_peered":"2024-05-09T09:56:25.827450+0000","last_clean":"2024-05-09T09:56:25.827450+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:56:25.827450+0000","last_undegraded":"2024-05-09T09:56:25.827450+0000","last_fullsized":"2024-05-09T09:56:25.827450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:25.827261+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:25.827261+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.827261+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:01:49.598563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.554468+0000","last_change":"2024-05-09T09:56:24.554583+0000","last_active":"2024-05-09T09:56:24.554468+0000","last_peered":"2024-05-09T09:56:24.554468+0000","last_clean":"2024-05-09T09:56:24.554468+0000","last_became_active":"2024-05-09T09:55:10.501517+0000","last_became_peered":"2024-05-09T09:55:10.501517+0000","last_unstale":"2024-05-09T09:56:24.554468+0000","last_undegraded":"2024-05-09T09:56:24.554468+0000","last_fullsized":"2024-05-09T09:56:24.554468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.554248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.554248+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.554248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:09:19.236660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'8","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.997410+0000","last_change":"2024-05-09T09:55:42.549939+0000","last_active":"2024-05-09T09:56:07.997410+0000","last_peered":"2024-05-09T09:56:07.997410+0000","last_clean":"2024-05-09T09:56:07.997410+0000","last_became_active":"2024-05-09T09:55:41.517108+0000","last_became_peered":"2024-05-09T09:55:41.517108+0000","last_unstale":"2024-05-09T09:56:07.997410+0000","last_undegraded":"2024-05-09T09:56:07.997410+0000","last_fullsized":"2024-05-09T09:56:07.997410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.496932+0000","last_change":"2024-05-09T09:56:28.496986+0000","last_active":"2024-05-09T09:56:28.496932+0000","last_peered":"2024-05-09T09:56:28.496932+0000","last_clean":"2024-05-09T09:56:28.496932+0000","last_became_active":"2024-05-09T09:55:41.495217+0000","last_became_peered":"2024-05-09T09:55:41.495217+0000","last_unstale":"2024-05-09T09:56:28.496932+0000","last_undegraded":"2024-05-09T09:56:28.496932+0000","last_fullsized":"2024-05-09T09:56:28.496932+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.496701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.496701+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.496701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:33.511280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'24","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.389380+0000","last_change":"2024-05-09T09:56:21.389450+0000","last_active":"2024-05-09T09:56:21.389380+0000","last_peered":"2024-05-09T09:56:21.389380+0000","last_clean":"2024-05-09T09:56:21.389380+0000","last_became_active":"2024-05-09T09:55:10.515515+0000","last_became_peered":"2024-05-09T09:55:10.515515+0000","last_unstale":"2024-05-09T09:56:21.389380+0000","last_undegraded":"2024-05-09T09:56:21.389380+0000","last_fullsized":"2024-05-09T09:56:21.389380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:21.389179+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:21.389179+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.389179+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:16.078887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":77594624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706176+0000","last_change":"2024-05-09T09:55:41.471993+0000","last_active":"2024-05-09T09:55:56.706176+0000","last_peered":"2024-05-09T09:55:56.706176+0000","last_clean":"2024-05-09T09:55:56.706176+0000","last_became_active":"2024-05-09T09:55:41.469463+0000","last_became_peered":"2024-05-09T09:55:41.469463+0000","last_unstale":"2024-05-09T09:55:56.706176+0000","last_undegraded":"2024-05-09T09:55:56.706176+0000","last_fullsized":"2024-05-09T09:55:56.706176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'16","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.199507+0000","last_change":"2024-05-09T09:53:07.098522+0000","last_active":"2024-05-09T09:56:08.199507+0000","last_peered":"2024-05-09T09:56:08.199507+0000","last_clean":"2024-05-09T09:56:08.199507+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:56:08.199507+0000","last_undegraded":"2024-05-09T09:56:08.199507+0000","last_fullsized":"2024-05-09T09:56:08.199507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703922+0000","last_change":"2024-05-09T09:55:41.489025+0000","last_active":"2024-05-09T09:55:56.703922+0000","last_peered":"2024-05-09T09:55:56.703922+0000","last_clean":"2024-05-09T09:55:56.703922+0000","last_became_active":"2024-05-09T09:55:41.479825+0000","last_became_peered":"2024-05-09T09:55:41.479825+0000","last_unstale":"2024-05-09T09:55:56.703922+0000","last_undegraded":"2024-05-09T09:55:56.703922+0000","last_fullsized":"2024-05-09T09:55:56.703922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017563+0000","last_change":"2024-05-09T09:55:10.499813+0000","last_active":"2024-05-09T09:55:58.017563+0000","last_peered":"2024-05-09T09:55:58.017563+0000","last_clean":"2024-05-09T09:55:58.017563+0000","last_became_active":"2024-05-09T09:55:10.499014+0000","last_became_peered":"2024-05-09T09:55:10.499014+0000","last_unstale":"2024-05-09T09:55:58.017563+0000","last_undegraded":"2024-05-09T09:55:58.017563+0000","last_fullsized":"2024-05-09T09:55:58.017563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'18","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.239456+0000","last_change":"2024-05-09T09:55:43.099041+0000","last_active":"2024-05-09T09:56:08.239456+0000","last_peered":"2024-05-09T09:56:08.239456+0000","last_clean":"2024-05-09T09:56:08.239456+0000","last_became_active":"2024-05-09T09:55:41.507252+0000","last_became_peered":"2024-05-09T09:55:41.507252+0000","last_unstale":"2024-05-09T09:56:08.239456+0000","last_undegraded":"2024-05-09T09:56:08.239456+0000","last_fullsized":"2024-05-09T09:56:08.239456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30720,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.944024+0000","last_change":"2024-05-09T09:56:26.944136+0000","last_active":"2024-05-09T09:56:26.944024+0000","last_peered":"2024-05-09T09:56:26.944024+0000","last_clean":"2024-05-09T09:56:26.944024+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:56:26.944024+0000","last_undegraded":"2024-05-09T09:56:26.944024+0000","last_fullsized":"2024-05-09T09:56:26.944024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.943760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.943760+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.943760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:14.203954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'24","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.818141+0000","last_change":"2024-05-09T09:56:21.818220+0000","last_active":"2024-05-09T09:56:21.818141+0000","last_peered":"2024-05-09T09:56:21.818141+0000","last_clean":"2024-05-09T09:56:21.818141+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:56:21.818141+0000","last_undegraded":"2024-05-09T09:56:21.818141+0000","last_fullsized":"2024-05-09T09:56:21.818141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:21.817925+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:21.817925+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.817925+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:43.852737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":37,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":852,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.929708+0000","last_change":"2024-05-09T09:56:23.929763+0000","last_active":"2024-05-09T09:56:23.929708+0000","last_peered":"2024-05-09T09:56:23.929708+0000","last_clean":"2024-05-09T09:56:23.929708+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:56:23.929708+0000","last_undegraded":"2024-05-09T09:56:23.929708+0000","last_fullsized":"2024-05-09T09:56:23.929708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.929478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.929478+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.929478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:26.285018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400384+0000","last_change":"2024-05-09T09:55:41.487851+0000","last_active":"2024-05-09T09:55:57.400384+0000","last_peered":"2024-05-09T09:55:57.400384+0000","last_clean":"2024-05-09T09:55:57.400384+0000","last_became_active":"2024-05-09T09:55:41.487060+0000","last_became_peered":"2024-05-09T09:55:41.487060+0000","last_unstale":"2024-05-09T09:55:57.400384+0000","last_undegraded":"2024-05-09T09:55:57.400384+0000","last_fullsized":"2024-05-09T09:55:57.400384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.402411+0000","last_change":"2024-05-09T09:53:09.127545+0000","last_active":"2024-05-09T09:55:57.402411+0000","last_peered":"2024-05-09T09:55:57.402411+0000","last_clean":"2024-05-09T09:55:57.402411+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:55:57.402411+0000","last_undegraded":"2024-05-09T09:55:57.402411+0000","last_fullsized":"2024-05-09T09:55:57.402411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'6","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.975437+0000","last_change":"2024-05-09T09:53:07.122730+0000","last_active":"2024-05-09T09:56:07.975437+0000","last_peered":"2024-05-09T09:56:07.975437+0000","last_clean":"2024-05-09T09:56:07.975437+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:56:07.975437+0000","last_undegraded":"2024-05-09T09:56:07.975437+0000","last_fullsized":"2024-05-09T09:56:07.975437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":12294,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018051+0000","last_change":"2024-05-09T09:55:10.509010+0000","last_active":"2024-05-09T09:55:58.018051+0000","last_peered":"2024-05-09T09:55:58.018051+0000","last_clean":"2024-05-09T09:55:58.018051+0000","last_became_active":"2024-05-09T09:55:10.506778+0000","last_became_peered":"2024-05-09T09:55:10.506778+0000","last_unstale":"2024-05-09T09:55:58.018051+0000","last_undegraded":"2024-05-09T09:55:58.018051+0000","last_fullsized":"2024-05-09T09:55:58.018051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"95'9","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.077960+0000","last_change":"2024-05-09T09:56:29.078031+0000","last_active":"2024-05-09T09:56:29.077960+0000","last_peered":"2024-05-09T09:56:29.077960+0000","last_clean":"2024-05-09T09:56:29.077960+0000","last_became_active":"2024-05-09T09:55:41.467079+0000","last_became_peered":"2024-05-09T09:55:41.467079+0000","last_unstale":"2024-05-09T09:56:29.077960+0000","last_undegraded":"2024-05-09T09:56:29.077960+0000","last_fullsized":"2024-05-09T09:56:29.077960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'9","last_scrub_stamp":"2024-05-09T09:56:29.077771+0000","last_deep_scrub":"95'9","last_deep_scrub_stamp":"2024-05-09T09:56:29.077771+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.077771+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:13:12.289545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706410+0000","last_change":"2024-05-09T09:55:41.468769+0000","last_active":"2024-05-09T09:55:56.706410+0000","last_peered":"2024-05-09T09:55:56.706410+0000","last_clean":"2024-05-09T09:55:56.706410+0000","last_became_active":"2024-05-09T09:55:41.467929+0000","last_became_peered":"2024-05-09T09:55:41.467929+0000","last_unstale":"2024-05-09T09:55:56.706410+0000","last_undegraded":"2024-05-09T09:55:56.706410+0000","last_fullsized":"2024-05-09T09:55:56.706410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702365+0000","last_change":"2024-05-09T09:53:17.175683+0000","last_active":"2024-05-09T09:55:56.702365+0000","last_peered":"2024-05-09T09:55:56.702365+0000","last_clean":"2024-05-09T09:55:56.702365+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:55:56.702365+0000","last_undegraded":"2024-05-09T09:55:56.702365+0000","last_fullsized":"2024-05-09T09:55:56.702365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.830912+0000","last_change":"2024-05-09T09:56:13.830932+0000","last_active":"2024-05-09T09:56:13.830912+0000","last_peered":"2024-05-09T09:56:13.830912+0000","last_clean":"2024-05-09T09:56:13.830912+0000","last_became_active":"2024-05-09T09:55:10.482649+0000","last_became_peered":"2024-05-09T09:55:10.482649+0000","last_unstale":"2024-05-09T09:56:13.830912+0000","last_undegraded":"2024-05-09T09:56:13.830912+0000","last_fullsized":"2024-05-09T09:56:13.830912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:13.830834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:13.830834+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.830834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:25.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'20","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.250428+0000","last_change":"2024-05-09T09:55:45.036128+0000","last_active":"2024-05-09T09:56:08.250428+0000","last_peered":"2024-05-09T09:56:08.250428+0000","last_clean":"2024-05-09T09:56:08.250428+0000","last_became_active":"2024-05-09T09:55:41.508695+0000","last_became_peered":"2024-05-09T09:55:41.508695+0000","last_unstale":"2024-05-09T09:56:08.250428+0000","last_undegraded":"2024-05-09T09:56:08.250428+0000","last_fullsized":"2024-05-09T09:56:08.250428+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":38936,"num_write":60,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018277+0000","last_change":"2024-05-09T09:55:10.510105+0000","last_active":"2024-05-09T09:55:58.018277+0000","last_peered":"2024-05-09T09:55:58.018277+0000","last_clean":"2024-05-09T09:55:58.018277+0000","last_became_active":"2024-05-09T09:55:10.508122+0000","last_became_peered":"2024-05-09T09:55:10.508122+0000","last_unstale":"2024-05-09T09:55:58.018277+0000","last_undegraded":"2024-05-09T09:55:58.018277+0000","last_fullsized":"2024-05-09T09:55:58.018277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"63'11","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.511500+0000","last_change":"2024-05-09T09:55:43.116362+0000","last_active":"2024-05-09T09:55:57.511500+0000","last_peered":"2024-05-09T09:55:57.511500+0000","last_clean":"2024-05-09T09:55:57.511500+0000","last_became_active":"2024-05-09T09:55:41.506785+0000","last_became_peered":"2024-05-09T09:55:41.506785+0000","last_unstale":"2024-05-09T09:55:57.511500+0000","last_undegraded":"2024-05-09T09:55:57.511500+0000","last_fullsized":"2024-05-09T09:55:57.511500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'18","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.953388+0000","last_change":"2024-05-09T09:56:25.953450+0000","last_active":"2024-05-09T09:56:25.953388+0000","last_peered":"2024-05-09T09:56:25.953388+0000","last_clean":"2024-05-09T09:56:25.953388+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:56:25.953388+0000","last_undegraded":"2024-05-09T09:56:25.953388+0000","last_fullsized":"2024-05-09T09:56:25.953388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:25.953197+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:25.953197+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.953197+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:09:31.580360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'2","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.819707+0000","last_change":"2024-05-09T09:56:13.819769+0000","last_active":"2024-05-09T09:56:13.819707+0000","last_peered":"2024-05-09T09:56:13.819707+0000","last_clean":"2024-05-09T09:56:13.819707+0000","last_became_active":"2024-05-09T09:55:41.492528+0000","last_became_peered":"2024-05-09T09:55:41.492528+0000","last_unstale":"2024-05-09T09:56:13.819707+0000","last_undegraded":"2024-05-09T09:56:13.819707+0000","last_fullsized":"2024-05-09T09:56:13.819707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-09T09:56:13.819494+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-09T09:56:13.819494+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.819494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:21:46.630613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018587+0000","last_change":"2024-05-09T09:55:10.510510+0000","last_active":"2024-05-09T09:55:58.018587+0000","last_peered":"2024-05-09T09:55:58.018587+0000","last_clean":"2024-05-09T09:55:58.018587+0000","last_became_active":"2024-05-09T09:55:10.508721+0000","last_became_peered":"2024-05-09T09:55:10.508721+0000","last_unstale":"2024-05-09T09:55:58.018587+0000","last_undegraded":"2024-05-09T09:55:58.018587+0000","last_fullsized":"2024-05-09T09:55:58.018587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'12","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.901542+0000","last_change":"2024-05-09T09:56:28.901605+0000","last_active":"2024-05-09T09:56:28.901542+0000","last_peered":"2024-05-09T09:56:28.901542+0000","last_clean":"2024-05-09T09:56:28.901542+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:56:28.901542+0000","last_undegraded":"2024-05-09T09:56:28.901542+0000","last_fullsized":"2024-05-09T09:56:28.901542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:28.901346+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:28.901346+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.901346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:43:21.094891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.959030+0000","last_change":"2024-05-09T09:56:16.959084+0000","last_active":"2024-05-09T09:56:16.959030+0000","last_peered":"2024-05-09T09:56:16.959030+0000","last_clean":"2024-05-09T09:56:16.959030+0000","last_became_active":"2024-05-09T09:55:10.507504+0000","last_became_peered":"2024-05-09T09:55:10.507504+0000","last_unstale":"2024-05-09T09:56:16.959030+0000","last_undegraded":"2024-05-09T09:56:16.959030+0000","last_fullsized":"2024-05-09T09:56:16.959030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.958837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.958837+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.958837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:45.715135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'21","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.863153+0000","last_change":"2024-05-09T09:56:19.863224+0000","last_active":"2024-05-09T09:56:19.863153+0000","last_peered":"2024-05-09T09:56:19.863153+0000","last_clean":"2024-05-09T09:56:19.863153+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:56:19.863153+0000","last_undegraded":"2024-05-09T09:56:19.863153+0000","last_fullsized":"2024-05-09T09:56:19.863153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-05-09T09:56:19.862972+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-05-09T09:56:19.862972+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.862972+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:52.693864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'21","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.373467+0000","last_change":"2024-05-09T09:56:27.373529+0000","last_active":"2024-05-09T09:56:27.373467+0000","last_peered":"2024-05-09T09:56:27.373467+0000","last_clean":"2024-05-09T09:56:27.373467+0000","last_became_active":"2024-05-09T09:55:10.502644+0000","last_became_peered":"2024-05-09T09:55:10.502644+0000","last_unstale":"2024-05-09T09:56:27.373467+0000","last_undegraded":"2024-05-09T09:56:27.373467+0000","last_fullsized":"2024-05-09T09:56:27.373467+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-05-09T09:56:27.373256+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-05-09T09:56:27.373256+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.373256+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:31.137721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400967+0000","last_change":"2024-05-09T09:53:09.127401+0000","last_active":"2024-05-09T09:55:57.400967+0000","last_peered":"2024-05-09T09:55:57.400967+0000","last_clean":"2024-05-09T09:55:57.400967+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:55:57.400967+0000","last_undegraded":"2024-05-09T09:55:57.400967+0000","last_fullsized":"2024-05-09T09:55:57.400967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'20","reported_seq":227,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.253448+0000","last_change":"2024-05-09T09:55:44.175359+0000","last_active":"2024-05-09T09:56:08.253448+0000","last_peered":"2024-05-09T09:56:08.253448+0000","last_clean":"2024-05-09T09:56:08.253448+0000","last_became_active":"2024-05-09T09:55:41.507201+0000","last_became_peered":"2024-05-09T09:55:41.507201+0000","last_unstale":"2024-05-09T09:56:08.253448+0000","last_undegraded":"2024-05-09T09:56:08.253448+0000","last_fullsized":"2024-05-09T09:56:08.253448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34828,"num_write":40,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.940895+0000","last_change":"2024-05-09T09:56:26.941027+0000","last_active":"2024-05-09T09:56:26.940895+0000","last_peered":"2024-05-09T09:56:26.940895+0000","last_clean":"2024-05-09T09:56:26.940895+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:56:26.940895+0000","last_undegraded":"2024-05-09T09:56:26.940895+0000","last_fullsized":"2024-05-09T09:56:26.940895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.940670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.940670+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.940670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:36:58.896665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'39","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.917796+0000","last_change":"2024-05-09T09:56:21.917951+0000","last_active":"2024-05-09T09:56:21.917796+0000","last_peered":"2024-05-09T09:56:21.917796+0000","last_clean":"2024-05-09T09:56:21.917796+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:56:21.917796+0000","last_undegraded":"2024-05-09T09:56:21.917796+0000","last_fullsized":"2024-05-09T09:56:21.917796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'39","last_scrub_stamp":"2024-05-09T09:56:21.917541+0000","last_deep_scrub":"95'39","last_deep_scrub_stamp":"2024-05-09T09:56:21.917541+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.917541+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:39.992260+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":57,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.390463+0000","last_change":"2024-05-09T09:56:14.390616+0000","last_active":"2024-05-09T09:56:14.390463+0000","last_peered":"2024-05-09T09:56:14.390463+0000","last_clean":"2024-05-09T09:56:14.390463+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:56:14.390463+0000","last_undegraded":"2024-05-09T09:56:14.390463+0000","last_fullsized":"2024-05-09T09:56:14.390463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:14.390213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:14.390213+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.390213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:12.479727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401596+0000","last_change":"2024-05-09T09:55:41.485193+0000","last_active":"2024-05-09T09:55:57.401596+0000","last_peered":"2024-05-09T09:55:57.401596+0000","last_clean":"2024-05-09T09:55:57.401596+0000","last_became_active":"2024-05-09T09:55:41.484312+0000","last_became_peered":"2024-05-09T09:55:41.484312+0000","last_unstale":"2024-05-09T09:55:57.401596+0000","last_undegraded":"2024-05-09T09:55:57.401596+0000","last_fullsized":"2024-05-09T09:55:57.401596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704247+0000","last_change":"2024-05-09T09:55:41.479720+0000","last_active":"2024-05-09T09:55:56.704247+0000","last_peered":"2024-05-09T09:55:56.704247+0000","last_clean":"2024-05-09T09:55:56.704247+0000","last_became_active":"2024-05-09T09:55:41.472133+0000","last_became_peered":"2024-05-09T09:55:41.472133+0000","last_unstale":"2024-05-09T09:55:56.704247+0000","last_undegraded":"2024-05-09T09:55:56.704247+0000","last_fullsized":"2024-05-09T09:55:56.704247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'8","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.239479+0000","last_change":"2024-05-09T09:55:44.852684+0000","last_active":"2024-05-09T09:56:08.239479+0000","last_peered":"2024-05-09T09:56:08.239479+0000","last_clean":"2024-05-09T09:56:08.239479+0000","last_became_active":"2024-05-09T09:55:41.507751+0000","last_became_peered":"2024-05-09T09:55:41.507751+0000","last_unstale":"2024-05-09T09:56:08.239479+0000","last_undegraded":"2024-05-09T09:56:08.239479+0000","last_fullsized":"2024-05-09T09:56:08.239479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.591345+0000","last_change":"2024-05-09T09:56:20.591401+0000","last_active":"2024-05-09T09:56:20.591345+0000","last_peered":"2024-05-09T09:56:20.591345+0000","last_clean":"2024-05-09T09:56:20.591345+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:56:20.591345+0000","last_undegraded":"2024-05-09T09:56:20.591345+0000","last_fullsized":"2024-05-09T09:56:20.591345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:20.591139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:20.591139+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.591139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:15.997031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'16","reported_seq":65,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.524245+0000","last_change":"2024-05-09T09:55:11.749967+0000","last_active":"2024-05-09T09:56:07.524245+0000","last_peered":"2024-05-09T09:56:07.524245+0000","last_clean":"2024-05-09T09:56:07.524245+0000","last_became_active":"2024-05-09T09:55:10.522763+0000","last_became_peered":"2024-05-09T09:55:10.522763+0000","last_unstale":"2024-05-09T09:56:07.524245+0000","last_undegraded":"2024-05-09T09:56:07.524245+0000","last_fullsized":"2024-05-09T09:56:07.524245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013705+0000","last_change":"2024-05-09T09:55:10.505759+0000","last_active":"2024-05-09T09:55:58.013705+0000","last_peered":"2024-05-09T09:55:58.013705+0000","last_clean":"2024-05-09T09:55:58.013705+0000","last_became_active":"2024-05-09T09:55:10.504789+0000","last_became_peered":"2024-05-09T09:55:10.504789+0000","last_unstale":"2024-05-09T09:55:58.013705+0000","last_undegraded":"2024-05-09T09:55:58.013705+0000","last_fullsized":"2024-05-09T09:55:58.013705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298345+0000","last_change":"2024-05-09T09:55:41.506430+0000","last_active":"2024-05-09T09:55:57.298345+0000","last_peered":"2024-05-09T09:55:57.298345+0000","last_clean":"2024-05-09T09:55:57.298345+0000","last_became_active":"2024-05-09T09:55:41.505745+0000","last_became_peered":"2024-05-09T09:55:41.505745+0000","last_unstale":"2024-05-09T09:55:57.298345+0000","last_undegraded":"2024-05-09T09:55:57.298345+0000","last_fullsized":"2024-05-09T09:55:57.298345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.297191+0000","last_change":"2024-05-09T09:53:09.114468+0000","last_active":"2024-05-09T09:55:57.297191+0000","last_peered":"2024-05-09T09:55:57.297191+0000","last_clean":"2024-05-09T09:55:57.297191+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:55:57.297191+0000","last_undegraded":"2024-05-09T09:55:57.297191+0000","last_fullsized":"2024-05-09T09:55:57.297191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'20","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.089138+0000","last_change":"2024-05-09T09:53:07.133146+0000","last_active":"2024-05-09T09:56:08.089138+0000","last_peered":"2024-05-09T09:56:08.089138+0000","last_clean":"2024-05-09T09:56:08.089138+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:56:08.089138+0000","last_undegraded":"2024-05-09T09:56:08.089138+0000","last_fullsized":"2024-05-09T09:56:08.089138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34828,"num_write":40,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.609926+0000","last_change":"2024-05-09T09:56:19.609985+0000","last_active":"2024-05-09T09:56:19.609926+0000","last_peered":"2024-05-09T09:56:19.609926+0000","last_clean":"2024-05-09T09:56:19.609926+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:56:19.609926+0000","last_undegraded":"2024-05-09T09:56:19.609926+0000","last_fullsized":"2024-05-09T09:56:19.609926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:19.609719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:19.609719+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.609719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:26.743623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'31","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.894544+0000","last_change":"2024-05-09T09:56:20.894724+0000","last_active":"2024-05-09T09:56:20.894544+0000","last_peered":"2024-05-09T09:56:20.894544+0000","last_clean":"2024-05-09T09:56:20.894544+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:56:20.894544+0000","last_undegraded":"2024-05-09T09:56:20.894544+0000","last_fullsized":"2024-05-09T09:56:20.894544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'31","last_scrub_stamp":"2024-05-09T09:56:20.894290+0000","last_deep_scrub":"95'31","last_deep_scrub_stamp":"2024-05-09T09:56:20.894290+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.894290+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:36.256411+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'18","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.795475+0000","last_change":"2024-05-09T09:56:24.795564+0000","last_active":"2024-05-09T09:56:24.795475+0000","last_peered":"2024-05-09T09:56:24.795475+0000","last_clean":"2024-05-09T09:56:24.795475+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:56:24.795475+0000","last_undegraded":"2024-05-09T09:56:24.795475+0000","last_fullsized":"2024-05-09T09:56:24.795475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:24.795280+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:24.795280+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.795280+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:58.756038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'4","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706868+0000","last_change":"2024-05-09T09:53:17.181294+0000","last_active":"2024-05-09T09:55:56.706868+0000","last_peered":"2024-05-09T09:55:56.706868+0000","last_clean":"2024-05-09T09:55:56.706868+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:55:56.706868+0000","last_undegraded":"2024-05-09T09:55:56.706868+0000","last_fullsized":"2024-05-09T09:55:56.706868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"75'34","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705438+0000","last_change":"2024-05-09T09:53:09.101143+0000","last_active":"2024-05-09T09:55:56.705438+0000","last_peered":"2024-05-09T09:55:56.705438+0000","last_clean":"2024-05-09T09:55:56.705438+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:55:56.705438+0000","last_undegraded":"2024-05-09T09:55:56.705438+0000","last_fullsized":"2024-05-09T09:55:56.705438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'20","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.253673+0000","last_change":"2024-05-09T09:55:11.694165+0000","last_active":"2024-05-09T09:56:08.253673+0000","last_peered":"2024-05-09T09:56:08.253673+0000","last_clean":"2024-05-09T09:56:08.253673+0000","last_became_active":"2024-05-09T09:55:10.521894+0000","last_became_peered":"2024-05-09T09:55:10.521894+0000","last_unstale":"2024-05-09T09:56:08.253673+0000","last_undegraded":"2024-05-09T09:56:08.253673+0000","last_fullsized":"2024-05-09T09:56:08.253673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38924,"num_write":40,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.537202+0000","last_change":"2024-05-09T09:56:27.537258+0000","last_active":"2024-05-09T09:56:27.537202+0000","last_peered":"2024-05-09T09:56:27.537202+0000","last_clean":"2024-05-09T09:56:27.537202+0000","last_became_active":"2024-05-09T09:55:41.483828+0000","last_became_peered":"2024-05-09T09:55:41.483828+0000","last_unstale":"2024-05-09T09:56:27.537202+0000","last_undegraded":"2024-05-09T09:56:27.537202+0000","last_fullsized":"2024-05-09T09:56:27.537202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:27.536980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:27.536980+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.536980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:40:00.144105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'41","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.850584+0000","last_change":"2024-05-09T09:56:23.850658+0000","last_active":"2024-05-09T09:56:23.850584+0000","last_peered":"2024-05-09T09:56:23.850584+0000","last_clean":"2024-05-09T09:56:23.850584+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:56:23.850584+0000","last_undegraded":"2024-05-09T09:56:23.850584+0000","last_fullsized":"2024-05-09T09:56:23.850584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'41","last_scrub_stamp":"2024-05-09T09:56:23.850382+0000","last_deep_scrub":"95'41","last_deep_scrub_stamp":"2024-05-09T09:56:23.850382+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.850382+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:28:27.018821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":100,"num_write":42,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.567407+0000","last_change":"2024-05-09T09:56:15.567470+0000","last_active":"2024-05-09T09:56:15.567407+0000","last_peered":"2024-05-09T09:56:15.567407+0000","last_clean":"2024-05-09T09:56:15.567407+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:56:15.567407+0000","last_undegraded":"2024-05-09T09:56:15.567407+0000","last_fullsized":"2024-05-09T09:56:15.567407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:15.567201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:15.567201+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.567201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:31:01.367464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703634+0000","last_change":"2024-05-09T09:55:10.518479+0000","last_active":"2024-05-09T09:55:56.703634+0000","last_peered":"2024-05-09T09:55:56.703634+0000","last_clean":"2024-05-09T09:55:56.703634+0000","last_became_active":"2024-05-09T09:55:10.518109+0000","last_became_peered":"2024-05-09T09:55:10.518109+0000","last_unstale":"2024-05-09T09:55:56.703634+0000","last_undegraded":"2024-05-09T09:55:56.703634+0000","last_fullsized":"2024-05-09T09:55:56.703634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705632+0000","last_change":"2024-05-09T09:55:41.491823+0000","last_active":"2024-05-09T09:55:56.705632+0000","last_peered":"2024-05-09T09:55:56.705632+0000","last_clean":"2024-05-09T09:55:56.705632+0000","last_became_active":"2024-05-09T09:55:41.488846+0000","last_became_peered":"2024-05-09T09:55:41.488846+0000","last_unstale":"2024-05-09T09:55:56.705632+0000","last_undegraded":"2024-05-09T09:55:56.705632+0000","last_fullsized":"2024-05-09T09:55:56.705632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'14","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.057993+0000","last_change":"2024-05-09T09:55:10.972117+0000","last_active":"2024-05-09T09:56:08.057993+0000","last_peered":"2024-05-09T09:56:08.057993+0000","last_clean":"2024-05-09T09:56:08.057993+0000","last_became_active":"2024-05-09T09:55:10.507132+0000","last_became_peered":"2024-05-09T09:55:10.507132+0000","last_unstale":"2024-05-09T09:56:08.057993+0000","last_undegraded":"2024-05-09T09:56:08.057993+0000","last_fullsized":"2024-05-09T09:56:08.057993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22550,"num_write":54,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.608869+0000","last_change":"2024-05-09T09:56:21.609011+0000","last_active":"2024-05-09T09:56:21.608869+0000","last_peered":"2024-05-09T09:56:21.608869+0000","last_clean":"2024-05-09T09:56:21.608869+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:56:21.608869+0000","last_undegraded":"2024-05-09T09:56:21.608869+0000","last_fullsized":"2024-05-09T09:56:21.608869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.608614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.608614+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.608614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:24.683876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'24","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.644855+0000","last_change":"2024-05-09T09:55:42.405072+0000","last_active":"2024-05-09T09:56:07.644855+0000","last_peered":"2024-05-09T09:56:07.644855+0000","last_clean":"2024-05-09T09:56:07.644855+0000","last_became_active":"2024-05-09T09:55:41.509467+0000","last_became_peered":"2024-05-09T09:55:41.509467+0000","last_unstale":"2024-05-09T09:56:07.644855+0000","last_undegraded":"2024-05-09T09:56:07.644855+0000","last_fullsized":"2024-05-09T09:56:07.644855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":55,"num_write":30,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":6936,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:12.809572+0000","last_change":"2024-05-09T09:56:12.809600+0000","last_active":"2024-05-09T09:56:12.809572+0000","last_peered":"2024-05-09T09:56:12.809572+0000","last_clean":"2024-05-09T09:56:12.809572+0000","last_became_active":"2024-05-09T09:55:10.506376+0000","last_became_peered":"2024-05-09T09:55:10.506376+0000","last_unstale":"2024-05-09T09:56:12.809572+0000","last_undegraded":"2024-05-09T09:56:12.809572+0000","last_fullsized":"2024-05-09T09:56:12.809572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:12.809470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:12.809470+0000","last_clean_scrub_stamp":"2024-05-09T09:56:12.809470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:35.305496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"63'2","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.254726+0000","last_change":"2024-05-09T09:56:16.254786+0000","last_active":"2024-05-09T09:56:16.254726+0000","last_peered":"2024-05-09T09:56:16.254726+0000","last_clean":"2024-05-09T09:56:16.254726+0000","last_became_active":"2024-05-09T09:55:10.512509+0000","last_became_peered":"2024-05-09T09:55:10.512509+0000","last_unstale":"2024-05-09T09:56:16.254726+0000","last_undegraded":"2024-05-09T09:56:16.254726+0000","last_fullsized":"2024-05-09T09:56:16.254726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-05-09T09:56:16.254523+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-05-09T09:56:16.254523+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.254523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:44:38.983451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706413+0000","last_change":"2024-05-09T09:55:41.477052+0000","last_active":"2024-05-09T09:55:56.706413+0000","last_peered":"2024-05-09T09:55:56.706413+0000","last_clean":"2024-05-09T09:55:56.706413+0000","last_became_active":"2024-05-09T09:55:41.471497+0000","last_became_peered":"2024-05-09T09:55:41.471497+0000","last_unstale":"2024-05-09T09:55:56.706413+0000","last_undegraded":"2024-05-09T09:55:56.706413+0000","last_fullsized":"2024-05-09T09:55:56.706413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'18","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.220635+0000","last_change":"2024-05-09T09:55:42.508840+0000","last_active":"2024-05-09T09:56:08.220635+0000","last_peered":"2024-05-09T09:56:08.220635+0000","last_clean":"2024-05-09T09:56:08.220635+0000","last_became_active":"2024-05-09T09:55:41.513259+0000","last_became_peered":"2024-05-09T09:55:41.513259+0000","last_unstale":"2024-05-09T09:56:08.220635+0000","last_undegraded":"2024-05-09T09:56:08.220635+0000","last_fullsized":"2024-05-09T09:56:08.220635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703163+0000","last_change":"2024-05-09T09:55:41.505012+0000","last_active":"2024-05-09T09:55:56.703163+0000","last_peered":"2024-05-09T09:55:56.703163+0000","last_clean":"2024-05-09T09:55:56.703163+0000","last_became_active":"2024-05-09T09:55:41.504609+0000","last_became_peered":"2024-05-09T09:55:41.504609+0000","last_unstale":"2024-05-09T09:55:56.703163+0000","last_undegraded":"2024-05-09T09:55:56.703163+0000","last_fullsized":"2024-05-09T09:55:56.703163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'34","reported_seq":248,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.550585+0000","last_change":"2024-05-09T09:56:26.550680+0000","last_active":"2024-05-09T09:56:26.550585+0000","last_peered":"2024-05-09T09:56:26.550585+0000","last_clean":"2024-05-09T09:56:26.550585+0000","last_became_active":"2024-05-09T09:55:10.520615+0000","last_became_peered":"2024-05-09T09:55:10.520615+0000","last_unstale":"2024-05-09T09:56:26.550585+0000","last_undegraded":"2024-05-09T09:56:26.550585+0000","last_fullsized":"2024-05-09T09:56:26.550585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-05-09T09:56:26.550390+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-05-09T09:56:26.550390+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.550390+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:26.354147+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":58,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":3002,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'18","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.601125+0000","last_change":"2024-05-09T09:56:23.601197+0000","last_active":"2024-05-09T09:56:23.601125+0000","last_peered":"2024-05-09T09:56:23.601125+0000","last_clean":"2024-05-09T09:56:23.601125+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:56:23.601125+0000","last_undegraded":"2024-05-09T09:56:23.601125+0000","last_fullsized":"2024-05-09T09:56:23.601125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:23.600925+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:23.600925+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.600925+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:52:59.008101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.389411+0000","last_change":"2024-05-09T09:56:18.389534+0000","last_active":"2024-05-09T09:56:18.389411+0000","last_peered":"2024-05-09T09:56:18.389411+0000","last_clean":"2024-05-09T09:56:18.389411+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:56:18.389411+0000","last_undegraded":"2024-05-09T09:56:18.389411+0000","last_fullsized":"2024-05-09T09:56:18.389411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-09T09:56:18.389119+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-09T09:56:18.389119+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.389119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:01:42.160422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'6","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706862+0000","last_change":"2024-05-09T09:55:42.572344+0000","last_active":"2024-05-09T09:55:56.706862+0000","last_peered":"2024-05-09T09:55:56.706862+0000","last_clean":"2024-05-09T09:55:56.706862+0000","last_became_active":"2024-05-09T09:55:41.517278+0000","last_became_peered":"2024-05-09T09:55:41.517278+0000","last_unstale":"2024-05-09T09:55:56.706862+0000","last_undegraded":"2024-05-09T09:55:56.706862+0000","last_fullsized":"2024-05-09T09:55:56.706862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'18","reported_seq":73,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.881490+0000","last_change":"2024-05-09T09:56:15.881557+0000","last_active":"2024-05-09T09:56:15.881490+0000","last_peered":"2024-05-09T09:56:15.881490+0000","last_clean":"2024-05-09T09:56:15.881490+0000","last_became_active":"2024-05-09T09:55:41.481490+0000","last_became_peered":"2024-05-09T09:55:41.481490+0000","last_unstale":"2024-05-09T09:56:15.881490+0000","last_undegraded":"2024-05-09T09:56:15.881490+0000","last_fullsized":"2024-05-09T09:56:15.881490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:15.881274+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:15.881274+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.881274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:33.015859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"23'3","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.337480+0000","last_change":"2024-05-09T09:55:41.651487+0000","last_active":"2024-05-09T09:56:07.337480+0000","last_peered":"2024-05-09T09:56:07.337480+0000","last_clean":"2024-05-09T09:56:07.337480+0000","last_became_active":"2024-05-09T09:55:41.495448+0000","last_became_peered":"2024-05-09T09:55:41.495448+0000","last_unstale":"2024-05-09T09:56:07.337480+0000","last_undegraded":"2024-05-09T09:56:07.337480+0000","last_fullsized":"2024-05-09T09:56:07.337480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"95'15","reported_seq":73,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.361881+0000","last_change":"2024-05-09T09:56:20.361953+0000","last_active":"2024-05-09T09:56:20.361881+0000","last_peered":"2024-05-09T09:56:20.361881+0000","last_clean":"2024-05-09T09:56:20.361881+0000","last_became_active":"2024-05-09T09:55:10.512273+0000","last_became_peered":"2024-05-09T09:55:10.512273+0000","last_unstale":"2024-05-09T09:56:20.361881+0000","last_undegraded":"2024-05-09T09:56:20.361881+0000","last_fullsized":"2024-05-09T09:56:20.361881+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-05-09T09:56:20.361692+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-05-09T09:56:20.361692+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.361692+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:52.524182+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'18","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.746063+0000","last_change":"2024-05-09T09:56:14.746129+0000","last_active":"2024-05-09T09:56:14.746063+0000","last_peered":"2024-05-09T09:56:14.746063+0000","last_clean":"2024-05-09T09:56:14.746063+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:56:14.746063+0000","last_undegraded":"2024-05-09T09:56:14.746063+0000","last_fullsized":"2024-05-09T09:56:14.746063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:14.745869+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:14.745869+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.745869+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:30:57.277120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705241+0000","last_change":"2024-05-09T09:55:41.475763+0000","last_active":"2024-05-09T09:55:56.705241+0000","last_peered":"2024-05-09T09:55:56.705241+0000","last_clean":"2024-05-09T09:55:56.705241+0000","last_became_active":"2024-05-09T09:55:41.474020+0000","last_became_peered":"2024-05-09T09:55:41.474020+0000","last_unstale":"2024-05-09T09:55:56.705241+0000","last_undegraded":"2024-05-09T09:55:56.705241+0000","last_fullsized":"2024-05-09T09:55:56.705241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"75'42","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704621+0000","last_change":"2024-05-09T09:55:11.077756+0000","last_active":"2024-05-09T09:55:56.704621+0000","last_peered":"2024-05-09T09:55:56.704621+0000","last_clean":"2024-05-09T09:55:56.704621+0000","last_became_active":"2024-05-09T09:55:10.516407+0000","last_became_peered":"2024-05-09T09:55:10.516407+0000","last_unstale":"2024-05-09T09:55:56.704621+0000","last_undegraded":"2024-05-09T09:55:56.704621+0000","last_fullsized":"2024-05-09T09:55:56.704621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"95'12","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.275988+0000","last_change":"2024-05-09T09:56:18.276167+0000","last_active":"2024-05-09T09:56:18.275988+0000","last_peered":"2024-05-09T09:56:18.275988+0000","last_clean":"2024-05-09T09:56:18.275988+0000","last_became_active":"2024-05-09T09:55:10.516633+0000","last_became_peered":"2024-05-09T09:55:10.516633+0000","last_unstale":"2024-05-09T09:56:18.275988+0000","last_undegraded":"2024-05-09T09:56:18.275988+0000","last_fullsized":"2024-05-09T09:56:18.275988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:18.275749+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:18.275749+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.275749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:44:43.006139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12294,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706642+0000","last_change":"2024-05-09T09:55:41.480580+0000","last_active":"2024-05-09T09:55:56.706642+0000","last_peered":"2024-05-09T09:55:56.706642+0000","last_clean":"2024-05-09T09:55:56.706642+0000","last_became_active":"2024-05-09T09:55:41.479634+0000","last_became_peered":"2024-05-09T09:55:41.479634+0000","last_unstale":"2024-05-09T09:55:56.706642+0000","last_undegraded":"2024-05-09T09:55:56.706642+0000","last_fullsized":"2024-05-09T09:55:56.706642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'35","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.900203+0000","last_change":"2024-05-09T09:56:19.900280+0000","last_active":"2024-05-09T09:56:19.900203+0000","last_peered":"2024-05-09T09:56:19.900203+0000","last_clean":"2024-05-09T09:56:19.900203+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:56:19.900203+0000","last_undegraded":"2024-05-09T09:56:19.900203+0000","last_fullsized":"2024-05-09T09:56:19.900203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'35","last_scrub_stamp":"2024-05-09T09:56:19.900027+0000","last_deep_scrub":"95'35","last_deep_scrub_stamp":"2024-05-09T09:56:19.900027+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.900027+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:09.053803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":48,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298562+0000","last_change":"2024-05-09T09:55:10.503163+0000","last_active":"2024-05-09T09:55:57.298562+0000","last_peered":"2024-05-09T09:55:57.298562+0000","last_clean":"2024-05-09T09:55:57.298562+0000","last_became_active":"2024-05-09T09:55:10.501658+0000","last_became_peered":"2024-05-09T09:55:10.501658+0000","last_unstale":"2024-05-09T09:55:57.298562+0000","last_undegraded":"2024-05-09T09:55:57.298562+0000","last_fullsized":"2024-05-09T09:55:57.298562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.400422+0000","last_change":"2024-05-09T09:56:20.400479+0000","last_active":"2024-05-09T09:56:20.400422+0000","last_peered":"2024-05-09T09:56:20.400422+0000","last_clean":"2024-05-09T09:56:20.400422+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:56:20.400422+0000","last_undegraded":"2024-05-09T09:56:20.400422+0000","last_fullsized":"2024-05-09T09:56:20.400422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:20.400224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:20.400224+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.400224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:35.762346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299130+0000","last_change":"2024-05-09T09:55:41.514105+0000","last_active":"2024-05-09T09:55:57.299130+0000","last_peered":"2024-05-09T09:55:57.299130+0000","last_clean":"2024-05-09T09:55:57.299130+0000","last_became_active":"2024-05-09T09:55:41.513454+0000","last_became_peered":"2024-05-09T09:55:41.513454+0000","last_unstale":"2024-05-09T09:55:57.299130+0000","last_undegraded":"2024-05-09T09:55:57.299130+0000","last_fullsized":"2024-05-09T09:55:57.299130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":319,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015169+0000","last_change":"2024-05-09T09:53:01.050722+0000","last_active":"2024-05-09T09:55:58.015169+0000","last_peered":"2024-05-09T09:55:58.015169+0000","last_clean":"2024-05-09T09:55:58.015169+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:55:58.015169+0000","last_undegraded":"2024-05-09T09:55:58.015169+0000","last_fullsized":"2024-05-09T09:55:58.015169+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401481+0000","last_change":"2024-05-09T09:53:01.054701+0000","last_active":"2024-05-09T09:55:57.401481+0000","last_peered":"2024-05-09T09:55:57.401481+0000","last_clean":"2024-05-09T09:55:57.401481+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:55:57.401481+0000","last_undegraded":"2024-05-09T09:55:57.401481+0000","last_fullsized":"2024-05-09T09:55:57.401481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'16","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.198129+0000","last_change":"2024-05-09T09:55:10.921973+0000","last_active":"2024-05-09T09:56:08.198129+0000","last_peered":"2024-05-09T09:56:08.198129+0000","last_clean":"2024-05-09T09:56:08.198129+0000","last_became_active":"2024-05-09T09:55:10.505428+0000","last_became_peered":"2024-05-09T09:55:10.505428+0000","last_unstale":"2024-05-09T09:56:08.198129+0000","last_undegraded":"2024-05-09T09:56:08.198129+0000","last_fullsized":"2024-05-09T09:56:08.198129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16396,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.946698+0000","last_change":"2024-05-09T09:56:28.946752+0000","last_active":"2024-05-09T09:56:28.946698+0000","last_peered":"2024-05-09T09:56:28.946698+0000","last_clean":"2024-05-09T09:56:28.946698+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:56:28.946698+0000","last_undegraded":"2024-05-09T09:56:28.946698+0000","last_fullsized":"2024-05-09T09:56:28.946698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.946479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.946479+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.946479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:58.795744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'48","reported_seq":256,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.258256+0000","last_change":"2024-05-09T09:55:11.706091+0000","last_active":"2024-05-09T09:56:08.258256+0000","last_peered":"2024-05-09T09:56:08.258256+0000","last_clean":"2024-05-09T09:56:08.258256+0000","last_became_active":"2024-05-09T09:55:10.522989+0000","last_became_peered":"2024-05-09T09:55:10.522989+0000","last_unstale":"2024-05-09T09:56:08.258256+0000","last_undegraded":"2024-05-09T09:56:08.258256+0000","last_fullsized":"2024-05-09T09:56:08.258256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":130,"num_write":50,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":11272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.799174+0000","last_change":"2024-05-09T09:56:22.799228+0000","last_active":"2024-05-09T09:56:22.799174+0000","last_peered":"2024-05-09T09:56:22.799174+0000","last_clean":"2024-05-09T09:56:22.799174+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:56:22.799174+0000","last_undegraded":"2024-05-09T09:56:22.799174+0000","last_fullsized":"2024-05-09T09:56:22.799174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:22.798974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:22.798974+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.798974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:08.605089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"75'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.763184+0000","last_change":"2024-05-09T09:56:20.763250+0000","last_active":"2024-05-09T09:56:20.763184+0000","last_peered":"2024-05-09T09:56:20.763184+0000","last_clean":"2024-05-09T09:56:20.763184+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:56:20.763184+0000","last_undegraded":"2024-05-09T09:56:20.763184+0000","last_fullsized":"2024-05-09T09:56:20.763184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-09T09:56:20.762949+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-09T09:56:20.762949+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.762949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:18.852462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.801725+0000","last_change":"2024-05-09T09:56:14.801764+0000","last_active":"2024-05-09T09:56:14.801725+0000","last_peered":"2024-05-09T09:56:14.801725+0000","last_clean":"2024-05-09T09:56:14.801725+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:56:14.801725+0000","last_undegraded":"2024-05-09T09:56:14.801725+0000","last_fullsized":"2024-05-09T09:56:14.801725+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:14.801605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:14.801605+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.801605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:17.157145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015209+0000","last_change":"2024-05-09T09:53:01.052809+0000","last_active":"2024-05-09T09:55:58.015209+0000","last_peered":"2024-05-09T09:55:58.015209+0000","last_clean":"2024-05-09T09:55:58.015209+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:55:58.015209+0000","last_undegraded":"2024-05-09T09:55:58.015209+0000","last_fullsized":"2024-05-09T09:55:58.015209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'14","reported_seq":245,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.208123+0000","last_change":"2024-05-09T09:55:42.599407+0000","last_active":"2024-05-09T09:56:08.208123+0000","last_peered":"2024-05-09T09:56:08.208123+0000","last_clean":"2024-05-09T09:56:08.208123+0000","last_became_active":"2024-05-09T09:55:41.489210+0000","last_became_peered":"2024-05-09T09:55:41.489210+0000","last_unstale":"2024-05-09T09:56:08.208123+0000","last_undegraded":"2024-05-09T09:56:08.208123+0000","last_fullsized":"2024-05-09T09:56:08.208123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":14,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.920294+0000","last_change":"2024-05-09T09:56:24.920397+0000","last_active":"2024-05-09T09:56:24.920294+0000","last_peered":"2024-05-09T09:56:24.920294+0000","last_clean":"2024-05-09T09:56:24.920294+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:56:24.920294+0000","last_undegraded":"2024-05-09T09:56:24.920294+0000","last_fullsized":"2024-05-09T09:56:24.920294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.920011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.920011+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.920011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:02.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'80","reported_seq":308,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.388236+0000","last_change":"2024-05-09T09:56:13.388275+0000","last_active":"2024-05-09T09:56:13.388236+0000","last_peered":"2024-05-09T09:56:13.388236+0000","last_clean":"2024-05-09T09:56:13.388236+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:56:13.388236+0000","last_undegraded":"2024-05-09T09:56:13.388236+0000","last_fullsized":"2024-05-09T09:56:13.388236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'80","last_scrub_stamp":"2024-05-09T09:56:13.388167+0000","last_deep_scrub":"95'80","last_deep_scrub_stamp":"2024-05-09T09:56:13.388167+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.388167+0000","objects_scrubbed":10,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:09:08.070579+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":182,"num_write":70,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.856635+0000","last_change":"2024-05-09T09:56:21.856688+0000","last_active":"2024-05-09T09:56:21.856635+0000","last_peered":"2024-05-09T09:56:21.856635+0000","last_clean":"2024-05-09T09:56:21.856635+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:56:21.856635+0000","last_undegraded":"2024-05-09T09:56:21.856635+0000","last_fullsized":"2024-05-09T09:56:21.856635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.856436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.856436+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.856436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:43:14.049981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.418150+0000","last_change":"2024-05-09T09:56:22.418210+0000","last_active":"2024-05-09T09:56:22.418150+0000","last_peered":"2024-05-09T09:56:22.418150+0000","last_clean":"2024-05-09T09:56:22.418150+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:56:22.418150+0000","last_undegraded":"2024-05-09T09:56:22.418150+0000","last_fullsized":"2024-05-09T09:56:22.418150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:22.417926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:22.417926+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.417926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:49:33.782084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'46","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704683+0000","last_change":"2024-05-09T09:53:09.114831+0000","last_active":"2024-05-09T09:55:56.704683+0000","last_peered":"2024-05-09T09:55:56.704683+0000","last_clean":"2024-05-09T09:55:56.704683+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:55:56.704683+0000","last_undegraded":"2024-05-09T09:55:56.704683+0000","last_fullsized":"2024-05-09T09:55:56.704683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.577352+0000","last_change":"2024-05-09T09:56:14.577435+0000","last_active":"2024-05-09T09:56:14.577352+0000","last_peered":"2024-05-09T09:56:14.577352+0000","last_clean":"2024-05-09T09:56:14.577352+0000","last_became_active":"2024-05-09T09:55:10.500197+0000","last_became_peered":"2024-05-09T09:55:10.500197+0000","last_unstale":"2024-05-09T09:56:14.577352+0000","last_undegraded":"2024-05-09T09:56:14.577352+0000","last_fullsized":"2024-05-09T09:56:14.577352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:14.577154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:14.577154+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.577154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:22.117427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'22","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.551968+0000","last_change":"2024-05-09T09:56:27.552028+0000","last_active":"2024-05-09T09:56:27.551968+0000","last_peered":"2024-05-09T09:56:27.551968+0000","last_clean":"2024-05-09T09:56:27.551968+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:56:27.551968+0000","last_undegraded":"2024-05-09T09:56:27.551968+0000","last_fullsized":"2024-05-09T09:56:27.551968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-05-09T09:56:27.551778+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-05-09T09:56:27.551778+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.551778+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:57.597266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"95'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.630903+0000","last_change":"2024-05-09T09:56:22.631081+0000","last_active":"2024-05-09T09:56:22.630903+0000","last_peered":"2024-05-09T09:56:22.630903+0000","last_clean":"2024-05-09T09:56:22.630903+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:56:22.630903+0000","last_undegraded":"2024-05-09T09:56:22.630903+0000","last_fullsized":"2024-05-09T09:56:22.630903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-05-09T09:56:22.630673+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-05-09T09:56:22.630673+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.630673+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:04.621784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'23","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.899967+0000","last_change":"2024-05-09T09:56:18.900063+0000","last_active":"2024-05-09T09:56:18.899967+0000","last_peered":"2024-05-09T09:56:18.899967+0000","last_clean":"2024-05-09T09:56:18.899967+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:56:18.899967+0000","last_undegraded":"2024-05-09T09:56:18.899967+0000","last_fullsized":"2024-05-09T09:56:18.899967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'23","last_scrub_stamp":"2024-05-09T09:56:18.899773+0000","last_deep_scrub":"95'23","last_deep_scrub_stamp":"2024-05-09T09:56:18.899773+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.899773+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:01:42.671076+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.704414+0000","last_change":"2024-05-09T09:55:41.486659+0000","last_active":"2024-05-09T09:55:56.704414+0000","last_peered":"2024-05-09T09:55:56.704414+0000","last_clean":"2024-05-09T09:55:56.704414+0000","last_became_active":"2024-05-09T09:55:41.486383+0000","last_became_peered":"2024-05-09T09:55:41.486383+0000","last_unstale":"2024-05-09T09:55:56.704414+0000","last_undegraded":"2024-05-09T09:55:56.704414+0000","last_fullsized":"2024-05-09T09:55:56.704414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"75'2","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013282+0000","last_change":"2024-05-09T09:55:44.856823+0000","last_active":"2024-05-09T09:55:58.013282+0000","last_peered":"2024-05-09T09:55:58.013282+0000","last_clean":"2024-05-09T09:55:58.013282+0000","last_became_active":"2024-05-09T09:55:41.512553+0000","last_became_peered":"2024-05-09T09:55:41.512553+0000","last_unstale":"2024-05-09T09:55:58.013282+0000","last_undegraded":"2024-05-09T09:55:58.013282+0000","last_fullsized":"2024-05-09T09:55:58.013282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401886+0000","last_change":"2024-05-09T09:54:55.401865+0000","last_active":"2024-05-09T09:55:57.401886+0000","last_peered":"2024-05-09T09:55:57.401886+0000","last_clean":"2024-05-09T09:55:57.401886+0000","last_became_active":"2024-05-09T09:54:55.401038+0000","last_became_peered":"2024-05-09T09:54:55.401038+0000","last_unstale":"2024-05-09T09:55:57.401886+0000","last_undegraded":"2024-05-09T09:55:57.401886+0000","last_fullsized":"2024-05-09T09:55:57.401886+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400037+0000","last_change":"2024-05-09T09:53:01.053056+0000","last_active":"2024-05-09T09:55:57.400037+0000","last_peered":"2024-05-09T09:55:57.400037+0000","last_clean":"2024-05-09T09:55:57.400037+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:55:57.400037+0000","last_undegraded":"2024-05-09T09:55:57.400037+0000","last_fullsized":"2024-05-09T09:55:57.400037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'16","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.246894+0000","last_change":"2024-05-09T09:55:41.719143+0000","last_active":"2024-05-09T09:56:08.246894+0000","last_peered":"2024-05-09T09:56:08.246894+0000","last_clean":"2024-05-09T09:56:08.246894+0000","last_became_active":"2024-05-09T09:55:41.469663+0000","last_became_peered":"2024-05-09T09:55:41.469663+0000","last_unstale":"2024-05-09T09:56:08.246894+0000","last_undegraded":"2024-05-09T09:56:08.246894+0000","last_fullsized":"2024-05-09T09:56:08.246894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.810409+0000","last_change":"2024-05-09T09:56:27.810519+0000","last_active":"2024-05-09T09:56:27.810409+0000","last_peered":"2024-05-09T09:56:27.810409+0000","last_clean":"2024-05-09T09:56:27.810409+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:56:27.810409+0000","last_undegraded":"2024-05-09T09:56:27.810409+0000","last_fullsized":"2024-05-09T09:56:27.810409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:27.810186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:27.810186+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.810186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:06.192483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"30'12","reported_seq":81,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015439+0000","last_change":"2024-05-09T09:55:42.823551+0000","last_active":"2024-05-09T09:55:58.015439+0000","last_peered":"2024-05-09T09:55:58.015439+0000","last_clean":"2024-05-09T09:55:58.015439+0000","last_became_active":"2024-05-09T09:55:41.504368+0000","last_became_peered":"2024-05-09T09:55:41.504368+0000","last_unstale":"2024-05-09T09:55:58.015439+0000","last_undegraded":"2024-05-09T09:55:58.015439+0000","last_fullsized":"2024-05-09T09:55:58.015439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.773532+0000","last_change":"2024-05-09T09:56:15.773651+0000","last_active":"2024-05-09T09:56:15.773532+0000","last_peered":"2024-05-09T09:56:15.773532+0000","last_clean":"2024-05-09T09:56:15.773532+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:56:15.773532+0000","last_undegraded":"2024-05-09T09:56:15.773532+0000","last_fullsized":"2024-05-09T09:56:15.773532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:15.773302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:15.773302+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.773302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:17.217863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400289+0000","last_change":"2024-05-09T09:55:10.495545+0000","last_active":"2024-05-09T09:55:57.400289+0000","last_peered":"2024-05-09T09:55:57.400289+0000","last_clean":"2024-05-09T09:55:57.400289+0000","last_became_active":"2024-05-09T09:55:10.494741+0000","last_became_peered":"2024-05-09T09:55:10.494741+0000","last_unstale":"2024-05-09T09:55:57.400289+0000","last_undegraded":"2024-05-09T09:55:57.400289+0000","last_fullsized":"2024-05-09T09:55:57.400289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703619+0000","last_change":"2024-05-09T09:53:09.115111+0000","last_active":"2024-05-09T09:55:56.703619+0000","last_peered":"2024-05-09T09:55:56.703619+0000","last_clean":"2024-05-09T09:55:56.703619+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:55:56.703619+0000","last_undegraded":"2024-05-09T09:55:56.703619+0000","last_fullsized":"2024-05-09T09:55:56.703619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'20","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.003143+0000","last_change":"2024-05-09T09:56:16.003205+0000","last_active":"2024-05-09T09:56:16.003143+0000","last_peered":"2024-05-09T09:56:16.003143+0000","last_clean":"2024-05-09T09:56:16.003143+0000","last_became_active":"2024-05-09T09:55:10.494626+0000","last_became_peered":"2024-05-09T09:55:10.494626+0000","last_unstale":"2024-05-09T09:56:16.003143+0000","last_undegraded":"2024-05-09T09:56:16.003143+0000","last_fullsized":"2024-05-09T09:56:16.003143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:16.002954+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:16.002954+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.002954+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:16:57.214582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30738,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.479481+0000","last_change":"2024-05-09T09:56:25.479587+0000","last_active":"2024-05-09T09:56:25.479481+0000","last_peered":"2024-05-09T09:56:25.479481+0000","last_clean":"2024-05-09T09:56:25.479481+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:56:25.479481+0000","last_undegraded":"2024-05-09T09:56:25.479481+0000","last_fullsized":"2024-05-09T09:56:25.479481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:25.479189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:25.479189+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.479189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:09:31.106352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.807358+0000","last_change":"2024-05-09T09:56:25.807414+0000","last_active":"2024-05-09T09:56:25.807358+0000","last_peered":"2024-05-09T09:56:25.807358+0000","last_clean":"2024-05-09T09:56:25.807358+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:56:25.807358+0000","last_undegraded":"2024-05-09T09:56:25.807358+0000","last_fullsized":"2024-05-09T09:56:25.807358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:25.807143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:25.807143+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.807143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:10:50.469762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'40","reported_seq":260,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.800424+0000","last_change":"2024-05-09T09:55:10.807327+0000","last_active":"2024-05-09T09:56:07.800424+0000","last_peered":"2024-05-09T09:56:07.800424+0000","last_clean":"2024-05-09T09:56:07.800424+0000","last_became_active":"2024-05-09T09:55:10.495540+0000","last_became_peered":"2024-05-09T09:55:10.495540+0000","last_unstale":"2024-05-09T09:56:07.800424+0000","last_undegraded":"2024-05-09T09:56:07.800424+0000","last_fullsized":"2024-05-09T09:56:07.800424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":75,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":3221,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.066543+0000","last_change":"2024-05-09T09:56:28.066599+0000","last_active":"2024-05-09T09:56:28.066543+0000","last_peered":"2024-05-09T09:56:28.066543+0000","last_clean":"2024-05-09T09:56:28.066543+0000","last_became_active":"2024-05-09T09:55:41.496466+0000","last_became_peered":"2024-05-09T09:55:41.496466+0000","last_unstale":"2024-05-09T09:56:28.066543+0000","last_undegraded":"2024-05-09T09:56:28.066543+0000","last_fullsized":"2024-05-09T09:56:28.066543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.066350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.066350+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.066350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:58.403897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.775627+0000","last_change":"2024-05-09T09:56:15.775686+0000","last_active":"2024-05-09T09:56:15.775627+0000","last_peered":"2024-05-09T09:56:15.775627+0000","last_clean":"2024-05-09T09:56:15.775627+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:56:15.775627+0000","last_undegraded":"2024-05-09T09:56:15.775627+0000","last_fullsized":"2024-05-09T09:56:15.775627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:15.775435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:15.775435+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.775435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:00.122066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705333+0000","last_change":"2024-05-09T09:53:09.124687+0000","last_active":"2024-05-09T09:55:56.705333+0000","last_peered":"2024-05-09T09:55:56.705333+0000","last_clean":"2024-05-09T09:55:56.705333+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:55:56.705333+0000","last_undegraded":"2024-05-09T09:55:56.705333+0000","last_fullsized":"2024-05-09T09:55:56.705333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'12","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.554372+0000","last_change":"2024-05-09T09:56:28.554431+0000","last_active":"2024-05-09T09:56:28.554372+0000","last_peered":"2024-05-09T09:56:28.554372+0000","last_clean":"2024-05-09T09:56:28.554372+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:56:28.554372+0000","last_undegraded":"2024-05-09T09:56:28.554372+0000","last_fullsized":"2024-05-09T09:56:28.554372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:28.554187+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:28.554187+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.554187+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:58.403451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22546,"num_write":42,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015603+0000","last_change":"2024-05-09T09:53:01.056570+0000","last_active":"2024-05-09T09:55:58.015603+0000","last_peered":"2024-05-09T09:55:58.015603+0000","last_clean":"2024-05-09T09:55:58.015603+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:55:58.015603+0000","last_undegraded":"2024-05-09T09:55:58.015603+0000","last_fullsized":"2024-05-09T09:55:58.015603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:00.029602+0000","last_clean_scrub_stamp":"2024-05-09T09:53:00.029602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.714673+0000","last_change":"2024-05-09T09:56:19.714727+0000","last_active":"2024-05-09T09:56:19.714673+0000","last_peered":"2024-05-09T09:56:19.714673+0000","last_clean":"2024-05-09T09:56:19.714673+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:56:19.714673+0000","last_undegraded":"2024-05-09T09:56:19.714673+0000","last_fullsized":"2024-05-09T09:56:19.714673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:19.714478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:19.714478+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.714478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:07.323842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"95'21","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:12.381471+0000","last_change":"2024-05-09T09:56:12.381533+0000","last_active":"2024-05-09T09:56:12.381471+0000","last_peered":"2024-05-09T09:56:12.381471+0000","last_clean":"2024-05-09T09:56:12.381471+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:56:12.381471+0000","last_undegraded":"2024-05-09T09:56:12.381471+0000","last_fullsized":"2024-05-09T09:56:12.381471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-05-09T09:56:12.381382+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-05-09T09:56:12.381382+0000","last_clean_scrub_stamp":"2024-05-09T09:56:12.381382+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:02.941712+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'18","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.879620+0000","last_change":"2024-05-09T09:56:23.879684+0000","last_active":"2024-05-09T09:56:23.879620+0000","last_peered":"2024-05-09T09:56:23.879620+0000","last_clean":"2024-05-09T09:56:23.879620+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:56:23.879620+0000","last_undegraded":"2024-05-09T09:56:23.879620+0000","last_fullsized":"2024-05-09T09:56:23.879620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:23.879433+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:23.879433+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.879433+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:03.546682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018357+0000","last_change":"2024-05-09T09:55:10.517397+0000","last_active":"2024-05-09T09:55:58.018357+0000","last_peered":"2024-05-09T09:55:58.018357+0000","last_clean":"2024-05-09T09:55:58.018357+0000","last_became_active":"2024-05-09T09:55:10.515588+0000","last_became_peered":"2024-05-09T09:55:10.515588+0000","last_unstale":"2024-05-09T09:55:58.018357+0000","last_undegraded":"2024-05-09T09:55:58.018357+0000","last_fullsized":"2024-05-09T09:55:58.018357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"75'44","reported_seq":65,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.335282+0000","last_change":"2024-05-09T09:56:14.335305+0000","last_active":"2024-05-09T09:56:14.335282+0000","last_peered":"2024-05-09T09:56:14.335282+0000","last_clean":"2024-05-09T09:56:14.335282+0000","last_became_active":"2024-05-09T09:55:10.518766+0000","last_became_peered":"2024-05-09T09:55:10.518766+0000","last_unstale":"2024-05-09T09:56:14.335282+0000","last_undegraded":"2024-05-09T09:56:14.335282+0000","last_fullsized":"2024-05-09T09:56:14.335282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'44","last_scrub_stamp":"2024-05-09T09:56:14.335184+0000","last_deep_scrub":"75'44","last_deep_scrub_stamp":"2024-05-09T09:56:14.335184+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.335184+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:50:52.481059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":112,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"95'20","reported_seq":77,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.208914+0000","last_change":"2024-05-09T09:55:11.060481+0000","last_active":"2024-05-09T09:56:08.208914+0000","last_peered":"2024-05-09T09:56:08.208914+0000","last_clean":"2024-05-09T09:56:08.208914+0000","last_became_active":"2024-05-09T09:55:10.509265+0000","last_became_peered":"2024-05-09T09:55:10.509265+0000","last_unstale":"2024-05-09T09:56:08.208914+0000","last_undegraded":"2024-05-09T09:56:08.208914+0000","last_fullsized":"2024-05-09T09:56:08.208914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16398,"num_write":50,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.435409+0000","last_change":"2024-05-09T09:56:24.435465+0000","last_active":"2024-05-09T09:56:24.435409+0000","last_peered":"2024-05-09T09:56:24.435409+0000","last_clean":"2024-05-09T09:56:24.435409+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:56:24.435409+0000","last_undegraded":"2024-05-09T09:56:24.435409+0000","last_fullsized":"2024-05-09T09:56:24.435409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.435217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.435217+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.435217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:15.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.988325+0000","last_change":"2024-05-09T09:56:23.988379+0000","last_active":"2024-05-09T09:56:23.988325+0000","last_peered":"2024-05-09T09:56:23.988325+0000","last_clean":"2024-05-09T09:56:23.988325+0000","last_became_active":"2024-05-09T09:55:41.498766+0000","last_became_peered":"2024-05-09T09:55:41.498766+0000","last_unstale":"2024-05-09T09:56:23.988325+0000","last_undegraded":"2024-05-09T09:56:23.988325+0000","last_fullsized":"2024-05-09T09:56:23.988325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.988135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.988135+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.988135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:54.033623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705412+0000","last_change":"2024-05-09T09:55:42.422831+0000","last_active":"2024-05-09T09:55:56.705412+0000","last_peered":"2024-05-09T09:55:56.705412+0000","last_clean":"2024-05-09T09:55:56.705412+0000","last_became_active":"2024-05-09T09:55:41.513003+0000","last_became_peered":"2024-05-09T09:55:41.513003+0000","last_unstale":"2024-05-09T09:55:56.705412+0000","last_undegraded":"2024-05-09T09:55:56.705412+0000","last_fullsized":"2024-05-09T09:55:56.705412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'21","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.273463+0000","last_change":"2024-05-09T09:55:10.808760+0000","last_active":"2024-05-09T09:56:08.273463+0000","last_peered":"2024-05-09T09:56:08.273463+0000","last_clean":"2024-05-09T09:56:08.273463+0000","last_became_active":"2024-05-09T09:55:10.505477+0000","last_became_peered":"2024-05-09T09:55:10.505477+0000","last_unstale":"2024-05-09T09:56:08.273463+0000","last_undegraded":"2024-05-09T09:56:08.273463+0000","last_fullsized":"2024-05-09T09:56:08.273463+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:11.784247+0000","last_change":"2024-05-09T09:56:11.784311+0000","last_active":"2024-05-09T09:56:11.784247+0000","last_peered":"2024-05-09T09:56:11.784247+0000","last_clean":"2024-05-09T09:56:11.784247+0000","last_became_active":"2024-05-09T09:55:10.494445+0000","last_became_peered":"2024-05-09T09:55:10.494445+0000","last_unstale":"2024-05-09T09:56:11.784247+0000","last_undegraded":"2024-05-09T09:56:11.784247+0000","last_fullsized":"2024-05-09T09:56:11.784247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:11.784030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:11.784030+0000","last_clean_scrub_stamp":"2024-05-09T09:56:11.784030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:33.505969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'10","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.850428+0000","last_change":"2024-05-09T09:56:14.850489+0000","last_active":"2024-05-09T09:56:14.850428+0000","last_peered":"2024-05-09T09:56:14.850428+0000","last_clean":"2024-05-09T09:56:14.850428+0000","last_became_active":"2024-05-09T09:55:41.480316+0000","last_became_peered":"2024-05-09T09:55:41.480316+0000","last_unstale":"2024-05-09T09:56:14.850428+0000","last_undegraded":"2024-05-09T09:56:14.850428+0000","last_fullsized":"2024-05-09T09:56:14.850428+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'10","last_scrub_stamp":"2024-05-09T09:56:14.850233+0000","last_deep_scrub":"63'10","last_deep_scrub_stamp":"2024-05-09T09:56:14.850233+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.850233+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:58.502827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'22","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.236279+0000","last_change":"2024-05-09T09:53:07.098582+0000","last_active":"2024-05-09T09:56:08.236279+0000","last_peered":"2024-05-09T09:56:08.236279+0000","last_clean":"2024-05-09T09:56:08.236279+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:56:08.236279+0000","last_undegraded":"2024-05-09T09:56:08.236279+0000","last_fullsized":"2024-05-09T09:56:08.236279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.824260+0000","last_change":"2024-05-09T09:56:24.824411+0000","last_active":"2024-05-09T09:56:24.824260+0000","last_peered":"2024-05-09T09:56:24.824260+0000","last_clean":"2024-05-09T09:56:24.824260+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:56:24.824260+0000","last_undegraded":"2024-05-09T09:56:24.824260+0000","last_fullsized":"2024-05-09T09:56:24.824260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.823957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.823957+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.823957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:21:57.635076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.368612+0000","last_change":"2024-05-09T09:56:28.368731+0000","last_active":"2024-05-09T09:56:28.368612+0000","last_peered":"2024-05-09T09:56:28.368612+0000","last_clean":"2024-05-09T09:56:28.368612+0000","last_became_active":"2024-05-09T09:55:10.505544+0000","last_became_peered":"2024-05-09T09:55:10.505544+0000","last_unstale":"2024-05-09T09:56:28.368612+0000","last_undegraded":"2024-05-09T09:56:28.368612+0000","last_fullsized":"2024-05-09T09:56:28.368612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.368363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.368363+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.368363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:28:14.775391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'55","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.936305+0000","last_change":"2024-05-09T09:56:17.936405+0000","last_active":"2024-05-09T09:56:17.936305+0000","last_peered":"2024-05-09T09:56:17.936305+0000","last_clean":"2024-05-09T09:56:17.936305+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:56:17.936305+0000","last_undegraded":"2024-05-09T09:56:17.936305+0000","last_fullsized":"2024-05-09T09:56:17.936305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'55","last_scrub_stamp":"2024-05-09T09:56:17.936080+0000","last_deep_scrub":"95'55","last_deep_scrub_stamp":"2024-05-09T09:56:17.936080+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.936080+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:21:50.747199+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":80,"num_read_kb":110,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013619+0000","last_change":"2024-05-09T09:55:10.498516+0000","last_active":"2024-05-09T09:55:58.013619+0000","last_peered":"2024-05-09T09:55:58.013619+0000","last_clean":"2024-05-09T09:55:58.013619+0000","last_became_active":"2024-05-09T09:55:10.498080+0000","last_became_peered":"2024-05-09T09:55:10.498080+0000","last_unstale":"2024-05-09T09:55:58.013619+0000","last_undegraded":"2024-05-09T09:55:58.013619+0000","last_fullsized":"2024-05-09T09:55:58.013619+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'2","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.969769+0000","last_change":"2024-05-09T09:56:25.969841+0000","last_active":"2024-05-09T09:56:25.969769+0000","last_peered":"2024-05-09T09:56:25.969769+0000","last_clean":"2024-05-09T09:56:25.969769+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:56:25.969769+0000","last_undegraded":"2024-05-09T09:56:25.969769+0000","last_fullsized":"2024-05-09T09:56:25.969769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-05-09T09:56:25.969575+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-05-09T09:56:25.969575+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.969575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:29:10.177967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.776336+0000","last_change":"2024-05-09T09:56:17.776396+0000","last_active":"2024-05-09T09:56:17.776336+0000","last_peered":"2024-05-09T09:56:17.776336+0000","last_clean":"2024-05-09T09:56:17.776336+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:56:17.776336+0000","last_undegraded":"2024-05-09T09:56:17.776336+0000","last_fullsized":"2024-05-09T09:56:17.776336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:17.776127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:17.776127+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.776127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:18.085682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705042+0000","last_change":"2024-05-09T09:55:42.429944+0000","last_active":"2024-05-09T09:55:56.705042+0000","last_peered":"2024-05-09T09:55:56.705042+0000","last_clean":"2024-05-09T09:55:56.705042+0000","last_became_active":"2024-05-09T09:55:41.516290+0000","last_became_peered":"2024-05-09T09:55:41.516290+0000","last_unstale":"2024-05-09T09:55:56.705042+0000","last_undegraded":"2024-05-09T09:55:56.705042+0000","last_fullsized":"2024-05-09T09:55:56.705042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'16","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.916572+0000","last_change":"2024-05-09T09:56:16.916715+0000","last_active":"2024-05-09T09:56:16.916572+0000","last_peered":"2024-05-09T09:56:16.916572+0000","last_clean":"2024-05-09T09:56:16.916572+0000","last_became_active":"2024-05-09T09:55:41.489973+0000","last_became_peered":"2024-05-09T09:55:41.489973+0000","last_unstale":"2024-05-09T09:56:16.916572+0000","last_undegraded":"2024-05-09T09:56:16.916572+0000","last_fullsized":"2024-05-09T09:56:16.916572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:16.916318+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:16.916318+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.916318+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:32.278440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":30736,"num_write":46,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.403175+0000","last_change":"2024-05-09T09:56:17.403235+0000","last_active":"2024-05-09T09:56:17.403175+0000","last_peered":"2024-05-09T09:56:17.403175+0000","last_clean":"2024-05-09T09:56:17.403175+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:56:17.403175+0000","last_undegraded":"2024-05-09T09:56:17.403175+0000","last_fullsized":"2024-05-09T09:56:17.403175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:17.402949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:17.402949+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.402949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:21:50.214069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'23","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.003081+0000","last_change":"2024-05-09T09:55:10.932387+0000","last_active":"2024-05-09T09:56:08.003081+0000","last_peered":"2024-05-09T09:56:08.003081+0000","last_clean":"2024-05-09T09:56:08.003081+0000","last_became_active":"2024-05-09T09:55:10.507307+0000","last_became_peered":"2024-05-09T09:55:10.507307+0000","last_unstale":"2024-05-09T09:56:08.003081+0000","last_undegraded":"2024-05-09T09:56:08.003081+0000","last_fullsized":"2024-05-09T09:56:08.003081+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":48,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.414085+0000","last_change":"2024-05-09T09:56:26.414146+0000","last_active":"2024-05-09T09:56:26.414085+0000","last_peered":"2024-05-09T09:56:26.414085+0000","last_clean":"2024-05-09T09:56:26.414085+0000","last_became_active":"2024-05-09T09:55:10.518305+0000","last_became_peered":"2024-05-09T09:55:10.518305+0000","last_unstale":"2024-05-09T09:56:26.414085+0000","last_undegraded":"2024-05-09T09:56:26.414085+0000","last_fullsized":"2024-05-09T09:56:26.414085+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.413869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.413869+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.413869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:10.539726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.018061+0000","last_change":"2024-05-09T09:55:10.505287+0000","last_active":"2024-05-09T09:55:58.018061+0000","last_peered":"2024-05-09T09:55:58.018061+0000","last_clean":"2024-05-09T09:55:58.018061+0000","last_became_active":"2024-05-09T09:55:10.504822+0000","last_became_peered":"2024-05-09T09:55:10.504822+0000","last_unstale":"2024-05-09T09:55:58.018061+0000","last_undegraded":"2024-05-09T09:55:58.018061+0000","last_fullsized":"2024-05-09T09:55:58.018061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.953410+0000","last_change":"2024-05-09T09:56:16.953469+0000","last_active":"2024-05-09T09:56:16.953410+0000","last_peered":"2024-05-09T09:56:16.953410+0000","last_clean":"2024-05-09T09:56:16.953410+0000","last_became_active":"2024-05-09T09:54:55.398970+0000","last_became_peered":"2024-05-09T09:54:55.398970+0000","last_unstale":"2024-05-09T09:56:16.953410+0000","last_undegraded":"2024-05-09T09:56:16.953410+0000","last_fullsized":"2024-05-09T09:56:16.953410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.953217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.953217+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.953217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:24.297227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"95'14","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.915500+0000","last_change":"2024-05-09T09:56:14.915700+0000","last_active":"2024-05-09T09:56:14.915500+0000","last_peered":"2024-05-09T09:56:14.915500+0000","last_clean":"2024-05-09T09:56:14.915500+0000","last_became_active":"2024-05-09T09:55:10.499847+0000","last_became_peered":"2024-05-09T09:55:10.499847+0000","last_unstale":"2024-05-09T09:56:14.915500+0000","last_undegraded":"2024-05-09T09:56:14.915500+0000","last_fullsized":"2024-05-09T09:56:14.915500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:14.915275+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:14.915275+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.915275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:13.004789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28690,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016835+0000","last_change":"2024-05-09T09:55:10.508325+0000","last_active":"2024-05-09T09:55:58.016835+0000","last_peered":"2024-05-09T09:55:58.016835+0000","last_clean":"2024-05-09T09:55:58.016835+0000","last_became_active":"2024-05-09T09:55:10.506831+0000","last_became_peered":"2024-05-09T09:55:10.506831+0000","last_unstale":"2024-05-09T09:55:58.016835+0000","last_undegraded":"2024-05-09T09:55:58.016835+0000","last_fullsized":"2024-05-09T09:55:58.016835+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"95'8","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.776530+0000","last_change":"2024-05-09T09:56:18.776603+0000","last_active":"2024-05-09T09:56:18.776530+0000","last_peered":"2024-05-09T09:56:18.776530+0000","last_clean":"2024-05-09T09:56:18.776530+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:56:18.776530+0000","last_undegraded":"2024-05-09T09:56:18.776530+0000","last_fullsized":"2024-05-09T09:56:18.776530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-05-09T09:56:18.776333+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-05-09T09:56:18.776333+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.776333+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:48.821821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.956126+0000","last_change":"2024-05-09T09:56:27.956181+0000","last_active":"2024-05-09T09:56:27.956126+0000","last_peered":"2024-05-09T09:56:27.956126+0000","last_clean":"2024-05-09T09:56:27.956126+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:56:27.956126+0000","last_undegraded":"2024-05-09T09:56:27.956126+0000","last_fullsized":"2024-05-09T09:56:27.956126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:27.955920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:27.955920+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.955920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:58.001408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.700819+0000","last_change":"2024-05-09T09:53:17.178889+0000","last_active":"2024-05-09T09:55:56.700819+0000","last_peered":"2024-05-09T09:55:56.700819+0000","last_clean":"2024-05-09T09:55:56.700819+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:55:56.700819+0000","last_undegraded":"2024-05-09T09:55:56.700819+0000","last_fullsized":"2024-05-09T09:55:56.700819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.013487+0000","last_change":"2024-05-09T09:55:10.514293+0000","last_active":"2024-05-09T09:55:58.013487+0000","last_peered":"2024-05-09T09:55:58.013487+0000","last_clean":"2024-05-09T09:55:58.013487+0000","last_became_active":"2024-05-09T09:55:10.513915+0000","last_became_peered":"2024-05-09T09:55:10.513915+0000","last_unstale":"2024-05-09T09:55:58.013487+0000","last_undegraded":"2024-05-09T09:55:58.013487+0000","last_fullsized":"2024-05-09T09:55:58.013487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'18","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.178332+0000","last_change":"2024-05-09T09:53:07.124396+0000","last_active":"2024-05-09T09:56:08.178332+0000","last_peered":"2024-05-09T09:56:08.178332+0000","last_clean":"2024-05-09T09:56:08.178332+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:56:08.178332+0000","last_undegraded":"2024-05-09T09:56:08.178332+0000","last_fullsized":"2024-05-09T09:56:08.178332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.316337+0000","last_change":"2024-05-09T09:55:42.066725+0000","last_active":"2024-05-09T09:56:07.316337+0000","last_peered":"2024-05-09T09:56:07.316337+0000","last_clean":"2024-05-09T09:56:07.316337+0000","last_became_active":"2024-05-09T09:55:41.506927+0000","last_became_peered":"2024-05-09T09:55:41.506927+0000","last_unstale":"2024-05-09T09:56:07.316337+0000","last_undegraded":"2024-05-09T09:56:07.316337+0000","last_fullsized":"2024-05-09T09:56:07.316337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'29","reported_seq":81,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.316721+0000","last_change":"2024-05-09T09:56:19.316813+0000","last_active":"2024-05-09T09:56:19.316721+0000","last_peered":"2024-05-09T09:56:19.316721+0000","last_clean":"2024-05-09T09:56:19.316721+0000","last_became_active":"2024-05-09T09:55:10.507511+0000","last_became_peered":"2024-05-09T09:55:10.507511+0000","last_unstale":"2024-05-09T09:56:19.316721+0000","last_undegraded":"2024-05-09T09:56:19.316721+0000","last_fullsized":"2024-05-09T09:56:19.316721+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-05-09T09:56:19.316528+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-05-09T09:56:19.316528+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.316528+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:13.896163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":70,"num_write":28,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.737486+0000","last_change":"2024-05-09T09:56:16.737542+0000","last_active":"2024-05-09T09:56:16.737486+0000","last_peered":"2024-05-09T09:56:16.737486+0000","last_clean":"2024-05-09T09:56:16.737486+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:56:16.737486+0000","last_undegraded":"2024-05-09T09:56:16.737486+0000","last_fullsized":"2024-05-09T09:56:16.737486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.737271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.737271+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.737271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:06.379489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.963854+0000","last_change":"2024-05-09T09:56:27.964022+0000","last_active":"2024-05-09T09:56:27.963854+0000","last_peered":"2024-05-09T09:56:27.963854+0000","last_clean":"2024-05-09T09:56:27.963854+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:56:27.963854+0000","last_undegraded":"2024-05-09T09:56:27.963854+0000","last_fullsized":"2024-05-09T09:56:27.963854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-05-09T09:56:27.963622+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-05-09T09:56:27.963622+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.963622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:41.711059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'38","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.267817+0000","last_change":"2024-05-09T09:56:17.267884+0000","last_active":"2024-05-09T09:56:17.267817+0000","last_peered":"2024-05-09T09:56:17.267817+0000","last_clean":"2024-05-09T09:56:17.267817+0000","last_became_active":"2024-05-09T09:55:10.520941+0000","last_became_peered":"2024-05-09T09:55:10.520941+0000","last_unstale":"2024-05-09T09:56:17.267817+0000","last_undegraded":"2024-05-09T09:56:17.267817+0000","last_fullsized":"2024-05-09T09:56:17.267817+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-05-09T09:56:17.267613+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-05-09T09:56:17.267613+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.267613+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:50:34.317978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.177177+0000","last_change":"2024-05-09T09:53:07.117812+0000","last_active":"2024-05-09T09:56:08.177177+0000","last_peered":"2024-05-09T09:56:08.177177+0000","last_clean":"2024-05-09T09:56:08.177177+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:56:08.177177+0000","last_undegraded":"2024-05-09T09:56:08.177177+0000","last_fullsized":"2024-05-09T09:56:08.177177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.298316+0000","last_change":"2024-05-09T09:55:41.515909+0000","last_active":"2024-05-09T09:55:57.298316+0000","last_peered":"2024-05-09T09:55:57.298316+0000","last_clean":"2024-05-09T09:55:57.298316+0000","last_became_active":"2024-05-09T09:55:41.514849+0000","last_became_peered":"2024-05-09T09:55:41.514849+0000","last_unstale":"2024-05-09T09:55:57.298316+0000","last_undegraded":"2024-05-09T09:55:57.298316+0000","last_fullsized":"2024-05-09T09:55:57.298316+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'22","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.891914+0000","last_change":"2024-05-09T09:56:22.892098+0000","last_active":"2024-05-09T09:56:22.891914+0000","last_peered":"2024-05-09T09:56:22.891914+0000","last_clean":"2024-05-09T09:56:22.891914+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:56:22.891914+0000","last_undegraded":"2024-05-09T09:56:22.891914+0000","last_fullsized":"2024-05-09T09:56:22.891914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-05-09T09:56:22.891669+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-05-09T09:56:22.891669+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.891669+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:49:34.255827+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.795823+0000","last_change":"2024-05-09T09:56:20.795879+0000","last_active":"2024-05-09T09:56:20.795823+0000","last_peered":"2024-05-09T09:56:20.795823+0000","last_clean":"2024-05-09T09:56:20.795823+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:56:20.795823+0000","last_undegraded":"2024-05-09T09:56:20.795823+0000","last_fullsized":"2024-05-09T09:56:20.795823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:20.795584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:20.795584+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.795584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:47.543645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299617+0000","last_change":"2024-05-09T09:53:09.114659+0000","last_active":"2024-05-09T09:55:57.299617+0000","last_peered":"2024-05-09T09:55:57.299617+0000","last_clean":"2024-05-09T09:55:57.299617+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:55:57.299617+0000","last_undegraded":"2024-05-09T09:55:57.299617+0000","last_fullsized":"2024-05-09T09:55:57.299617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'20","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.205992+0000","last_change":"2024-05-09T09:55:55.809479+0000","last_active":"2024-05-09T09:56:08.205992+0000","last_peered":"2024-05-09T09:56:08.205992+0000","last_clean":"2024-05-09T09:56:08.205992+0000","last_became_active":"2024-05-09T09:55:55.677234+0000","last_became_peered":"2024-05-09T09:55:55.677234+0000","last_unstale":"2024-05-09T09:56:08.205992+0000","last_undegraded":"2024-05-09T09:56:08.205992+0000","last_fullsized":"2024-05-09T09:56:08.205992+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8196,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706591+0000","last_change":"2024-05-09T09:53:11.113692+0000","last_active":"2024-05-09T09:55:56.706591+0000","last_peered":"2024-05-09T09:55:56.706591+0000","last_clean":"2024-05-09T09:55:56.706591+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:55:56.706591+0000","last_undegraded":"2024-05-09T09:55:56.706591+0000","last_fullsized":"2024-05-09T09:55:56.706591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'37","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.442851+0000","last_change":"2024-05-09T09:56:15.442943+0000","last_active":"2024-05-09T09:56:15.442851+0000","last_peered":"2024-05-09T09:56:15.442851+0000","last_clean":"2024-05-09T09:56:15.442851+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:56:15.442851+0000","last_undegraded":"2024-05-09T09:56:15.442851+0000","last_fullsized":"2024-05-09T09:56:15.442851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'37","last_scrub_stamp":"2024-05-09T09:56:15.442651+0000","last_deep_scrub":"95'37","last_deep_scrub_stamp":"2024-05-09T09:56:15.442651+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.442651+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:15.977669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":104,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.886059+0000","last_change":"2024-05-09T09:56:18.886133+0000","last_active":"2024-05-09T09:56:18.886059+0000","last_peered":"2024-05-09T09:56:18.886059+0000","last_clean":"2024-05-09T09:56:18.886059+0000","last_became_active":"2024-05-09T09:55:10.494186+0000","last_became_peered":"2024-05-09T09:55:10.494186+0000","last_unstale":"2024-05-09T09:56:18.886059+0000","last_undegraded":"2024-05-09T09:56:18.886059+0000","last_fullsized":"2024-05-09T09:56:18.886059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:18.885838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:18.885838+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.885838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:11:01.093395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.016749+0000","last_change":"2024-05-09T09:55:10.505728+0000","last_active":"2024-05-09T09:55:58.016749+0000","last_peered":"2024-05-09T09:55:58.016749+0000","last_clean":"2024-05-09T09:55:58.016749+0000","last_became_active":"2024-05-09T09:55:10.504907+0000","last_became_peered":"2024-05-09T09:55:10.504907+0000","last_unstale":"2024-05-09T09:55:58.016749+0000","last_undegraded":"2024-05-09T09:55:58.016749+0000","last_fullsized":"2024-05-09T09:55:58.016749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706312+0000","last_change":"2024-05-09T09:53:09.125873+0000","last_active":"2024-05-09T09:55:56.706312+0000","last_peered":"2024-05-09T09:55:56.706312+0000","last_clean":"2024-05-09T09:55:56.706312+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:55:56.706312+0000","last_undegraded":"2024-05-09T09:55:56.706312+0000","last_fullsized":"2024-05-09T09:55:56.706312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'6","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.163567+0000","last_change":"2024-05-09T09:55:10.559316+0000","last_active":"2024-05-09T09:56:08.163567+0000","last_peered":"2024-05-09T09:56:08.163567+0000","last_clean":"2024-05-09T09:56:08.163567+0000","last_became_active":"2024-05-09T09:55:10.497596+0000","last_became_peered":"2024-05-09T09:55:10.497596+0000","last_unstale":"2024-05-09T09:56:08.163567+0000","last_undegraded":"2024-05-09T09:56:08.163567+0000","last_fullsized":"2024-05-09T09:56:08.163567+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.299301+0000","last_change":"2024-05-09T09:55:41.513826+0000","last_active":"2024-05-09T09:55:57.299301+0000","last_peered":"2024-05-09T09:55:57.299301+0000","last_clean":"2024-05-09T09:55:57.299301+0000","last_became_active":"2024-05-09T09:55:41.513248+0000","last_became_peered":"2024-05-09T09:55:41.513248+0000","last_unstale":"2024-05-09T09:55:57.299301+0000","last_undegraded":"2024-05-09T09:55:57.299301+0000","last_fullsized":"2024-05-09T09:55:57.299301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'37","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.927734+0000","last_change":"2024-05-09T09:56:24.927816+0000","last_active":"2024-05-09T09:56:24.927734+0000","last_peered":"2024-05-09T09:56:24.927734+0000","last_clean":"2024-05-09T09:56:24.927734+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:56:24.927734+0000","last_undegraded":"2024-05-09T09:56:24.927734+0000","last_fullsized":"2024-05-09T09:56:24.927734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'37","last_scrub_stamp":"2024-05-09T09:56:24.927532+0000","last_deep_scrub":"95'37","last_deep_scrub_stamp":"2024-05-09T09:56:24.927532+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.927532+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:16.284884+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":51,"num_read_kb":77,"num_write":36,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.399693+0000","last_change":"2024-05-09T09:56:16.399811+0000","last_active":"2024-05-09T09:56:16.399693+0000","last_peered":"2024-05-09T09:56:16.399693+0000","last_clean":"2024-05-09T09:56:16.399693+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:56:16.399693+0000","last_undegraded":"2024-05-09T09:56:16.399693+0000","last_fullsized":"2024-05-09T09:56:16.399693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.399437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.399437+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.399437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:23.743447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"63'4","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.676916+0000","last_change":"2024-05-09T09:56:18.676981+0000","last_active":"2024-05-09T09:56:18.676916+0000","last_peered":"2024-05-09T09:56:18.676916+0000","last_clean":"2024-05-09T09:56:18.676916+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:56:18.676916+0000","last_undegraded":"2024-05-09T09:56:18.676916+0000","last_fullsized":"2024-05-09T09:56:18.676916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'4","last_scrub_stamp":"2024-05-09T09:56:18.676693+0000","last_deep_scrub":"63'4","last_deep_scrub_stamp":"2024-05-09T09:56:18.676693+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.676693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:00.667805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017732+0000","last_change":"2024-05-09T09:55:10.500134+0000","last_active":"2024-05-09T09:55:58.017732+0000","last_peered":"2024-05-09T09:55:58.017732+0000","last_clean":"2024-05-09T09:55:58.017732+0000","last_became_active":"2024-05-09T09:55:10.499690+0000","last_became_peered":"2024-05-09T09:55:10.499690+0000","last_unstale":"2024-05-09T09:55:58.017732+0000","last_undegraded":"2024-05-09T09:55:58.017732+0000","last_fullsized":"2024-05-09T09:55:58.017732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'24","reported_seq":84,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.960167+0000","last_change":"2024-05-09T09:56:17.960230+0000","last_active":"2024-05-09T09:56:17.960167+0000","last_peered":"2024-05-09T09:56:17.960167+0000","last_clean":"2024-05-09T09:56:17.960167+0000","last_became_active":"2024-05-09T09:55:41.481073+0000","last_became_peered":"2024-05-09T09:55:41.481073+0000","last_unstale":"2024-05-09T09:56:17.960167+0000","last_undegraded":"2024-05-09T09:56:17.960167+0000","last_fullsized":"2024-05-09T09:56:17.960167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:17.959941+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:17.959941+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.959941+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:40.455966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":45062,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.028207+0000","last_change":"2024-05-09T09:56:21.028267+0000","last_active":"2024-05-09T09:56:21.028207+0000","last_peered":"2024-05-09T09:56:21.028207+0000","last_clean":"2024-05-09T09:56:21.028207+0000","last_became_active":"2024-05-09T09:55:41.512431+0000","last_became_peered":"2024-05-09T09:55:41.512431+0000","last_unstale":"2024-05-09T09:56:21.028207+0000","last_undegraded":"2024-05-09T09:56:21.028207+0000","last_fullsized":"2024-05-09T09:56:21.028207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.027981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.027981+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.027981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:12.385334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'28","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.313376+0000","last_change":"2024-05-09T09:56:13.313416+0000","last_active":"2024-05-09T09:56:13.313376+0000","last_peered":"2024-05-09T09:56:13.313376+0000","last_clean":"2024-05-09T09:56:13.313376+0000","last_became_active":"2024-05-09T09:55:10.517760+0000","last_became_peered":"2024-05-09T09:55:10.517760+0000","last_unstale":"2024-05-09T09:56:13.313376+0000","last_undegraded":"2024-05-09T09:56:13.313376+0000","last_fullsized":"2024-05-09T09:56:13.313376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-05-09T09:56:13.313267+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-05-09T09:56:13.313267+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.313267+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:54.339833+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":63,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703238+0000","last_change":"2024-05-09T09:55:10.485758+0000","last_active":"2024-05-09T09:55:56.703238+0000","last_peered":"2024-05-09T09:55:56.703238+0000","last_clean":"2024-05-09T09:55:56.703238+0000","last_became_active":"2024-05-09T09:55:10.485167+0000","last_became_peered":"2024-05-09T09:55:10.485167+0000","last_unstale":"2024-05-09T09:55:56.703238+0000","last_undegraded":"2024-05-09T09:55:56.703238+0000","last_fullsized":"2024-05-09T09:55:56.703238+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.400507+0000","last_change":"2024-05-09T09:53:17.193859+0000","last_active":"2024-05-09T09:55:57.400507+0000","last_peered":"2024-05-09T09:55:57.400507+0000","last_clean":"2024-05-09T09:55:57.400507+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:55:57.400507+0000","last_undegraded":"2024-05-09T09:55:57.400507+0000","last_fullsized":"2024-05-09T09:55:57.400507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.653218+0000","last_change":"2024-05-09T09:56:17.653274+0000","last_active":"2024-05-09T09:56:17.653218+0000","last_peered":"2024-05-09T09:56:17.653218+0000","last_clean":"2024-05-09T09:56:17.653218+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:56:17.653218+0000","last_undegraded":"2024-05-09T09:56:17.653218+0000","last_fullsized":"2024-05-09T09:56:17.653218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:17.652977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:17.652977+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.652977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:11.016259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'16","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.131084+0000","last_change":"2024-05-09T09:55:41.638527+0000","last_active":"2024-05-09T09:56:08.131084+0000","last_peered":"2024-05-09T09:56:08.131084+0000","last_clean":"2024-05-09T09:56:08.131084+0000","last_became_active":"2024-05-09T09:55:41.470350+0000","last_became_peered":"2024-05-09T09:55:41.470350+0000","last_unstale":"2024-05-09T09:56:08.131084+0000","last_undegraded":"2024-05-09T09:56:08.131084+0000","last_fullsized":"2024-05-09T09:56:08.131084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":26636,"num_write":36,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703723+0000","last_change":"2024-05-09T09:55:41.504749+0000","last_active":"2024-05-09T09:55:56.703723+0000","last_peered":"2024-05-09T09:55:56.703723+0000","last_clean":"2024-05-09T09:55:56.703723+0000","last_became_active":"2024-05-09T09:55:41.504290+0000","last_became_peered":"2024-05-09T09:55:41.504290+0000","last_unstale":"2024-05-09T09:55:56.703723+0000","last_undegraded":"2024-05-09T09:55:56.703723+0000","last_fullsized":"2024-05-09T09:55:56.703723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706566+0000","last_change":"2024-05-09T09:55:42.568315+0000","last_active":"2024-05-09T09:55:56.706566+0000","last_peered":"2024-05-09T09:55:56.706566+0000","last_clean":"2024-05-09T09:55:56.706566+0000","last_became_active":"2024-05-09T09:55:41.517072+0000","last_became_peered":"2024-05-09T09:55:41.517072+0000","last_unstale":"2024-05-09T09:55:56.706566+0000","last_undegraded":"2024-05-09T09:55:56.706566+0000","last_fullsized":"2024-05-09T09:55:56.706566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'23","reported_seq":247,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.263700+0000","last_change":"2024-05-09T09:55:44.549663+0000","last_active":"2024-05-09T09:56:08.263700+0000","last_peered":"2024-05-09T09:56:08.263700+0000","last_clean":"2024-05-09T09:56:08.263700+0000","last_became_active":"2024-05-09T09:55:41.514399+0000","last_became_peered":"2024-05-09T09:55:41.514399+0000","last_unstale":"2024-05-09T09:56:08.263700+0000","last_undegraded":"2024-05-09T09:56:08.263700+0000","last_fullsized":"2024-05-09T09:56:08.263700+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:14.118958+0000","last_clean_scrub_stamp":"2024-05-09T09:53:14.118958+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"63'2","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015922+0000","last_change":"2024-05-09T09:53:17.189388+0000","last_active":"2024-05-09T09:55:58.015922+0000","last_peered":"2024-05-09T09:55:58.015922+0000","last_clean":"2024-05-09T09:55:58.015922+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:55:58.015922+0000","last_undegraded":"2024-05-09T09:55:58.015922+0000","last_fullsized":"2024-05-09T09:55:58.015922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.027033+0000","last_change":"2024-05-09T09:56:25.027160+0000","last_active":"2024-05-09T09:56:25.027033+0000","last_peered":"2024-05-09T09:56:25.027033+0000","last_clean":"2024-05-09T09:56:25.027033+0000","last_became_active":"2024-05-09T09:55:41.513724+0000","last_became_peered":"2024-05-09T09:55:41.513724+0000","last_unstale":"2024-05-09T09:56:25.027033+0000","last_undegraded":"2024-05-09T09:56:25.027033+0000","last_fullsized":"2024-05-09T09:56:25.027033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:25.026789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:25.026789+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.026789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:42:19.167725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'14","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.476507+0000","last_change":"2024-05-09T09:56:29.476647+0000","last_active":"2024-05-09T09:56:29.476507+0000","last_peered":"2024-05-09T09:56:29.476507+0000","last_clean":"2024-05-09T09:56:29.476507+0000","last_became_active":"2024-05-09T09:55:41.495012+0000","last_became_peered":"2024-05-09T09:55:41.495012+0000","last_unstale":"2024-05-09T09:56:29.476507+0000","last_undegraded":"2024-05-09T09:56:29.476507+0000","last_fullsized":"2024-05-09T09:56:29.476507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:29.476184+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:29.476184+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.476184+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:01:53.247487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015170+0000","last_change":"2024-05-09T09:55:41.508232+0000","last_active":"2024-05-09T09:55:58.015170+0000","last_peered":"2024-05-09T09:55:58.015170+0000","last_clean":"2024-05-09T09:55:58.015170+0000","last_became_active":"2024-05-09T09:55:41.506905+0000","last_became_peered":"2024-05-09T09:55:41.506905+0000","last_unstale":"2024-05-09T09:55:58.015170+0000","last_undegraded":"2024-05-09T09:55:58.015170+0000","last_fullsized":"2024-05-09T09:55:58.015170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:10.086129+0000","last_clean_scrub_stamp":"2024-05-09T09:53:10.086129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'34","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.874977+0000","last_change":"2024-05-09T09:56:20.875159+0000","last_active":"2024-05-09T09:56:20.874977+0000","last_peered":"2024-05-09T09:56:20.874977+0000","last_clean":"2024-05-09T09:56:20.874977+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:56:20.874977+0000","last_undegraded":"2024-05-09T09:56:20.874977+0000","last_fullsized":"2024-05-09T09:56:20.874977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-05-09T09:56:20.874733+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-05-09T09:56:20.874733+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.874733+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:55.350949+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":68,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.770707+0000","last_change":"2024-05-09T09:56:26.770773+0000","last_active":"2024-05-09T09:56:26.770707+0000","last_peered":"2024-05-09T09:56:26.770707+0000","last_clean":"2024-05-09T09:56:26.770707+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:56:26.770707+0000","last_undegraded":"2024-05-09T09:56:26.770707+0000","last_fullsized":"2024-05-09T09:56:26.770707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.770508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.770508+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.770508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:02.797264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015709+0000","last_change":"2024-05-09T09:53:17.187500+0000","last_active":"2024-05-09T09:55:58.015709+0000","last_peered":"2024-05-09T09:55:58.015709+0000","last_clean":"2024-05-09T09:55:58.015709+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:55:58.015709+0000","last_undegraded":"2024-05-09T09:55:58.015709+0000","last_fullsized":"2024-05-09T09:55:58.015709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.000319+0000","last_change":"2024-05-09T09:56:23.000372+0000","last_active":"2024-05-09T09:56:23.000319+0000","last_peered":"2024-05-09T09:56:23.000319+0000","last_clean":"2024-05-09T09:56:23.000319+0000","last_became_active":"2024-05-09T09:55:41.512176+0000","last_became_peered":"2024-05-09T09:55:41.512176+0000","last_unstale":"2024-05-09T09:56:23.000319+0000","last_undegraded":"2024-05-09T09:56:23.000319+0000","last_fullsized":"2024-05-09T09:56:23.000319+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.000115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.000115+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.000115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:23.309671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'16","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.236498+0000","last_change":"2024-05-09T09:55:42.801375+0000","last_active":"2024-05-09T09:56:08.236498+0000","last_peered":"2024-05-09T09:56:08.236498+0000","last_clean":"2024-05-09T09:56:08.236498+0000","last_became_active":"2024-05-09T09:55:41.495260+0000","last_became_peered":"2024-05-09T09:55:41.495260+0000","last_unstale":"2024-05-09T09:56:08.236498+0000","last_undegraded":"2024-05-09T09:56:08.236498+0000","last_fullsized":"2024-05-09T09:56:08.236498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.868424+0000","last_change":"2024-05-09T09:56:22.868479+0000","last_active":"2024-05-09T09:56:22.868424+0000","last_peered":"2024-05-09T09:56:22.868424+0000","last_clean":"2024-05-09T09:56:22.868424+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:56:22.868424+0000","last_undegraded":"2024-05-09T09:56:22.868424+0000","last_fullsized":"2024-05-09T09:56:22.868424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:22.868234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:22.868234+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.868234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:40.546112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'19","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.807504+0000","last_change":"2024-05-09T09:56:19.807595+0000","last_active":"2024-05-09T09:56:19.807504+0000","last_peered":"2024-05-09T09:56:19.807504+0000","last_clean":"2024-05-09T09:56:19.807504+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:56:19.807504+0000","last_undegraded":"2024-05-09T09:56:19.807504+0000","last_fullsized":"2024-05-09T09:56:19.807504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-05-09T09:56:19.807281+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-05-09T09:56:19.807281+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.807281+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:42:13.948216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.714465+0000","last_change":"2024-05-09T09:56:17.714517+0000","last_active":"2024-05-09T09:56:17.714465+0000","last_peered":"2024-05-09T09:56:17.714465+0000","last_clean":"2024-05-09T09:56:17.714465+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:56:17.714465+0000","last_undegraded":"2024-05-09T09:56:17.714465+0000","last_fullsized":"2024-05-09T09:56:17.714465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:17.714266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:17.714266+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.714266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:08.705649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017940+0000","last_change":"2024-05-09T09:55:10.502456+0000","last_active":"2024-05-09T09:55:58.017940+0000","last_peered":"2024-05-09T09:55:58.017940+0000","last_clean":"2024-05-09T09:55:58.017940+0000","last_became_active":"2024-05-09T09:55:10.502015+0000","last_became_peered":"2024-05-09T09:55:10.502015+0000","last_unstale":"2024-05-09T09:55:58.017940+0000","last_undegraded":"2024-05-09T09:55:58.017940+0000","last_fullsized":"2024-05-09T09:55:58.017940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"75'46","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.383656+0000","last_change":"2024-05-09T09:56:29.383721+0000","last_active":"2024-05-09T09:56:29.383656+0000","last_peered":"2024-05-09T09:56:29.383656+0000","last_clean":"2024-05-09T09:56:29.383656+0000","last_became_active":"2024-05-09T09:55:10.503704+0000","last_became_peered":"2024-05-09T09:55:10.503704+0000","last_unstale":"2024-05-09T09:56:29.383656+0000","last_undegraded":"2024-05-09T09:56:29.383656+0000","last_fullsized":"2024-05-09T09:56:29.383656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-05-09T09:56:29.383421+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-05-09T09:56:29.383421+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.383421+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:14.620481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'6","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.349548+0000","last_change":"2024-05-09T09:56:22.349609+0000","last_active":"2024-05-09T09:56:22.349548+0000","last_peered":"2024-05-09T09:56:22.349548+0000","last_clean":"2024-05-09T09:56:22.349548+0000","last_became_active":"2024-05-09T09:55:10.511777+0000","last_became_peered":"2024-05-09T09:55:10.511777+0000","last_unstale":"2024-05-09T09:56:22.349548+0000","last_undegraded":"2024-05-09T09:56:22.349548+0000","last_fullsized":"2024-05-09T09:56:22.349548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'6","last_scrub_stamp":"2024-05-09T09:56:22.349349+0000","last_deep_scrub":"95'6","last_deep_scrub_stamp":"2024-05-09T09:56:22.349349+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.349349+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:24.459805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8196,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.002951+0000","last_change":"2024-05-09T09:56:19.003007+0000","last_active":"2024-05-09T09:56:19.002951+0000","last_peered":"2024-05-09T09:56:19.002951+0000","last_clean":"2024-05-09T09:56:19.002951+0000","last_became_active":"2024-05-09T09:55:41.503996+0000","last_became_peered":"2024-05-09T09:55:41.503996+0000","last_unstale":"2024-05-09T09:56:19.002951+0000","last_undegraded":"2024-05-09T09:56:19.002951+0000","last_fullsized":"2024-05-09T09:56:19.002951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:19.002759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:19.002759+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.002759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:30.994350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'16","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.046847+0000","last_change":"2024-05-09T09:55:11.754129+0000","last_active":"2024-05-09T09:56:08.046847+0000","last_peered":"2024-05-09T09:56:08.046847+0000","last_clean":"2024-05-09T09:56:08.046847+0000","last_became_active":"2024-05-09T09:55:10.525384+0000","last_became_peered":"2024-05-09T09:55:10.525384+0000","last_unstale":"2024-05-09T09:56:08.046847+0000","last_undegraded":"2024-05-09T09:56:08.046847+0000","last_fullsized":"2024-05-09T09:56:08.046847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:12.093256+0000","last_clean_scrub_stamp":"2024-05-09T09:53:12.093256+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":35,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.987270+0000","last_change":"2024-05-09T09:56:21.987325+0000","last_active":"2024-05-09T09:56:21.987270+0000","last_peered":"2024-05-09T09:56:21.987270+0000","last_clean":"2024-05-09T09:56:21.987270+0000","last_became_active":"2024-05-09T09:55:41.502389+0000","last_became_peered":"2024-05-09T09:55:41.502389+0000","last_unstale":"2024-05-09T09:56:21.987270+0000","last_undegraded":"2024-05-09T09:56:21.987270+0000","last_fullsized":"2024-05-09T09:56:21.987270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.987073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.987073+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.987073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:48.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.015874+0000","last_change":"2024-05-09T09:53:17.184199+0000","last_active":"2024-05-09T09:55:58.015874+0000","last_peered":"2024-05-09T09:55:58.015874+0000","last_clean":"2024-05-09T09:55:58.015874+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:55:58.015874+0000","last_undegraded":"2024-05-09T09:55:58.015874+0000","last_fullsized":"2024-05-09T09:55:58.015874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.017310+0000","last_change":"2024-05-09T09:56:20.017364+0000","last_active":"2024-05-09T09:56:20.017310+0000","last_peered":"2024-05-09T09:56:20.017310+0000","last_clean":"2024-05-09T09:56:20.017310+0000","last_became_active":"2024-05-09T09:55:41.503132+0000","last_became_peered":"2024-05-09T09:55:41.503132+0000","last_unstale":"2024-05-09T09:56:20.017310+0000","last_undegraded":"2024-05-09T09:56:20.017310+0000","last_fullsized":"2024-05-09T09:56:20.017310+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:20.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:20.017113+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:22.372653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'18","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.176617+0000","last_change":"2024-05-09T09:53:07.117809+0000","last_active":"2024-05-09T09:56:08.176617+0000","last_peered":"2024-05-09T09:56:08.176617+0000","last_clean":"2024-05-09T09:56:08.176617+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:56:08.176617+0000","last_undegraded":"2024-05-09T09:56:08.176617+0000","last_fullsized":"2024-05-09T09:56:08.176617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":36882,"num_write":48,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"95'2","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.426680+0000","last_change":"2024-05-09T09:56:19.426757+0000","last_active":"2024-05-09T09:56:19.426680+0000","last_peered":"2024-05-09T09:56:19.426680+0000","last_clean":"2024-05-09T09:56:19.426680+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:56:19.426680+0000","last_undegraded":"2024-05-09T09:56:19.426680+0000","last_fullsized":"2024-05-09T09:56:19.426680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-05-09T09:56:19.426485+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-05-09T09:56:19.426485+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.426485+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:52.257376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'22","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.108468+0000","last_change":"2024-05-09T09:56:27.108623+0000","last_active":"2024-05-09T09:56:27.108468+0000","last_peered":"2024-05-09T09:56:27.108468+0000","last_clean":"2024-05-09T09:56:27.108468+0000","last_became_active":"2024-05-09T09:55:41.453982+0000","last_became_peered":"2024-05-09T09:55:41.453982+0000","last_unstale":"2024-05-09T09:56:27.108468+0000","last_undegraded":"2024-05-09T09:56:27.108468+0000","last_fullsized":"2024-05-09T09:56:27.108468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-05-09T09:56:27.108233+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-05-09T09:56:27.108233+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.108233+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:49.143045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":34,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.799352+0000","last_change":"2024-05-09T09:56:28.799408+0000","last_active":"2024-05-09T09:56:28.799352+0000","last_peered":"2024-05-09T09:56:28.799352+0000","last_clean":"2024-05-09T09:56:28.799352+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:56:28.799352+0000","last_undegraded":"2024-05-09T09:56:28.799352+0000","last_fullsized":"2024-05-09T09:56:28.799352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.799143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.799143+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.799143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:19.084979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705876+0000","last_change":"2024-05-09T09:55:41.488023+0000","last_active":"2024-05-09T09:55:56.705876+0000","last_peered":"2024-05-09T09:55:56.705876+0000","last_clean":"2024-05-09T09:55:56.705876+0000","last_became_active":"2024-05-09T09:55:41.478429+0000","last_became_peered":"2024-05-09T09:55:41.478429+0000","last_unstale":"2024-05-09T09:55:56.705876+0000","last_undegraded":"2024-05-09T09:55:56.705876+0000","last_fullsized":"2024-05-09T09:55:56.705876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:16.138621+0000","last_clean_scrub_stamp":"2024-05-09T09:53:16.138621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"75'30","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.435770+0000","last_change":"2024-05-09T09:56:23.435942+0000","last_active":"2024-05-09T09:56:23.435770+0000","last_peered":"2024-05-09T09:56:23.435770+0000","last_clean":"2024-05-09T09:56:23.435770+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:56:23.435770+0000","last_undegraded":"2024-05-09T09:56:23.435770+0000","last_fullsized":"2024-05-09T09:56:23.435770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'30","last_scrub_stamp":"2024-05-09T09:56:23.435533+0000","last_deep_scrub":"75'30","last_deep_scrub_stamp":"2024-05-09T09:56:23.435533+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.435533+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:25.791073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":76,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'14","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.245336+0000","last_change":"2024-05-09T09:53:07.134408+0000","last_active":"2024-05-09T09:56:08.245336+0000","last_peered":"2024-05-09T09:56:08.245336+0000","last_clean":"2024-05-09T09:56:08.245336+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:56:08.245336+0000","last_undegraded":"2024-05-09T09:56:08.245336+0000","last_fullsized":"2024-05-09T09:56:08.245336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.703650+0000","last_change":"2024-05-09T09:53:09.106305+0000","last_active":"2024-05-09T09:55:56.703650+0000","last_peered":"2024-05-09T09:55:56.703650+0000","last_clean":"2024-05-09T09:55:56.703650+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:55:56.703650+0000","last_undegraded":"2024-05-09T09:55:56.703650+0000","last_fullsized":"2024-05-09T09:55:56.703650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'24","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.590344+0000","last_change":"2024-05-09T09:56:13.590403+0000","last_active":"2024-05-09T09:56:13.590344+0000","last_peered":"2024-05-09T09:56:13.590344+0000","last_clean":"2024-05-09T09:56:13.590344+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:56:13.590344+0000","last_undegraded":"2024-05-09T09:56:13.590344+0000","last_fullsized":"2024-05-09T09:56:13.590344+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:13.590153+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:13.590153+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.590153+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:57.949511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":38936,"num_write":64,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:57.401939+0000","last_change":"2024-05-09T09:53:09.127569+0000","last_active":"2024-05-09T09:55:57.401939+0000","last_peered":"2024-05-09T09:55:57.401939+0000","last_clean":"2024-05-09T09:55:57.401939+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:55:57.401939+0000","last_undegraded":"2024-05-09T09:55:57.401939+0000","last_fullsized":"2024-05-09T09:55:57.401939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'18","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.922747+0000","last_change":"2024-05-09T09:56:17.922808+0000","last_active":"2024-05-09T09:56:17.922747+0000","last_peered":"2024-05-09T09:56:17.922747+0000","last_clean":"2024-05-09T09:56:17.922747+0000","last_became_active":"2024-05-09T09:55:10.518812+0000","last_became_peered":"2024-05-09T09:55:10.518812+0000","last_unstale":"2024-05-09T09:56:17.922747+0000","last_undegraded":"2024-05-09T09:56:17.922747+0000","last_fullsized":"2024-05-09T09:56:17.922747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:17.922556+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:17.922556+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.922556+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:56.203186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":30726,"num_write":28,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.370386+0000","last_change":"2024-05-09T09:56:21.370437+0000","last_active":"2024-05-09T09:56:21.370386+0000","last_peered":"2024-05-09T09:56:21.370386+0000","last_clean":"2024-05-09T09:56:21.370386+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:56:21.370386+0000","last_undegraded":"2024-05-09T09:56:21.370386+0000","last_fullsized":"2024-05-09T09:56:21.370386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.370199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.370199+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.370199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:43:13.563744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'14","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.198678+0000","last_change":"2024-05-09T09:55:11.272479+0000","last_active":"2024-05-09T09:56:08.198678+0000","last_peered":"2024-05-09T09:56:08.198678+0000","last_clean":"2024-05-09T09:56:08.198678+0000","last_became_active":"2024-05-09T09:55:10.507500+0000","last_became_peered":"2024-05-09T09:55:10.507500+0000","last_unstale":"2024-05-09T09:56:08.198678+0000","last_undegraded":"2024-05-09T09:56:08.198678+0000","last_fullsized":"2024-05-09T09:56:08.198678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24594,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.373545+0000","last_change":"2024-05-09T09:56:23.373608+0000","last_active":"2024-05-09T09:56:23.373545+0000","last_peered":"2024-05-09T09:56:23.373545+0000","last_clean":"2024-05-09T09:56:23.373545+0000","last_became_active":"2024-05-09T09:55:10.523552+0000","last_became_peered":"2024-05-09T09:55:10.523552+0000","last_unstale":"2024-05-09T09:56:23.373545+0000","last_undegraded":"2024-05-09T09:56:23.373545+0000","last_fullsized":"2024-05-09T09:56:23.373545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.373351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.373351+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.373351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:28.652226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'26","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.211064+0000","last_change":"2024-05-09T09:55:42.061427+0000","last_active":"2024-05-09T09:56:08.211064+0000","last_peered":"2024-05-09T09:56:08.211064+0000","last_clean":"2024-05-09T09:56:08.211064+0000","last_became_active":"2024-05-09T09:55:41.504165+0000","last_became_peered":"2024-05-09T09:55:41.504165+0000","last_unstale":"2024-05-09T09:56:08.211064+0000","last_undegraded":"2024-05-09T09:56:08.211064+0000","last_fullsized":"2024-05-09T09:56:08.211064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12298,"num_write":46,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":113246208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.074933+0000","last_change":"2024-05-09T09:56:26.074993+0000","last_active":"2024-05-09T09:56:26.074933+0000","last_peered":"2024-05-09T09:56:26.074933+0000","last_clean":"2024-05-09T09:56:26.074933+0000","last_became_active":"2024-05-09T09:55:41.500371+0000","last_became_peered":"2024-05-09T09:55:41.500371+0000","last_unstale":"2024-05-09T09:56:26.074933+0000","last_undegraded":"2024-05-09T09:56:26.074933+0000","last_fullsized":"2024-05-09T09:56:26.074933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.074736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.074736+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.074736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.094970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'30","reported_seq":264,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.253507+0000","last_change":"2024-05-09T09:55:10.940790+0000","last_active":"2024-05-09T09:56:08.253507+0000","last_peered":"2024-05-09T09:56:08.253507+0000","last_clean":"2024-05-09T09:56:08.253507+0000","last_became_active":"2024-05-09T09:55:10.497720+0000","last_became_peered":"2024-05-09T09:55:10.497720+0000","last_unstale":"2024-05-09T09:56:08.253507+0000","last_undegraded":"2024-05-09T09:56:08.253507+0000","last_fullsized":"2024-05-09T09:56:08.253507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":51230,"num_write":80,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.412738+0000","last_change":"2024-05-09T09:56:24.412796+0000","last_active":"2024-05-09T09:56:24.412738+0000","last_peered":"2024-05-09T09:56:24.412738+0000","last_clean":"2024-05-09T09:56:24.412738+0000","last_became_active":"2024-05-09T09:55:10.520654+0000","last_became_peered":"2024-05-09T09:55:10.520654+0000","last_unstale":"2024-05-09T09:56:24.412738+0000","last_undegraded":"2024-05-09T09:56:24.412738+0000","last_fullsized":"2024-05-09T09:56:24.412738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.412534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.412534+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.412534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:21:13.306716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'16","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.840928+0000","last_change":"2024-05-09T09:56:26.841060+0000","last_active":"2024-05-09T09:56:26.840928+0000","last_peered":"2024-05-09T09:56:26.840928+0000","last_clean":"2024-05-09T09:56:26.840928+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:56:26.840928+0000","last_undegraded":"2024-05-09T09:56:26.840928+0000","last_fullsized":"2024-05-09T09:56:26.840928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:26.840591+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:26.840591+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.840591+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:43.975175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.795585+0000","last_change":"2024-05-09T09:56:23.795643+0000","last_active":"2024-05-09T09:56:23.795585+0000","last_peered":"2024-05-09T09:56:23.795585+0000","last_clean":"2024-05-09T09:56:23.795585+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:56:23.795585+0000","last_undegraded":"2024-05-09T09:56:23.795585+0000","last_fullsized":"2024-05-09T09:56:23.795585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.795386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.795386+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.795386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:31.139396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'12","reported_seq":86,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.189928+0000","last_change":"2024-05-09T09:55:43.542093+0000","last_active":"2024-05-09T09:56:08.189928+0000","last_peered":"2024-05-09T09:56:08.189928+0000","last_clean":"2024-05-09T09:56:08.189928+0000","last_became_active":"2024-05-09T09:55:41.504555+0000","last_became_peered":"2024-05-09T09:55:41.504555+0000","last_unstale":"2024-05-09T09:56:08.189928+0000","last_undegraded":"2024-05-09T09:56:08.189928+0000","last_fullsized":"2024-05-09T09:56:08.189928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6148,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"75'34","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706387+0000","last_change":"2024-05-09T09:55:11.694902+0000","last_active":"2024-05-09T09:55:56.706387+0000","last_peered":"2024-05-09T09:55:56.706387+0000","last_clean":"2024-05-09T09:55:56.706387+0000","last_became_active":"2024-05-09T09:55:10.515872+0000","last_became_peered":"2024-05-09T09:55:10.515872+0000","last_unstale":"2024-05-09T09:55:56.706387+0000","last_undegraded":"2024-05-09T09:55:56.706387+0000","last_fullsized":"2024-05-09T09:55:56.706387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'14","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.947150+0000","last_change":"2024-05-09T09:56:13.947207+0000","last_active":"2024-05-09T09:56:13.947150+0000","last_peered":"2024-05-09T09:56:13.947150+0000","last_clean":"2024-05-09T09:56:13.947150+0000","last_became_active":"2024-05-09T09:55:10.506370+0000","last_became_peered":"2024-05-09T09:55:10.506370+0000","last_unstale":"2024-05-09T09:56:13.947150+0000","last_undegraded":"2024-05-09T09:56:13.947150+0000","last_fullsized":"2024-05-09T09:56:13.947150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:13.946960+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:13.946960+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.946960+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:14:46.921583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16388,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.706790+0000","last_change":"2024-05-09T09:55:41.494250+0000","last_active":"2024-05-09T09:55:56.706790+0000","last_peered":"2024-05-09T09:55:56.706790+0000","last_clean":"2024-05-09T09:55:56.706790+0000","last_became_active":"2024-05-09T09:55:41.492423+0000","last_became_peered":"2024-05-09T09:55:41.492423+0000","last_unstale":"2024-05-09T09:55:56.706790+0000","last_undegraded":"2024-05-09T09:55:56.706790+0000","last_fullsized":"2024-05-09T09:55:56.706790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'16","reported_seq":96,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:07.936926+0000","last_change":"2024-05-09T09:55:44.733118+0000","last_active":"2024-05-09T09:56:07.936926+0000","last_peered":"2024-05-09T09:56:07.936926+0000","last_clean":"2024-05-09T09:56:07.936926+0000","last_became_active":"2024-05-09T09:55:41.505078+0000","last_became_peered":"2024-05-09T09:55:41.505078+0000","last_unstale":"2024-05-09T09:56:07.936926+0000","last_undegraded":"2024-05-09T09:56:07.936926+0000","last_fullsized":"2024-05-09T09:56:07.936926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":18438,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.635887+0000","last_change":"2024-05-09T09:56:18.635943+0000","last_active":"2024-05-09T09:56:18.635887+0000","last_peered":"2024-05-09T09:56:18.635887+0000","last_clean":"2024-05-09T09:56:18.635887+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:56:18.635887+0000","last_undegraded":"2024-05-09T09:56:18.635887+0000","last_fullsized":"2024-05-09T09:56:18.635887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:18.635674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:18.635674+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.635674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:23.223030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'34","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.239506+0000","last_change":"2024-05-09T09:53:07.131703+0000","last_active":"2024-05-09T09:56:08.239506+0000","last_peered":"2024-05-09T09:56:08.239506+0000","last_clean":"2024-05-09T09:56:08.239506+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:56:08.239506+0000","last_undegraded":"2024-05-09T09:56:08.239506+0000","last_fullsized":"2024-05-09T09:56:08.239506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":63494,"num_write":44,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'34","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.705589+0000","last_change":"2024-05-09T09:55:42.435861+0000","last_active":"2024-05-09T09:55:56.705589+0000","last_peered":"2024-05-09T09:55:56.705589+0000","last_clean":"2024-05-09T09:55:56.705589+0000","last_became_active":"2024-05-09T09:55:41.516340+0000","last_became_peered":"2024-05-09T09:55:41.516340+0000","last_unstale":"2024-05-09T09:55:56.705589+0000","last_undegraded":"2024-05-09T09:55:56.705589+0000","last_fullsized":"2024-05-09T09:55:56.705589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'20","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:12.590155+0000","last_change":"2024-05-09T09:56:12.590224+0000","last_active":"2024-05-09T09:56:12.590155+0000","last_peered":"2024-05-09T09:56:12.590155+0000","last_clean":"2024-05-09T09:56:12.590155+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:56:12.590155+0000","last_undegraded":"2024-05-09T09:56:12.590155+0000","last_fullsized":"2024-05-09T09:56:12.590155+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:12.589976+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:12.589976+0000","last_clean_scrub_stamp":"2024-05-09T09:56:12.589976+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:34.083244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":40972,"num_write":40,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'10","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:58.017199+0000","last_change":"2024-05-09T09:55:55.725591+0000","last_active":"2024-05-09T09:55:58.017199+0000","last_peered":"2024-05-09T09:55:58.017199+0000","last_clean":"2024-05-09T09:55:58.017199+0000","last_became_active":"2024-05-09T09:55:55.721121+0000","last_became_peered":"2024-05-09T09:55:55.721121+0000","last_unstale":"2024-05-09T09:55:58.017199+0000","last_undegraded":"2024-05-09T09:55:58.017199+0000","last_fullsized":"2024-05-09T09:55:58.017199+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'24","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.239506+0000","last_change":"2024-05-09T09:55:43.389559+0000","last_active":"2024-05-09T09:56:08.239506+0000","last_peered":"2024-05-09T09:56:08.239506+0000","last_clean":"2024-05-09T09:56:08.239506+0000","last_became_active":"2024-05-09T09:55:41.513564+0000","last_became_peered":"2024-05-09T09:55:41.513564+0000","last_unstale":"2024-05-09T09:56:08.239506+0000","last_undegraded":"2024-05-09T09:56:08.239506+0000","last_fullsized":"2024-05-09T09:56:08.239506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45068,"num_write":44,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"63'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:55:56.702182+0000","last_change":"2024-05-09T09:53:09.124378+0000","last_active":"2024-05-09T09:55:56.702182+0000","last_peered":"2024-05-09T09:55:56.702182+0000","last_clean":"2024-05-09T09:55:56.702182+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:55:56.702182+0000","last_undegraded":"2024-05-09T09:55:56.702182+0000","last_fullsized":"2024-05-09T09:55:56.702182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:08.079163+0000","last_clean_scrub_stamp":"2024-05-09T09:53:08.079163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'14","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.185976+0000","last_change":"2024-05-09T09:53:07.133698+0000","last_active":"2024-05-09T09:56:08.185976+0000","last_peered":"2024-05-09T09:56:08.185976+0000","last_clean":"2024-05-09T09:56:08.185976+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:56:08.185976+0000","last_undegraded":"2024-05-09T09:56:08.185976+0000","last_fullsized":"2024-05-09T09:56:08.185976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"63'6","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.458691+0000","last_change":"2024-05-09T09:56:25.458750+0000","last_active":"2024-05-09T09:56:25.458691+0000","last_peered":"2024-05-09T09:56:25.458691+0000","last_clean":"2024-05-09T09:56:25.458691+0000","last_became_active":"2024-05-09T09:55:10.495708+0000","last_became_peered":"2024-05-09T09:55:10.495708+0000","last_unstale":"2024-05-09T09:56:25.458691+0000","last_undegraded":"2024-05-09T09:56:25.458691+0000","last_fullsized":"2024-05-09T09:56:25.458691+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-05-09T09:56:25.458483+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-05-09T09:56:25.458483+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.458483+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:33.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'28","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.619417+0000","last_change":"2024-05-09T09:56:16.619488+0000","last_active":"2024-05-09T09:56:16.619417+0000","last_peered":"2024-05-09T09:56:16.619417+0000","last_clean":"2024-05-09T09:56:16.619417+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:56:16.619417+0000","last_undegraded":"2024-05-09T09:56:16.619417+0000","last_fullsized":"2024-05-09T09:56:16.619417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-05-09T09:56:16.619210+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-05-09T09:56:16.619210+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.619210+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:27.460685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":53278,"num_write":78,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'6","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.917448+0000","last_change":"2024-05-09T09:56:15.917511+0000","last_active":"2024-05-09T09:56:15.917448+0000","last_peered":"2024-05-09T09:56:15.917448+0000","last_clean":"2024-05-09T09:56:15.917448+0000","last_became_active":"2024-05-09T09:55:10.500255+0000","last_became_peered":"2024-05-09T09:55:10.500255+0000","last_unstale":"2024-05-09T09:56:15.917448+0000","last_undegraded":"2024-05-09T09:56:15.917448+0000","last_fullsized":"2024-05-09T09:56:15.917448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-05-09T09:56:15.917249+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-05-09T09:56:15.917249+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.917249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:16.452267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.196999+0000","last_change":"2024-05-09T09:53:07.130739+0000","last_active":"2024-05-09T09:56:08.196999+0000","last_peered":"2024-05-09T09:56:08.196999+0000","last_clean":"2024-05-09T09:56:08.196999+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:56:08.196999+0000","last_undegraded":"2024-05-09T09:56:08.196999+0000","last_fullsized":"2024-05-09T09:56:08.196999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.254223+0000","last_change":"2024-05-09T09:53:07.118630+0000","last_active":"2024-05-09T09:56:08.254223+0000","last_peered":"2024-05-09T09:56:08.254223+0000","last_clean":"2024-05-09T09:56:08.254223+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:56:08.254223+0000","last_undegraded":"2024-05-09T09:56:08.254223+0000","last_fullsized":"2024-05-09T09:56:08.254223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16384,"num_write":12,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.813392+0000","last_change":"2024-05-09T09:56:16.813446+0000","last_active":"2024-05-09T09:56:16.813392+0000","last_peered":"2024-05-09T09:56:16.813392+0000","last_clean":"2024-05-09T09:56:16.813392+0000","last_became_active":"2024-05-09T09:55:10.506690+0000","last_became_peered":"2024-05-09T09:55:10.506690+0000","last_unstale":"2024-05-09T09:56:16.813392+0000","last_undegraded":"2024-05-09T09:56:16.813392+0000","last_fullsized":"2024-05-09T09:56:16.813392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.813202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.813202+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.813202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:43.577711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'14","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:08.154361+0000","last_change":"2024-05-09T09:55:41.773438+0000","last_active":"2024-05-09T09:56:08.154361+0000","last_peered":"2024-05-09T09:56:08.154361+0000","last_clean":"2024-05-09T09:56:08.154361+0000","last_became_active":"2024-05-09T09:55:41.504558+0000","last_became_peered":"2024-05-09T09:55:41.504558+0000","last_unstale":"2024-05-09T09:56:08.154361+0000","last_undegraded":"2024-05-09T09:56:08.154361+0000","last_fullsized":"2024-05-09T09:56:08.154361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:53:06.067315+0000","last_clean_scrub_stamp":"2024-05-09T09:53:06.067315+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26642,"num_write":44,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.929170+0000","last_change":"2024-05-09T09:56:28.929302+0000","last_active":"2024-05-09T09:56:28.929170+0000","last_peered":"2024-05-09T09:56:28.929170+0000","last_clean":"2024-05-09T09:56:28.929170+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:56:28.929170+0000","last_undegraded":"2024-05-09T09:56:28.929170+0000","last_fullsized":"2024-05-09T09:56:28.929170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.928902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.928902+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.928902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:54:23.887947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":634,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":123282,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1201,"num_read_kb":1574,"num_write":775,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":46305,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1146,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":874,"ondisk_log_size":874,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1642,"num_read_kb":1223,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1462,"num_read_kb":1804930,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":1302331392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1773568,"data_stored":1259473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542190,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1150976,"data_stored":667452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1200128,"data_stored":668716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1146880,"data_stored":668379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36476,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335364,"statfs":{"total":96636764160,"available":96599412736,"internally_reserved":0,"allocated":1167360,"data_stored":667848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335392,"statfs":{"total":96636764160,"available":96599441408,"internally_reserved":0,"allocated":1138688,"data_stored":667014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36476,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335364,"statfs":{"total":96636764160,"available":96599412736,"internally_reserved":0,"allocated":1167360,"data_stored":667702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1748992,"data_stored":1257886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:56:35.457 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.457 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.457 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.457 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.457 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.457 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.457 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.458 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.458 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.458 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.458 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.458 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.458 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.458 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.458 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.459 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.460 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.460 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.460 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.460 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.460 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.460 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.460 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.460 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.461 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.462 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.462 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.462 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.462 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.462 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.462 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.462 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.462 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.463 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.463 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.463 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.463 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.463 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.463 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.463 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.463 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.464 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.464 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.464 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.464 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.464 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.464 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.464 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.464 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.465 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.465 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.465 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.465 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.465 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.465 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.465 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.465 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.466 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.466 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T09:53:00.029602+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=0, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.466 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.466 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.466 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.466 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.466 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.466 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.467 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.467 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.467 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.467 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.467 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.467 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.467 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.467 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.468 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-09T09:53:14.118958+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.469 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-09T09:53:10.086129+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=10, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.470 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.470 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.470 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.470 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-09T09:53:12.093256+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.470 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.470 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.470 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-09T09:53:16.138621+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=16, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.471 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.471 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.471 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.471 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.471 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.471 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.471 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.471 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-09T09:53:08.079163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=8, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.472 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.473 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.473 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T09:53:06.067315+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=56, tm_sec=9, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:56:35.473 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T09:56:55.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:56:55.807 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-05-09T09:56:55.813 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-05-09T09:56:55.824 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-05-09T09:56:55.397363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":715263,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4507,"num_read_kb":1807912,"num_write":3892,"num_write_kb":2051112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":598,"num_bytes_recovered":1302381373,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2002,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2819,"ondisk_log_size":2819,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284616,"kb_used_data":10248,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754690104,"statfs":{"total":773094113280,"available":772802666496,"internally_reserved":0,"allocated":10493952,"data_stored":6524470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":280874547},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":856,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005942"},"pg_stats":[{"pgid":"3.3f","version":"95'24","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:40.990984+0000","last_change":"2024-05-09T09:56:40.991088+0000","last_active":"2024-05-09T09:56:40.990984+0000","last_peered":"2024-05-09T09:56:40.990984+0000","last_clean":"2024-05-09T09:56:40.990984+0000","last_became_active":"2024-05-09T09:53:07.137633+0000","last_became_peered":"2024-05-09T09:53:07.137633+0000","last_unstale":"2024-05-09T09:56:40.990984+0000","last_undegraded":"2024-05-09T09:56:40.990984+0000","last_fullsized":"2024-05-09T09:56:40.990984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:40.990747+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:40.990747+0000","last_clean_scrub_stamp":"2024-05-09T09:56:40.990747+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:05.721137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":47116,"num_write":44,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:47.987635+0000","last_change":"2024-05-09T09:56:47.987687+0000","last_active":"2024-05-09T09:56:47.987635+0000","last_peered":"2024-05-09T09:56:47.987635+0000","last_clean":"2024-05-09T09:56:47.987635+0000","last_became_active":"2024-05-09T09:55:41.484367+0000","last_became_peered":"2024-05-09T09:55:41.484367+0000","last_unstale":"2024-05-09T09:56:47.987635+0000","last_undegraded":"2024-05-09T09:56:47.987635+0000","last_fullsized":"2024-05-09T09:56:47.987635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:47.987446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:47.987446+0000","last_clean_scrub_stamp":"2024-05-09T09:56:47.987446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:14:45.091141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'14","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.523828+0000","last_change":"2024-05-09T09:56:26.523888+0000","last_active":"2024-05-09T09:56:26.523828+0000","last_peered":"2024-05-09T09:56:26.523828+0000","last_clean":"2024-05-09T09:56:26.523828+0000","last_became_active":"2024-05-09T09:53:07.100663+0000","last_became_peered":"2024-05-09T09:53:07.100663+0000","last_unstale":"2024-05-09T09:56:26.523828+0000","last_undegraded":"2024-05-09T09:56:26.523828+0000","last_fullsized":"2024-05-09T09:56:26.523828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:26.523620+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:26.523620+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.523620+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:36:58.479614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'40","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:30.948649+0000","last_change":"2024-05-09T09:56:30.948711+0000","last_active":"2024-05-09T09:56:30.948649+0000","last_peered":"2024-05-09T09:56:30.948649+0000","last_clean":"2024-05-09T09:56:30.948649+0000","last_became_active":"2024-05-09T09:53:09.132230+0000","last_became_peered":"2024-05-09T09:53:09.132230+0000","last_unstale":"2024-05-09T09:56:30.948649+0000","last_undegraded":"2024-05-09T09:56:30.948649+0000","last_fullsized":"2024-05-09T09:56:30.948649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'40","last_scrub_stamp":"2024-05-09T09:56:30.948452+0000","last_deep_scrub":"75'40","last_deep_scrub_stamp":"2024-05-09T09:56:30.948452+0000","last_clean_scrub_stamp":"2024-05-09T09:56:30.948452+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:52.983265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":102,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'22","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:34.863831+0000","last_change":"2024-05-09T09:56:34.863903+0000","last_active":"2024-05-09T09:56:34.863831+0000","last_peered":"2024-05-09T09:56:34.863831+0000","last_clean":"2024-05-09T09:56:34.863831+0000","last_became_active":"2024-05-09T09:53:07.095712+0000","last_became_peered":"2024-05-09T09:53:07.095712+0000","last_unstale":"2024-05-09T09:56:34.863831+0000","last_undegraded":"2024-05-09T09:56:34.863831+0000","last_fullsized":"2024-05-09T09:56:34.863831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-05-09T09:56:34.863631+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-05-09T09:56:34.863631+0000","last_clean_scrub_stamp":"2024-05-09T09:56:34.863631+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:29.553339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":38918,"num_write":32,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:38.016114+0000","last_change":"2024-05-09T09:56:38.016169+0000","last_active":"2024-05-09T09:56:38.016114+0000","last_peered":"2024-05-09T09:56:38.016114+0000","last_clean":"2024-05-09T09:56:38.016114+0000","last_became_active":"2024-05-09T09:55:41.474847+0000","last_became_peered":"2024-05-09T09:55:41.474847+0000","last_unstale":"2024-05-09T09:56:38.016114+0000","last_undegraded":"2024-05-09T09:56:38.016114+0000","last_fullsized":"2024-05-09T09:56:38.016114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:38.015926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:38.015926+0000","last_clean_scrub_stamp":"2024-05-09T09:56:38.015926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:02.746316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'16","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.978993+0000","last_change":"2024-05-09T09:56:14.979053+0000","last_active":"2024-05-09T09:56:14.978993+0000","last_peered":"2024-05-09T09:56:14.978993+0000","last_clean":"2024-05-09T09:56:14.978993+0000","last_became_active":"2024-05-09T09:55:10.495355+0000","last_became_peered":"2024-05-09T09:55:10.495355+0000","last_unstale":"2024-05-09T09:56:14.978993+0000","last_undegraded":"2024-05-09T09:56:14.978993+0000","last_fullsized":"2024-05-09T09:56:14.978993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:14.978801+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:14.978801+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.978801+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:24.538534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24588,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:43.875061+0000","last_change":"2024-05-09T09:56:43.875123+0000","last_active":"2024-05-09T09:56:43.875061+0000","last_peered":"2024-05-09T09:56:43.875061+0000","last_clean":"2024-05-09T09:56:43.875061+0000","last_became_active":"2024-05-09T09:55:10.506740+0000","last_became_peered":"2024-05-09T09:55:10.506740+0000","last_unstale":"2024-05-09T09:56:43.875061+0000","last_undegraded":"2024-05-09T09:56:43.875061+0000","last_fullsized":"2024-05-09T09:56:43.875061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:43.874816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:43.874816+0000","last_clean_scrub_stamp":"2024-05-09T09:56:43.874816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:54:23.796799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'20","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.793617+0000","last_change":"2024-05-09T09:56:22.793617+0000","last_active":"2024-05-09T09:56:22.793617+0000","last_peered":"2024-05-09T09:56:22.793617+0000","last_clean":"2024-05-09T09:56:22.793617+0000","last_became_active":"2024-05-09T09:53:54.477094+0000","last_became_peered":"2024-05-09T09:53:54.477094+0000","last_unstale":"2024-05-09T09:56:22.793617+0000","last_undegraded":"2024-05-09T09:56:22.793617+0000","last_fullsized":"2024-05-09T09:56:22.793617+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:22.793329+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:22.793329+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.793329+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:23.328347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.763987+0000","last_change":"2024-05-09T09:56:21.764045+0000","last_active":"2024-05-09T09:56:21.763987+0000","last_peered":"2024-05-09T09:56:21.763987+0000","last_clean":"2024-05-09T09:56:21.763987+0000","last_became_active":"2024-05-09T09:53:09.128747+0000","last_became_peered":"2024-05-09T09:53:09.128747+0000","last_unstale":"2024-05-09T09:56:21.763987+0000","last_undegraded":"2024-05-09T09:56:21.763987+0000","last_fullsized":"2024-05-09T09:56:21.763987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.763779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.763779+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.763779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:36:21.681605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'20","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:31.916244+0000","last_change":"2024-05-09T09:56:31.916303+0000","last_active":"2024-05-09T09:56:31.916244+0000","last_peered":"2024-05-09T09:56:31.916244+0000","last_clean":"2024-05-09T09:56:31.916244+0000","last_became_active":"2024-05-09T09:53:54.469570+0000","last_became_peered":"2024-05-09T09:53:54.469570+0000","last_unstale":"2024-05-09T09:56:31.916244+0000","last_undegraded":"2024-05-09T09:56:31.916244+0000","last_fullsized":"2024-05-09T09:56:31.916244+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:31.916042+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:31.916042+0000","last_clean_scrub_stamp":"2024-05-09T09:56:31.916042+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:35.799966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":34840,"num_write":60,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'38","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:33.072607+0000","last_change":"2024-05-09T09:56:33.072668+0000","last_active":"2024-05-09T09:56:33.072607+0000","last_peered":"2024-05-09T09:56:33.072607+0000","last_clean":"2024-05-09T09:56:33.072607+0000","last_became_active":"2024-05-09T09:55:41.470370+0000","last_became_peered":"2024-05-09T09:55:41.470370+0000","last_unstale":"2024-05-09T09:56:33.072607+0000","last_undegraded":"2024-05-09T09:56:33.072607+0000","last_fullsized":"2024-05-09T09:56:33.072607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-05-09T09:56:33.072401+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-05-09T09:56:33.072401+0000","last_clean_scrub_stamp":"2024-05-09T09:56:33.072401+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:51:11.218276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'18","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:38.937670+0000","last_change":"2024-05-09T09:56:38.937729+0000","last_active":"2024-05-09T09:56:38.937670+0000","last_peered":"2024-05-09T09:56:38.937670+0000","last_clean":"2024-05-09T09:56:38.937670+0000","last_became_active":"2024-05-09T09:53:07.123571+0000","last_became_peered":"2024-05-09T09:53:07.123571+0000","last_unstale":"2024-05-09T09:56:38.937670+0000","last_undegraded":"2024-05-09T09:56:38.937670+0000","last_fullsized":"2024-05-09T09:56:38.937670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:38.937481+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:38.937481+0000","last_clean_scrub_stamp":"2024-05-09T09:56:38.937481+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:37.777372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":34816,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:41.970115+0000","last_change":"2024-05-09T09:56:41.970218+0000","last_active":"2024-05-09T09:56:41.970115+0000","last_peered":"2024-05-09T09:56:41.970115+0000","last_clean":"2024-05-09T09:56:41.970115+0000","last_became_active":"2024-05-09T09:53:09.111684+0000","last_became_peered":"2024-05-09T09:53:09.111684+0000","last_unstale":"2024-05-09T09:56:41.970115+0000","last_undegraded":"2024-05-09T09:56:41.970115+0000","last_fullsized":"2024-05-09T09:56:41.970115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:41.969806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:41.969806+0000","last_clean_scrub_stamp":"2024-05-09T09:56:41.969806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:23.738610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'20","reported_seq":83,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.304402+0000","last_change":"2024-05-09T09:56:15.304473+0000","last_active":"2024-05-09T09:56:15.304402+0000","last_peered":"2024-05-09T09:56:15.304402+0000","last_clean":"2024-05-09T09:56:15.304402+0000","last_became_active":"2024-05-09T09:55:10.517657+0000","last_became_peered":"2024-05-09T09:55:10.517657+0000","last_unstale":"2024-05-09T09:56:15.304402+0000","last_undegraded":"2024-05-09T09:56:15.304402+0000","last_fullsized":"2024-05-09T09:56:15.304402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:15.304198+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:15.304198+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.304198+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:08.516906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22558,"num_write":70,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.538654+0000","last_change":"2024-05-09T09:56:25.538714+0000","last_active":"2024-05-09T09:56:25.538654+0000","last_peered":"2024-05-09T09:56:25.538654+0000","last_clean":"2024-05-09T09:56:25.538654+0000","last_became_active":"2024-05-09T09:55:10.525051+0000","last_became_peered":"2024-05-09T09:55:10.525051+0000","last_unstale":"2024-05-09T09:56:25.538654+0000","last_undegraded":"2024-05-09T09:56:25.538654+0000","last_fullsized":"2024-05-09T09:56:25.538654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:25.538414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:25.538414+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.538414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:31:41.714094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:43.064082+0000","last_change":"2024-05-09T09:56:43.064151+0000","last_active":"2024-05-09T09:56:43.064082+0000","last_peered":"2024-05-09T09:56:43.064082+0000","last_clean":"2024-05-09T09:56:43.064082+0000","last_became_active":"2024-05-09T09:55:41.468227+0000","last_became_peered":"2024-05-09T09:55:41.468227+0000","last_unstale":"2024-05-09T09:56:43.064082+0000","last_undegraded":"2024-05-09T09:56:43.064082+0000","last_fullsized":"2024-05-09T09:56:43.064082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-05-09T09:56:43.063885+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-05-09T09:56:43.063885+0000","last_clean_scrub_stamp":"2024-05-09T09:56:43.063885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:48.342760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'14","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:39.988081+0000","last_change":"2024-05-09T09:56:39.988260+0000","last_active":"2024-05-09T09:56:39.988081+0000","last_peered":"2024-05-09T09:56:39.988081+0000","last_clean":"2024-05-09T09:56:39.988081+0000","last_became_active":"2024-05-09T09:53:07.138081+0000","last_became_peered":"2024-05-09T09:53:07.138081+0000","last_unstale":"2024-05-09T09:56:39.988081+0000","last_undegraded":"2024-05-09T09:56:39.988081+0000","last_fullsized":"2024-05-09T09:56:39.988081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:39.987859+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:39.987859+0000","last_clean_scrub_stamp":"2024-05-09T09:56:39.987859+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:25:34.672761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:32.983091+0000","last_change":"2024-05-09T09:56:32.983227+0000","last_active":"2024-05-09T09:56:32.983091+0000","last_peered":"2024-05-09T09:56:32.983091+0000","last_clean":"2024-05-09T09:56:32.983091+0000","last_became_active":"2024-05-09T09:53:09.132335+0000","last_became_peered":"2024-05-09T09:53:09.132335+0000","last_unstale":"2024-05-09T09:56:32.983091+0000","last_undegraded":"2024-05-09T09:56:32.983091+0000","last_fullsized":"2024-05-09T09:56:32.983091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:32.982838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:32.982838+0000","last_clean_scrub_stamp":"2024-05-09T09:56:32.982838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:28:36.151276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'12","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.889069+0000","last_change":"2024-05-09T09:56:27.889249+0000","last_active":"2024-05-09T09:56:27.889069+0000","last_peered":"2024-05-09T09:56:27.889069+0000","last_clean":"2024-05-09T09:56:27.889069+0000","last_became_active":"2024-05-09T09:53:07.126071+0000","last_became_peered":"2024-05-09T09:53:07.126071+0000","last_unstale":"2024-05-09T09:56:27.889069+0000","last_undegraded":"2024-05-09T09:56:27.889069+0000","last_fullsized":"2024-05-09T09:56:27.889069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:27.888750+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:27.888750+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.888750+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:43.250871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:42.953707+0000","last_change":"2024-05-09T09:56:42.953760+0000","last_active":"2024-05-09T09:56:42.953707+0000","last_peered":"2024-05-09T09:56:42.953707+0000","last_clean":"2024-05-09T09:56:42.953707+0000","last_became_active":"2024-05-09T09:53:09.121739+0000","last_became_peered":"2024-05-09T09:53:09.121739+0000","last_unstale":"2024-05-09T09:56:42.953707+0000","last_undegraded":"2024-05-09T09:56:42.953707+0000","last_fullsized":"2024-05-09T09:56:42.953707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:42.953517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:42.953517+0000","last_clean_scrub_stamp":"2024-05-09T09:56:42.953517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:29.956778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'18","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.827450+0000","last_change":"2024-05-09T09:56:25.827509+0000","last_active":"2024-05-09T09:56:25.827450+0000","last_peered":"2024-05-09T09:56:25.827450+0000","last_clean":"2024-05-09T09:56:25.827450+0000","last_became_active":"2024-05-09T09:53:07.124094+0000","last_became_peered":"2024-05-09T09:53:07.124094+0000","last_unstale":"2024-05-09T09:56:25.827450+0000","last_undegraded":"2024-05-09T09:56:25.827450+0000","last_fullsized":"2024-05-09T09:56:25.827450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:25.827261+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:25.827261+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.827261+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:01:49.598563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.554468+0000","last_change":"2024-05-09T09:56:24.554583+0000","last_active":"2024-05-09T09:56:24.554468+0000","last_peered":"2024-05-09T09:56:24.554468+0000","last_clean":"2024-05-09T09:56:24.554468+0000","last_became_active":"2024-05-09T09:55:10.501517+0000","last_became_peered":"2024-05-09T09:55:10.501517+0000","last_unstale":"2024-05-09T09:56:24.554468+0000","last_undegraded":"2024-05-09T09:56:24.554468+0000","last_fullsized":"2024-05-09T09:56:24.554468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.554248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.554248+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.554248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:09:19.236660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'8","reported_seq":61,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:48.119755+0000","last_change":"2024-05-09T09:56:48.119818+0000","last_active":"2024-05-09T09:56:48.119755+0000","last_peered":"2024-05-09T09:56:48.119755+0000","last_clean":"2024-05-09T09:56:48.119755+0000","last_became_active":"2024-05-09T09:55:41.517108+0000","last_became_peered":"2024-05-09T09:55:41.517108+0000","last_unstale":"2024-05-09T09:56:48.119755+0000","last_undegraded":"2024-05-09T09:56:48.119755+0000","last_fullsized":"2024-05-09T09:56:48.119755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-05-09T09:56:48.119561+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-05-09T09:56:48.119561+0000","last_clean_scrub_stamp":"2024-05-09T09:56:48.119561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:28:34.526589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.496932+0000","last_change":"2024-05-09T09:56:28.496986+0000","last_active":"2024-05-09T09:56:28.496932+0000","last_peered":"2024-05-09T09:56:28.496932+0000","last_clean":"2024-05-09T09:56:28.496932+0000","last_became_active":"2024-05-09T09:55:41.495217+0000","last_became_peered":"2024-05-09T09:55:41.495217+0000","last_unstale":"2024-05-09T09:56:28.496932+0000","last_undegraded":"2024-05-09T09:56:28.496932+0000","last_fullsized":"2024-05-09T09:56:28.496932+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.496701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.496701+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.496701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:33.511280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'24","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.389380+0000","last_change":"2024-05-09T09:56:21.389450+0000","last_active":"2024-05-09T09:56:21.389380+0000","last_peered":"2024-05-09T09:56:21.389380+0000","last_clean":"2024-05-09T09:56:21.389380+0000","last_became_active":"2024-05-09T09:55:10.515515+0000","last_became_peered":"2024-05-09T09:55:10.515515+0000","last_unstale":"2024-05-09T09:56:21.389380+0000","last_undegraded":"2024-05-09T09:56:21.389380+0000","last_fullsized":"2024-05-09T09:56:21.389380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:21.389179+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:21.389179+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.389179+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:16.078887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":77594624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:36.072272+0000","last_change":"2024-05-09T09:56:36.072325+0000","last_active":"2024-05-09T09:56:36.072272+0000","last_peered":"2024-05-09T09:56:36.072272+0000","last_clean":"2024-05-09T09:56:36.072272+0000","last_became_active":"2024-05-09T09:55:41.469463+0000","last_became_peered":"2024-05-09T09:55:41.469463+0000","last_unstale":"2024-05-09T09:56:36.072272+0000","last_undegraded":"2024-05-09T09:56:36.072272+0000","last_fullsized":"2024-05-09T09:56:36.072272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:36.072078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:36.072078+0000","last_clean_scrub_stamp":"2024-05-09T09:56:36.072078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:50:53.122443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'16","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:35.853200+0000","last_change":"2024-05-09T09:56:35.853261+0000","last_active":"2024-05-09T09:56:35.853200+0000","last_peered":"2024-05-09T09:56:35.853200+0000","last_clean":"2024-05-09T09:56:35.853200+0000","last_became_active":"2024-05-09T09:53:07.098196+0000","last_became_peered":"2024-05-09T09:53:07.098196+0000","last_unstale":"2024-05-09T09:56:35.853200+0000","last_undegraded":"2024-05-09T09:56:35.853200+0000","last_fullsized":"2024-05-09T09:56:35.853200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:35.853003+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:35.853003+0000","last_clean_scrub_stamp":"2024-05-09T09:56:35.853003+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:37.963459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":26630,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:34.034086+0000","last_change":"2024-05-09T09:56:34.034140+0000","last_active":"2024-05-09T09:56:34.034086+0000","last_peered":"2024-05-09T09:56:34.034086+0000","last_clean":"2024-05-09T09:56:34.034086+0000","last_became_active":"2024-05-09T09:55:41.479825+0000","last_became_peered":"2024-05-09T09:55:41.479825+0000","last_unstale":"2024-05-09T09:56:34.034086+0000","last_undegraded":"2024-05-09T09:56:34.034086+0000","last_fullsized":"2024-05-09T09:56:34.034086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:34.033892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:34.033892+0000","last_clean_scrub_stamp":"2024-05-09T09:56:34.033892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:12.416188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:40.461880+0000","last_change":"2024-05-09T09:56:40.461937+0000","last_active":"2024-05-09T09:56:40.461880+0000","last_peered":"2024-05-09T09:56:40.461880+0000","last_clean":"2024-05-09T09:56:40.461880+0000","last_became_active":"2024-05-09T09:55:10.499014+0000","last_became_peered":"2024-05-09T09:55:10.499014+0000","last_unstale":"2024-05-09T09:56:40.461880+0000","last_undegraded":"2024-05-09T09:56:40.461880+0000","last_fullsized":"2024-05-09T09:56:40.461880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:40.461678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:40.461678+0000","last_clean_scrub_stamp":"2024-05-09T09:56:40.461678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:46.502643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'18","reported_seq":228,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:44.910716+0000","last_change":"2024-05-09T09:56:44.910784+0000","last_active":"2024-05-09T09:56:44.910716+0000","last_peered":"2024-05-09T09:56:44.910716+0000","last_clean":"2024-05-09T09:56:44.910716+0000","last_became_active":"2024-05-09T09:55:41.507252+0000","last_became_peered":"2024-05-09T09:55:41.507252+0000","last_unstale":"2024-05-09T09:56:44.910716+0000","last_undegraded":"2024-05-09T09:56:44.910716+0000","last_fullsized":"2024-05-09T09:56:44.910716+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:44.910464+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:44.910464+0000","last_clean_scrub_stamp":"2024-05-09T09:56:44.910464+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:47.020921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30720,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.944024+0000","last_change":"2024-05-09T09:56:26.944136+0000","last_active":"2024-05-09T09:56:26.944024+0000","last_peered":"2024-05-09T09:56:26.944024+0000","last_clean":"2024-05-09T09:56:26.944024+0000","last_became_active":"2024-05-09T09:53:11.124570+0000","last_became_peered":"2024-05-09T09:53:11.124570+0000","last_unstale":"2024-05-09T09:56:26.944024+0000","last_undegraded":"2024-05-09T09:56:26.944024+0000","last_fullsized":"2024-05-09T09:56:26.944024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.943760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.943760+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.943760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:14.203954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'24","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.818141+0000","last_change":"2024-05-09T09:56:21.818220+0000","last_active":"2024-05-09T09:56:21.818141+0000","last_peered":"2024-05-09T09:56:21.818141+0000","last_clean":"2024-05-09T09:56:21.818141+0000","last_became_active":"2024-05-09T09:53:13.124749+0000","last_became_peered":"2024-05-09T09:53:13.124749+0000","last_unstale":"2024-05-09T09:56:21.818141+0000","last_undegraded":"2024-05-09T09:56:21.818141+0000","last_fullsized":"2024-05-09T09:56:21.818141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:21.817925+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:21.817925+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.817925+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:43.852737+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":37,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":852,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.929708+0000","last_change":"2024-05-09T09:56:23.929763+0000","last_active":"2024-05-09T09:56:23.929708+0000","last_peered":"2024-05-09T09:56:23.929708+0000","last_clean":"2024-05-09T09:56:23.929708+0000","last_became_active":"2024-05-09T09:53:15.166223+0000","last_became_peered":"2024-05-09T09:53:15.166223+0000","last_unstale":"2024-05-09T09:56:23.929708+0000","last_undegraded":"2024-05-09T09:56:23.929708+0000","last_fullsized":"2024-05-09T09:56:23.929708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.929478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.929478+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.929478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:26.285018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:48.990375+0000","last_change":"2024-05-09T09:56:48.990427+0000","last_active":"2024-05-09T09:56:48.990375+0000","last_peered":"2024-05-09T09:56:48.990375+0000","last_clean":"2024-05-09T09:56:48.990375+0000","last_became_active":"2024-05-09T09:55:41.487060+0000","last_became_peered":"2024-05-09T09:55:41.487060+0000","last_unstale":"2024-05-09T09:56:48.990375+0000","last_undegraded":"2024-05-09T09:56:48.990375+0000","last_fullsized":"2024-05-09T09:56:48.990375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:48.990160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:48.990160+0000","last_clean_scrub_stamp":"2024-05-09T09:56:48.990160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:57.637568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:32.931084+0000","last_change":"2024-05-09T09:56:32.931135+0000","last_active":"2024-05-09T09:56:32.931084+0000","last_peered":"2024-05-09T09:56:32.931084+0000","last_clean":"2024-05-09T09:56:32.931084+0000","last_became_active":"2024-05-09T09:53:09.126766+0000","last_became_peered":"2024-05-09T09:53:09.126766+0000","last_unstale":"2024-05-09T09:56:32.931084+0000","last_undegraded":"2024-05-09T09:56:32.931084+0000","last_fullsized":"2024-05-09T09:56:32.931084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:32.930888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:32.930888+0000","last_clean_scrub_stamp":"2024-05-09T09:56:32.930888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:24.720608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'6","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:39.834379+0000","last_change":"2024-05-09T09:56:39.834547+0000","last_active":"2024-05-09T09:56:39.834379+0000","last_peered":"2024-05-09T09:56:39.834379+0000","last_clean":"2024-05-09T09:56:39.834379+0000","last_became_active":"2024-05-09T09:53:07.122461+0000","last_became_peered":"2024-05-09T09:53:07.122461+0000","last_unstale":"2024-05-09T09:56:39.834379+0000","last_undegraded":"2024-05-09T09:56:39.834379+0000","last_fullsized":"2024-05-09T09:56:39.834379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'6","last_scrub_stamp":"2024-05-09T09:56:39.834100+0000","last_deep_scrub":"95'6","last_deep_scrub_stamp":"2024-05-09T09:56:39.834100+0000","last_clean_scrub_stamp":"2024-05-09T09:56:39.834100+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:38:44.670101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":12294,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:38.400609+0000","last_change":"2024-05-09T09:56:38.400667+0000","last_active":"2024-05-09T09:56:38.400609+0000","last_peered":"2024-05-09T09:56:38.400609+0000","last_clean":"2024-05-09T09:56:38.400609+0000","last_became_active":"2024-05-09T09:55:10.506778+0000","last_became_peered":"2024-05-09T09:55:10.506778+0000","last_unstale":"2024-05-09T09:56:38.400609+0000","last_undegraded":"2024-05-09T09:56:38.400609+0000","last_fullsized":"2024-05-09T09:56:38.400609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:38.400397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:38.400397+0000","last_clean_scrub_stamp":"2024-05-09T09:56:38.400397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:28.949112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"95'9","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.077960+0000","last_change":"2024-05-09T09:56:29.078031+0000","last_active":"2024-05-09T09:56:29.077960+0000","last_peered":"2024-05-09T09:56:29.077960+0000","last_clean":"2024-05-09T09:56:29.077960+0000","last_became_active":"2024-05-09T09:55:41.467079+0000","last_became_peered":"2024-05-09T09:55:41.467079+0000","last_unstale":"2024-05-09T09:56:29.077960+0000","last_undegraded":"2024-05-09T09:56:29.077960+0000","last_fullsized":"2024-05-09T09:56:29.077960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'9","last_scrub_stamp":"2024-05-09T09:56:29.077771+0000","last_deep_scrub":"95'9","last_deep_scrub_stamp":"2024-05-09T09:56:29.077771+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.077771+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:13:12.289545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:35.023201+0000","last_change":"2024-05-09T09:56:35.023253+0000","last_active":"2024-05-09T09:56:35.023201+0000","last_peered":"2024-05-09T09:56:35.023201+0000","last_clean":"2024-05-09T09:56:35.023201+0000","last_became_active":"2024-05-09T09:55:41.467929+0000","last_became_peered":"2024-05-09T09:55:41.467929+0000","last_unstale":"2024-05-09T09:56:35.023201+0000","last_undegraded":"2024-05-09T09:56:35.023201+0000","last_fullsized":"2024-05-09T09:56:35.023201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:35.023006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:35.023006+0000","last_clean_scrub_stamp":"2024-05-09T09:56:35.023006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:44:57.751934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:30.830985+0000","last_change":"2024-05-09T09:56:30.831046+0000","last_active":"2024-05-09T09:56:30.830985+0000","last_peered":"2024-05-09T09:56:30.830985+0000","last_clean":"2024-05-09T09:56:30.830985+0000","last_became_active":"2024-05-09T09:53:17.174962+0000","last_became_peered":"2024-05-09T09:53:17.174962+0000","last_unstale":"2024-05-09T09:56:30.830985+0000","last_undegraded":"2024-05-09T09:56:30.830985+0000","last_fullsized":"2024-05-09T09:56:30.830985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:30.830768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:30.830768+0000","last_clean_scrub_stamp":"2024-05-09T09:56:30.830768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:25:25.515670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.830912+0000","last_change":"2024-05-09T09:56:13.830932+0000","last_active":"2024-05-09T09:56:13.830912+0000","last_peered":"2024-05-09T09:56:13.830912+0000","last_clean":"2024-05-09T09:56:13.830912+0000","last_became_active":"2024-05-09T09:55:10.482649+0000","last_became_peered":"2024-05-09T09:55:10.482649+0000","last_unstale":"2024-05-09T09:56:13.830912+0000","last_undegraded":"2024-05-09T09:56:13.830912+0000","last_fullsized":"2024-05-09T09:56:13.830912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:13.830834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:13.830834+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.830834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:25.822425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'20","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:47.965676+0000","last_change":"2024-05-09T09:56:47.965740+0000","last_active":"2024-05-09T09:56:47.965676+0000","last_peered":"2024-05-09T09:56:47.965676+0000","last_clean":"2024-05-09T09:56:47.965676+0000","last_became_active":"2024-05-09T09:55:41.508695+0000","last_became_peered":"2024-05-09T09:55:41.508695+0000","last_unstale":"2024-05-09T09:56:47.965676+0000","last_undegraded":"2024-05-09T09:56:47.965676+0000","last_fullsized":"2024-05-09T09:56:47.965676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:47.965444+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:47.965444+0000","last_clean_scrub_stamp":"2024-05-09T09:56:47.965444+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:56.064545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":38936,"num_write":60,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:36.433095+0000","last_change":"2024-05-09T09:56:36.433156+0000","last_active":"2024-05-09T09:56:36.433095+0000","last_peered":"2024-05-09T09:56:36.433095+0000","last_clean":"2024-05-09T09:56:36.433095+0000","last_became_active":"2024-05-09T09:55:10.508122+0000","last_became_peered":"2024-05-09T09:55:10.508122+0000","last_unstale":"2024-05-09T09:56:36.433095+0000","last_undegraded":"2024-05-09T09:56:36.433095+0000","last_fullsized":"2024-05-09T09:56:36.433095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:36.432898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:36.432898+0000","last_clean_scrub_stamp":"2024-05-09T09:56:36.432898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:27.740752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"95'16","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:30.459651+0000","last_change":"2024-05-09T09:56:30.459827+0000","last_active":"2024-05-09T09:56:30.459651+0000","last_peered":"2024-05-09T09:56:30.459651+0000","last_clean":"2024-05-09T09:56:30.459651+0000","last_became_active":"2024-05-09T09:55:41.506785+0000","last_became_peered":"2024-05-09T09:55:41.506785+0000","last_unstale":"2024-05-09T09:56:30.459651+0000","last_undegraded":"2024-05-09T09:56:30.459651+0000","last_fullsized":"2024-05-09T09:56:30.459651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:30.459423+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:30.459423+0000","last_clean_scrub_stamp":"2024-05-09T09:56:30.459423+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:03.290314+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'18","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.953388+0000","last_change":"2024-05-09T09:56:25.953450+0000","last_active":"2024-05-09T09:56:25.953388+0000","last_peered":"2024-05-09T09:56:25.953388+0000","last_clean":"2024-05-09T09:56:25.953388+0000","last_became_active":"2024-05-09T09:53:15.169698+0000","last_became_peered":"2024-05-09T09:53:15.169698+0000","last_unstale":"2024-05-09T09:56:25.953388+0000","last_undegraded":"2024-05-09T09:56:25.953388+0000","last_fullsized":"2024-05-09T09:56:25.953388+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:25.953197+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:25.953197+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.953197+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:09:31.580360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"75'2","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.819707+0000","last_change":"2024-05-09T09:56:13.819769+0000","last_active":"2024-05-09T09:56:13.819707+0000","last_peered":"2024-05-09T09:56:13.819707+0000","last_clean":"2024-05-09T09:56:13.819707+0000","last_became_active":"2024-05-09T09:55:41.492528+0000","last_became_peered":"2024-05-09T09:55:41.492528+0000","last_unstale":"2024-05-09T09:56:13.819707+0000","last_undegraded":"2024-05-09T09:56:13.819707+0000","last_fullsized":"2024-05-09T09:56:13.819707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-09T09:56:13.819494+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-09T09:56:13.819494+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.819494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:21:46.630613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:34.387679+0000","last_change":"2024-05-09T09:56:34.387745+0000","last_active":"2024-05-09T09:56:34.387679+0000","last_peered":"2024-05-09T09:56:34.387679+0000","last_clean":"2024-05-09T09:56:34.387679+0000","last_became_active":"2024-05-09T09:55:10.508721+0000","last_became_peered":"2024-05-09T09:55:10.508721+0000","last_unstale":"2024-05-09T09:56:34.387679+0000","last_undegraded":"2024-05-09T09:56:34.387679+0000","last_fullsized":"2024-05-09T09:56:34.387679+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:34.387485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:34.387485+0000","last_clean_scrub_stamp":"2024-05-09T09:56:34.387485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:01.763055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'12","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.901542+0000","last_change":"2024-05-09T09:56:28.901605+0000","last_active":"2024-05-09T09:56:28.901542+0000","last_peered":"2024-05-09T09:56:28.901542+0000","last_clean":"2024-05-09T09:56:28.901542+0000","last_became_active":"2024-05-09T09:53:07.123129+0000","last_became_peered":"2024-05-09T09:53:07.123129+0000","last_unstale":"2024-05-09T09:56:28.901542+0000","last_undegraded":"2024-05-09T09:56:28.901542+0000","last_fullsized":"2024-05-09T09:56:28.901542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:28.901346+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:28.901346+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.901346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:43:21.094891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.959030+0000","last_change":"2024-05-09T09:56:16.959084+0000","last_active":"2024-05-09T09:56:16.959030+0000","last_peered":"2024-05-09T09:56:16.959030+0000","last_clean":"2024-05-09T09:56:16.959030+0000","last_became_active":"2024-05-09T09:55:10.507504+0000","last_became_peered":"2024-05-09T09:55:10.507504+0000","last_unstale":"2024-05-09T09:56:16.959030+0000","last_undegraded":"2024-05-09T09:56:16.959030+0000","last_fullsized":"2024-05-09T09:56:16.959030+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.958837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.958837+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.958837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:45.715135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'21","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.863153+0000","last_change":"2024-05-09T09:56:19.863224+0000","last_active":"2024-05-09T09:56:19.863153+0000","last_peered":"2024-05-09T09:56:19.863153+0000","last_clean":"2024-05-09T09:56:19.863153+0000","last_became_active":"2024-05-09T09:53:13.149164+0000","last_became_peered":"2024-05-09T09:53:13.149164+0000","last_unstale":"2024-05-09T09:56:19.863153+0000","last_undegraded":"2024-05-09T09:56:19.863153+0000","last_fullsized":"2024-05-09T09:56:19.863153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-05-09T09:56:19.862972+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-05-09T09:56:19.862972+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.862972+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:52.693864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'21","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.373467+0000","last_change":"2024-05-09T09:56:27.373529+0000","last_active":"2024-05-09T09:56:27.373467+0000","last_peered":"2024-05-09T09:56:27.373467+0000","last_clean":"2024-05-09T09:56:27.373467+0000","last_became_active":"2024-05-09T09:55:10.502644+0000","last_became_peered":"2024-05-09T09:55:10.502644+0000","last_unstale":"2024-05-09T09:56:27.373467+0000","last_undegraded":"2024-05-09T09:56:27.373467+0000","last_fullsized":"2024-05-09T09:56:27.373467+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-05-09T09:56:27.373256+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-05-09T09:56:27.373256+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.373256+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:31.137721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:34.954079+0000","last_change":"2024-05-09T09:56:34.954132+0000","last_active":"2024-05-09T09:56:34.954079+0000","last_peered":"2024-05-09T09:56:34.954079+0000","last_clean":"2024-05-09T09:56:34.954079+0000","last_became_active":"2024-05-09T09:53:09.126667+0000","last_became_peered":"2024-05-09T09:53:09.126667+0000","last_unstale":"2024-05-09T09:56:34.954079+0000","last_undegraded":"2024-05-09T09:56:34.954079+0000","last_fullsized":"2024-05-09T09:56:34.954079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:34.953852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:34.953852+0000","last_clean_scrub_stamp":"2024-05-09T09:56:34.953852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:00:31.388711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'20","reported_seq":235,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:45.897279+0000","last_change":"2024-05-09T09:56:45.897411+0000","last_active":"2024-05-09T09:56:45.897279+0000","last_peered":"2024-05-09T09:56:45.897279+0000","last_clean":"2024-05-09T09:56:45.897279+0000","last_became_active":"2024-05-09T09:55:41.507201+0000","last_became_peered":"2024-05-09T09:55:41.507201+0000","last_unstale":"2024-05-09T09:56:45.897279+0000","last_undegraded":"2024-05-09T09:56:45.897279+0000","last_fullsized":"2024-05-09T09:56:45.897279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:45.897030+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:45.897030+0000","last_clean_scrub_stamp":"2024-05-09T09:56:45.897030+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:51.175906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34828,"num_write":40,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.940895+0000","last_change":"2024-05-09T09:56:26.941027+0000","last_active":"2024-05-09T09:56:26.940895+0000","last_peered":"2024-05-09T09:56:26.940895+0000","last_clean":"2024-05-09T09:56:26.940895+0000","last_became_active":"2024-05-09T09:53:11.119847+0000","last_became_peered":"2024-05-09T09:53:11.119847+0000","last_unstale":"2024-05-09T09:56:26.940895+0000","last_undegraded":"2024-05-09T09:56:26.940895+0000","last_fullsized":"2024-05-09T09:56:26.940895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.940670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.940670+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.940670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:36:58.896665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'39","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.917796+0000","last_change":"2024-05-09T09:56:21.917951+0000","last_active":"2024-05-09T09:56:21.917796+0000","last_peered":"2024-05-09T09:56:21.917796+0000","last_clean":"2024-05-09T09:56:21.917796+0000","last_became_active":"2024-05-09T09:53:13.149962+0000","last_became_peered":"2024-05-09T09:53:13.149962+0000","last_unstale":"2024-05-09T09:56:21.917796+0000","last_undegraded":"2024-05-09T09:56:21.917796+0000","last_fullsized":"2024-05-09T09:56:21.917796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'39","last_scrub_stamp":"2024-05-09T09:56:21.917541+0000","last_deep_scrub":"95'39","last_deep_scrub_stamp":"2024-05-09T09:56:21.917541+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.917541+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:39.992260+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":57,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.390463+0000","last_change":"2024-05-09T09:56:14.390616+0000","last_active":"2024-05-09T09:56:14.390463+0000","last_peered":"2024-05-09T09:56:14.390463+0000","last_clean":"2024-05-09T09:56:14.390463+0000","last_became_active":"2024-05-09T09:53:15.172921+0000","last_became_peered":"2024-05-09T09:53:15.172921+0000","last_unstale":"2024-05-09T09:56:14.390463+0000","last_undegraded":"2024-05-09T09:56:14.390463+0000","last_fullsized":"2024-05-09T09:56:14.390463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:14.390213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:14.390213+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.390213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:12.479727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:47.032289+0000","last_change":"2024-05-09T09:56:47.032341+0000","last_active":"2024-05-09T09:56:47.032289+0000","last_peered":"2024-05-09T09:56:47.032289+0000","last_clean":"2024-05-09T09:56:47.032289+0000","last_became_active":"2024-05-09T09:55:41.484312+0000","last_became_peered":"2024-05-09T09:55:41.484312+0000","last_unstale":"2024-05-09T09:56:47.032289+0000","last_undegraded":"2024-05-09T09:56:47.032289+0000","last_fullsized":"2024-05-09T09:56:47.032289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:47.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:47.032089+0000","last_clean_scrub_stamp":"2024-05-09T09:56:47.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:00:25.310185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:40.046050+0000","last_change":"2024-05-09T09:56:40.046108+0000","last_active":"2024-05-09T09:56:40.046050+0000","last_peered":"2024-05-09T09:56:40.046050+0000","last_clean":"2024-05-09T09:56:40.046050+0000","last_became_active":"2024-05-09T09:55:41.472133+0000","last_became_peered":"2024-05-09T09:55:41.472133+0000","last_unstale":"2024-05-09T09:56:40.046050+0000","last_undegraded":"2024-05-09T09:56:40.046050+0000","last_fullsized":"2024-05-09T09:56:40.046050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:40.045735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:40.045735+0000","last_clean_scrub_stamp":"2024-05-09T09:56:40.045735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:12.208225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'8","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:46.928217+0000","last_change":"2024-05-09T09:56:46.928390+0000","last_active":"2024-05-09T09:56:46.928217+0000","last_peered":"2024-05-09T09:56:46.928217+0000","last_clean":"2024-05-09T09:56:46.928217+0000","last_became_active":"2024-05-09T09:55:41.507751+0000","last_became_peered":"2024-05-09T09:55:41.507751+0000","last_unstale":"2024-05-09T09:56:46.928217+0000","last_undegraded":"2024-05-09T09:56:46.928217+0000","last_fullsized":"2024-05-09T09:56:46.928217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-05-09T09:56:46.927982+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-05-09T09:56:46.927982+0000","last_clean_scrub_stamp":"2024-05-09T09:56:46.927982+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:21:35.822164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.591345+0000","last_change":"2024-05-09T09:56:20.591401+0000","last_active":"2024-05-09T09:56:20.591345+0000","last_peered":"2024-05-09T09:56:20.591345+0000","last_clean":"2024-05-09T09:56:20.591345+0000","last_became_active":"2024-05-09T09:53:11.113567+0000","last_became_peered":"2024-05-09T09:53:11.113567+0000","last_unstale":"2024-05-09T09:56:20.591345+0000","last_undegraded":"2024-05-09T09:56:20.591345+0000","last_fullsized":"2024-05-09T09:56:20.591345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:20.591139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:20.591139+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.591139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:15.997031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'20","reported_seq":77,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:48.441540+0000","last_change":"2024-05-09T09:56:48.441610+0000","last_active":"2024-05-09T09:56:48.441540+0000","last_peered":"2024-05-09T09:56:48.441540+0000","last_clean":"2024-05-09T09:56:48.441540+0000","last_became_active":"2024-05-09T09:55:10.522763+0000","last_became_peered":"2024-05-09T09:55:10.522763+0000","last_unstale":"2024-05-09T09:56:48.441540+0000","last_undegraded":"2024-05-09T09:56:48.441540+0000","last_fullsized":"2024-05-09T09:56:48.441540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:48.441349+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:48.441349+0000","last_clean_scrub_stamp":"2024-05-09T09:56:48.441349+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:56.198468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:45.471323+0000","last_change":"2024-05-09T09:56:45.471449+0000","last_active":"2024-05-09T09:56:45.471323+0000","last_peered":"2024-05-09T09:56:45.471323+0000","last_clean":"2024-05-09T09:56:45.471323+0000","last_became_active":"2024-05-09T09:55:10.504789+0000","last_became_peered":"2024-05-09T09:55:10.504789+0000","last_unstale":"2024-05-09T09:56:45.471323+0000","last_undegraded":"2024-05-09T09:56:45.471323+0000","last_fullsized":"2024-05-09T09:56:45.471323+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:45.471082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:45.471082+0000","last_clean_scrub_stamp":"2024-05-09T09:56:45.471082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:34:51.588784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:33.898543+0000","last_change":"2024-05-09T09:56:33.898596+0000","last_active":"2024-05-09T09:56:33.898543+0000","last_peered":"2024-05-09T09:56:33.898543+0000","last_clean":"2024-05-09T09:56:33.898543+0000","last_became_active":"2024-05-09T09:55:41.505745+0000","last_became_peered":"2024-05-09T09:55:41.505745+0000","last_unstale":"2024-05-09T09:56:33.898543+0000","last_undegraded":"2024-05-09T09:56:33.898543+0000","last_fullsized":"2024-05-09T09:56:33.898543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:33.898343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:33.898343+0000","last_clean_scrub_stamp":"2024-05-09T09:56:33.898343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:37:05.854338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:30.919593+0000","last_change":"2024-05-09T09:56:30.919715+0000","last_active":"2024-05-09T09:56:30.919593+0000","last_peered":"2024-05-09T09:56:30.919593+0000","last_clean":"2024-05-09T09:56:30.919593+0000","last_became_active":"2024-05-09T09:53:09.113744+0000","last_became_peered":"2024-05-09T09:53:09.113744+0000","last_unstale":"2024-05-09T09:56:30.919593+0000","last_undegraded":"2024-05-09T09:56:30.919593+0000","last_fullsized":"2024-05-09T09:56:30.919593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:30.919367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:30.919367+0000","last_clean_scrub_stamp":"2024-05-09T09:56:30.919367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:33.274907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'20","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:36.886268+0000","last_change":"2024-05-09T09:56:36.886408+0000","last_active":"2024-05-09T09:56:36.886268+0000","last_peered":"2024-05-09T09:56:36.886268+0000","last_clean":"2024-05-09T09:56:36.886268+0000","last_became_active":"2024-05-09T09:53:07.130631+0000","last_became_peered":"2024-05-09T09:53:07.130631+0000","last_unstale":"2024-05-09T09:56:36.886268+0000","last_undegraded":"2024-05-09T09:56:36.886268+0000","last_fullsized":"2024-05-09T09:56:36.886268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:36.886012+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:36.886012+0000","last_clean_scrub_stamp":"2024-05-09T09:56:36.886012+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:00:35.814496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34828,"num_write":40,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.609926+0000","last_change":"2024-05-09T09:56:19.609985+0000","last_active":"2024-05-09T09:56:19.609926+0000","last_peered":"2024-05-09T09:56:19.609926+0000","last_clean":"2024-05-09T09:56:19.609926+0000","last_became_active":"2024-05-09T09:53:11.105740+0000","last_became_peered":"2024-05-09T09:53:11.105740+0000","last_unstale":"2024-05-09T09:56:19.609926+0000","last_undegraded":"2024-05-09T09:56:19.609926+0000","last_fullsized":"2024-05-09T09:56:19.609926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:19.609719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:19.609719+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.609719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:26.743623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'31","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.894544+0000","last_change":"2024-05-09T09:56:20.894724+0000","last_active":"2024-05-09T09:56:20.894544+0000","last_peered":"2024-05-09T09:56:20.894544+0000","last_clean":"2024-05-09T09:56:20.894544+0000","last_became_active":"2024-05-09T09:53:13.138527+0000","last_became_peered":"2024-05-09T09:53:13.138527+0000","last_unstale":"2024-05-09T09:56:20.894544+0000","last_undegraded":"2024-05-09T09:56:20.894544+0000","last_fullsized":"2024-05-09T09:56:20.894544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'31","last_scrub_stamp":"2024-05-09T09:56:20.894290+0000","last_deep_scrub":"95'31","last_deep_scrub_stamp":"2024-05-09T09:56:20.894290+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.894290+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:36.256411+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'18","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.795475+0000","last_change":"2024-05-09T09:56:24.795564+0000","last_active":"2024-05-09T09:56:24.795475+0000","last_peered":"2024-05-09T09:56:24.795475+0000","last_clean":"2024-05-09T09:56:24.795475+0000","last_became_active":"2024-05-09T09:53:15.170738+0000","last_became_peered":"2024-05-09T09:53:15.170738+0000","last_unstale":"2024-05-09T09:56:24.795475+0000","last_undegraded":"2024-05-09T09:56:24.795475+0000","last_fullsized":"2024-05-09T09:56:24.795475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:24.795280+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:24.795280+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.795280+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:58.756038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'4","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:42.886059+0000","last_change":"2024-05-09T09:56:42.886124+0000","last_active":"2024-05-09T09:56:42.886059+0000","last_peered":"2024-05-09T09:56:42.886059+0000","last_clean":"2024-05-09T09:56:42.886059+0000","last_became_active":"2024-05-09T09:53:17.180475+0000","last_became_peered":"2024-05-09T09:53:17.180475+0000","last_unstale":"2024-05-09T09:56:42.886059+0000","last_undegraded":"2024-05-09T09:56:42.886059+0000","last_fullsized":"2024-05-09T09:56:42.886059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2024-05-09T09:56:42.885858+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2024-05-09T09:56:42.885858+0000","last_clean_scrub_stamp":"2024-05-09T09:56:42.885858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:28.122919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"75'34","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:40.872835+0000","last_change":"2024-05-09T09:56:40.872896+0000","last_active":"2024-05-09T09:56:40.872835+0000","last_peered":"2024-05-09T09:56:40.872835+0000","last_clean":"2024-05-09T09:56:40.872835+0000","last_became_active":"2024-05-09T09:53:09.100787+0000","last_became_peered":"2024-05-09T09:53:09.100787+0000","last_unstale":"2024-05-09T09:56:40.872835+0000","last_undegraded":"2024-05-09T09:56:40.872835+0000","last_fullsized":"2024-05-09T09:56:40.872835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-05-09T09:56:40.872584+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-05-09T09:56:40.872584+0000","last_clean_scrub_stamp":"2024-05-09T09:56:40.872584+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:44.637049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'20","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:44.998038+0000","last_change":"2024-05-09T09:56:44.998159+0000","last_active":"2024-05-09T09:56:44.998038+0000","last_peered":"2024-05-09T09:56:44.998038+0000","last_clean":"2024-05-09T09:56:44.998038+0000","last_became_active":"2024-05-09T09:55:10.521894+0000","last_became_peered":"2024-05-09T09:55:10.521894+0000","last_unstale":"2024-05-09T09:56:44.998038+0000","last_undegraded":"2024-05-09T09:56:44.998038+0000","last_fullsized":"2024-05-09T09:56:44.998038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:44.997807+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:44.997807+0000","last_clean_scrub_stamp":"2024-05-09T09:56:44.997807+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:14.966292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38924,"num_write":40,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":56623104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.537202+0000","last_change":"2024-05-09T09:56:27.537258+0000","last_active":"2024-05-09T09:56:27.537202+0000","last_peered":"2024-05-09T09:56:27.537202+0000","last_clean":"2024-05-09T09:56:27.537202+0000","last_became_active":"2024-05-09T09:55:41.483828+0000","last_became_peered":"2024-05-09T09:55:41.483828+0000","last_unstale":"2024-05-09T09:56:27.537202+0000","last_undegraded":"2024-05-09T09:56:27.537202+0000","last_fullsized":"2024-05-09T09:56:27.537202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:27.536980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:27.536980+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.536980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:40:00.144105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'41","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.850584+0000","last_change":"2024-05-09T09:56:23.850658+0000","last_active":"2024-05-09T09:56:23.850584+0000","last_peered":"2024-05-09T09:56:23.850584+0000","last_clean":"2024-05-09T09:56:23.850584+0000","last_became_active":"2024-05-09T09:53:13.124764+0000","last_became_peered":"2024-05-09T09:53:13.124764+0000","last_unstale":"2024-05-09T09:56:23.850584+0000","last_undegraded":"2024-05-09T09:56:23.850584+0000","last_fullsized":"2024-05-09T09:56:23.850584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'41","last_scrub_stamp":"2024-05-09T09:56:23.850382+0000","last_deep_scrub":"95'41","last_deep_scrub_stamp":"2024-05-09T09:56:23.850382+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.850382+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:28:27.018821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":100,"num_write":42,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.567407+0000","last_change":"2024-05-09T09:56:15.567470+0000","last_active":"2024-05-09T09:56:15.567407+0000","last_peered":"2024-05-09T09:56:15.567407+0000","last_clean":"2024-05-09T09:56:15.567407+0000","last_became_active":"2024-05-09T09:53:15.182656+0000","last_became_peered":"2024-05-09T09:53:15.182656+0000","last_unstale":"2024-05-09T09:56:15.567407+0000","last_undegraded":"2024-05-09T09:56:15.567407+0000","last_fullsized":"2024-05-09T09:56:15.567407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:15.567201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:15.567201+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.567201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:31:01.367464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:33.540772+0000","last_change":"2024-05-09T09:56:33.540828+0000","last_active":"2024-05-09T09:56:33.540772+0000","last_peered":"2024-05-09T09:56:33.540772+0000","last_clean":"2024-05-09T09:56:33.540772+0000","last_became_active":"2024-05-09T09:55:10.518109+0000","last_became_peered":"2024-05-09T09:55:10.518109+0000","last_unstale":"2024-05-09T09:56:33.540772+0000","last_undegraded":"2024-05-09T09:56:33.540772+0000","last_fullsized":"2024-05-09T09:56:33.540772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:33.540574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:33.540574+0000","last_clean_scrub_stamp":"2024-05-09T09:56:33.540574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:54:07.501332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:32.054177+0000","last_change":"2024-05-09T09:56:32.054232+0000","last_active":"2024-05-09T09:56:32.054177+0000","last_peered":"2024-05-09T09:56:32.054177+0000","last_clean":"2024-05-09T09:56:32.054177+0000","last_became_active":"2024-05-09T09:55:41.488846+0000","last_became_peered":"2024-05-09T09:55:41.488846+0000","last_unstale":"2024-05-09T09:56:32.054177+0000","last_undegraded":"2024-05-09T09:56:32.054177+0000","last_fullsized":"2024-05-09T09:56:32.054177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:32.053981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:32.053981+0000","last_clean_scrub_stamp":"2024-05-09T09:56:32.053981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:13.080547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'14","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:37.419086+0000","last_change":"2024-05-09T09:56:37.419151+0000","last_active":"2024-05-09T09:56:37.419086+0000","last_peered":"2024-05-09T09:56:37.419086+0000","last_clean":"2024-05-09T09:56:37.419086+0000","last_became_active":"2024-05-09T09:55:10.507132+0000","last_became_peered":"2024-05-09T09:55:10.507132+0000","last_unstale":"2024-05-09T09:56:37.419086+0000","last_undegraded":"2024-05-09T09:56:37.419086+0000","last_fullsized":"2024-05-09T09:56:37.419086+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:37.418883+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:37.418883+0000","last_clean_scrub_stamp":"2024-05-09T09:56:37.418883+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:29:39.622528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":22550,"num_write":54,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.608869+0000","last_change":"2024-05-09T09:56:21.609011+0000","last_active":"2024-05-09T09:56:21.608869+0000","last_peered":"2024-05-09T09:56:21.608869+0000","last_clean":"2024-05-09T09:56:21.608869+0000","last_became_active":"2024-05-09T09:53:11.115103+0000","last_became_peered":"2024-05-09T09:53:11.115103+0000","last_unstale":"2024-05-09T09:56:21.608869+0000","last_undegraded":"2024-05-09T09:56:21.608869+0000","last_fullsized":"2024-05-09T09:56:21.608869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.608614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.608614+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.608614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:24.683876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'30","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:44.088950+0000","last_change":"2024-05-09T09:56:44.089030+0000","last_active":"2024-05-09T09:56:44.088950+0000","last_peered":"2024-05-09T09:56:44.088950+0000","last_clean":"2024-05-09T09:56:44.088950+0000","last_became_active":"2024-05-09T09:55:41.509467+0000","last_became_peered":"2024-05-09T09:55:41.509467+0000","last_unstale":"2024-05-09T09:56:44.088950+0000","last_undegraded":"2024-05-09T09:56:44.088950+0000","last_fullsized":"2024-05-09T09:56:44.088950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-05-09T09:56:44.088755+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-05-09T09:56:44.088755+0000","last_clean_scrub_stamp":"2024-05-09T09:56:44.088755+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:21:32.982936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":55,"num_write":30,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":6936,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":856,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:12.809572+0000","last_change":"2024-05-09T09:56:12.809600+0000","last_active":"2024-05-09T09:56:12.809572+0000","last_peered":"2024-05-09T09:56:12.809572+0000","last_clean":"2024-05-09T09:56:12.809572+0000","last_became_active":"2024-05-09T09:55:10.506376+0000","last_became_peered":"2024-05-09T09:55:10.506376+0000","last_unstale":"2024-05-09T09:56:12.809572+0000","last_undegraded":"2024-05-09T09:56:12.809572+0000","last_fullsized":"2024-05-09T09:56:12.809572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:12.809470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:12.809470+0000","last_clean_scrub_stamp":"2024-05-09T09:56:12.809470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:35.305496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"63'2","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.254726+0000","last_change":"2024-05-09T09:56:16.254786+0000","last_active":"2024-05-09T09:56:16.254726+0000","last_peered":"2024-05-09T09:56:16.254726+0000","last_clean":"2024-05-09T09:56:16.254726+0000","last_became_active":"2024-05-09T09:55:10.512509+0000","last_became_peered":"2024-05-09T09:55:10.512509+0000","last_unstale":"2024-05-09T09:56:16.254726+0000","last_undegraded":"2024-05-09T09:56:16.254726+0000","last_fullsized":"2024-05-09T09:56:16.254726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-05-09T09:56:16.254523+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-05-09T09:56:16.254523+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.254523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:44:38.983451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":209,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:39.021928+0000","last_change":"2024-05-09T09:56:39.021983+0000","last_active":"2024-05-09T09:56:39.021928+0000","last_peered":"2024-05-09T09:56:39.021928+0000","last_clean":"2024-05-09T09:56:39.021928+0000","last_became_active":"2024-05-09T09:55:41.471497+0000","last_became_peered":"2024-05-09T09:55:41.471497+0000","last_unstale":"2024-05-09T09:56:39.021928+0000","last_undegraded":"2024-05-09T09:56:39.021928+0000","last_fullsized":"2024-05-09T09:56:39.021928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:39.021729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:39.021729+0000","last_clean_scrub_stamp":"2024-05-09T09:56:39.021729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:33.601364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'18","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:37.877984+0000","last_change":"2024-05-09T09:56:37.878103+0000","last_active":"2024-05-09T09:56:37.877984+0000","last_peered":"2024-05-09T09:56:37.877984+0000","last_clean":"2024-05-09T09:56:37.877984+0000","last_became_active":"2024-05-09T09:55:41.513259+0000","last_became_peered":"2024-05-09T09:55:41.513259+0000","last_unstale":"2024-05-09T09:56:37.877984+0000","last_undegraded":"2024-05-09T09:56:37.877984+0000","last_fullsized":"2024-05-09T09:56:37.877984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:37.877704+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:37.877704+0000","last_clean_scrub_stamp":"2024-05-09T09:56:37.877704+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:51:37.436884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:38.461269+0000","last_change":"2024-05-09T09:56:38.461343+0000","last_active":"2024-05-09T09:56:38.461269+0000","last_peered":"2024-05-09T09:56:38.461269+0000","last_clean":"2024-05-09T09:56:38.461269+0000","last_became_active":"2024-05-09T09:55:41.504609+0000","last_became_peered":"2024-05-09T09:55:41.504609+0000","last_unstale":"2024-05-09T09:56:38.461269+0000","last_undegraded":"2024-05-09T09:56:38.461269+0000","last_fullsized":"2024-05-09T09:56:38.461269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:38.461053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:38.461053+0000","last_clean_scrub_stamp":"2024-05-09T09:56:38.461053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:37.300944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'34","reported_seq":248,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.550585+0000","last_change":"2024-05-09T09:56:26.550680+0000","last_active":"2024-05-09T09:56:26.550585+0000","last_peered":"2024-05-09T09:56:26.550585+0000","last_clean":"2024-05-09T09:56:26.550585+0000","last_became_active":"2024-05-09T09:55:10.520615+0000","last_became_peered":"2024-05-09T09:55:10.520615+0000","last_unstale":"2024-05-09T09:56:26.550585+0000","last_undegraded":"2024-05-09T09:56:26.550585+0000","last_fullsized":"2024-05-09T09:56:26.550585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-05-09T09:56:26.550390+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-05-09T09:56:26.550390+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.550390+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:26.354147+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":58,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":3002,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'18","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.601125+0000","last_change":"2024-05-09T09:56:23.601197+0000","last_active":"2024-05-09T09:56:23.601125+0000","last_peered":"2024-05-09T09:56:23.601125+0000","last_clean":"2024-05-09T09:56:23.601125+0000","last_became_active":"2024-05-09T09:53:15.175963+0000","last_became_peered":"2024-05-09T09:53:15.175963+0000","last_unstale":"2024-05-09T09:56:23.601125+0000","last_undegraded":"2024-05-09T09:56:23.601125+0000","last_fullsized":"2024-05-09T09:56:23.601125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:23.600925+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:23.600925+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.600925+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:52:59.008101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.389411+0000","last_change":"2024-05-09T09:56:18.389534+0000","last_active":"2024-05-09T09:56:18.389411+0000","last_peered":"2024-05-09T09:56:18.389411+0000","last_clean":"2024-05-09T09:56:18.389411+0000","last_became_active":"2024-05-09T09:53:17.175687+0000","last_became_peered":"2024-05-09T09:53:17.175687+0000","last_unstale":"2024-05-09T09:56:18.389411+0000","last_undegraded":"2024-05-09T09:56:18.389411+0000","last_fullsized":"2024-05-09T09:56:18.389411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-09T09:56:18.389119+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-09T09:56:18.389119+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.389119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:01:42.160422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"63'6","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:50.191190+0000","last_change":"2024-05-09T09:56:50.191252+0000","last_active":"2024-05-09T09:56:50.191190+0000","last_peered":"2024-05-09T09:56:50.191190+0000","last_clean":"2024-05-09T09:56:50.191190+0000","last_became_active":"2024-05-09T09:55:41.517278+0000","last_became_peered":"2024-05-09T09:55:41.517278+0000","last_unstale":"2024-05-09T09:56:50.191190+0000","last_undegraded":"2024-05-09T09:56:50.191190+0000","last_fullsized":"2024-05-09T09:56:50.191190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-05-09T09:56:50.190973+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-05-09T09:56:50.190973+0000","last_clean_scrub_stamp":"2024-05-09T09:56:50.190973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:01.291618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'18","reported_seq":73,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.881490+0000","last_change":"2024-05-09T09:56:15.881557+0000","last_active":"2024-05-09T09:56:15.881490+0000","last_peered":"2024-05-09T09:56:15.881490+0000","last_clean":"2024-05-09T09:56:15.881490+0000","last_became_active":"2024-05-09T09:55:41.481490+0000","last_became_peered":"2024-05-09T09:55:41.481490+0000","last_unstale":"2024-05-09T09:56:15.881490+0000","last_undegraded":"2024-05-09T09:56:15.881490+0000","last_fullsized":"2024-05-09T09:56:15.881490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:15.881274+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:15.881274+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.881274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:33.015859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"95'6","reported_seq":225,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:50.021297+0000","last_change":"2024-05-09T09:56:50.021383+0000","last_active":"2024-05-09T09:56:50.021297+0000","last_peered":"2024-05-09T09:56:50.021297+0000","last_clean":"2024-05-09T09:56:50.021297+0000","last_became_active":"2024-05-09T09:55:41.495448+0000","last_became_peered":"2024-05-09T09:55:41.495448+0000","last_unstale":"2024-05-09T09:56:50.021297+0000","last_undegraded":"2024-05-09T09:56:50.021297+0000","last_fullsized":"2024-05-09T09:56:50.021297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'6","last_scrub_stamp":"2024-05-09T09:56:50.021086+0000","last_deep_scrub":"95'6","last_deep_scrub_stamp":"2024-05-09T09:56:50.021086+0000","last_clean_scrub_stamp":"2024-05-09T09:56:50.021086+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:31:12.781190+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"95'15","reported_seq":73,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.361881+0000","last_change":"2024-05-09T09:56:20.361953+0000","last_active":"2024-05-09T09:56:20.361881+0000","last_peered":"2024-05-09T09:56:20.361881+0000","last_clean":"2024-05-09T09:56:20.361881+0000","last_became_active":"2024-05-09T09:55:10.512273+0000","last_became_peered":"2024-05-09T09:55:10.512273+0000","last_unstale":"2024-05-09T09:56:20.361881+0000","last_undegraded":"2024-05-09T09:56:20.361881+0000","last_fullsized":"2024-05-09T09:56:20.361881+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-05-09T09:56:20.361692+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-05-09T09:56:20.361692+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.361692+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:11:52.524182+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'18","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.746063+0000","last_change":"2024-05-09T09:56:14.746129+0000","last_active":"2024-05-09T09:56:14.746063+0000","last_peered":"2024-05-09T09:56:14.746063+0000","last_clean":"2024-05-09T09:56:14.746063+0000","last_became_active":"2024-05-09T09:53:15.173312+0000","last_became_peered":"2024-05-09T09:53:15.173312+0000","last_unstale":"2024-05-09T09:56:14.746063+0000","last_undegraded":"2024-05-09T09:56:14.746063+0000","last_fullsized":"2024-05-09T09:56:14.746063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:14.745869+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:14.745869+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.745869+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:30:57.277120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:37.061993+0000","last_change":"2024-05-09T09:56:37.062051+0000","last_active":"2024-05-09T09:56:37.061993+0000","last_peered":"2024-05-09T09:56:37.061993+0000","last_clean":"2024-05-09T09:56:37.061993+0000","last_became_active":"2024-05-09T09:55:41.474020+0000","last_became_peered":"2024-05-09T09:55:41.474020+0000","last_unstale":"2024-05-09T09:56:37.061993+0000","last_undegraded":"2024-05-09T09:56:37.061993+0000","last_fullsized":"2024-05-09T09:56:37.061993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:37.061784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:37.061784+0000","last_clean_scrub_stamp":"2024-05-09T09:56:37.061784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:36.211211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"75'42","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:36.521710+0000","last_change":"2024-05-09T09:56:36.521774+0000","last_active":"2024-05-09T09:56:36.521710+0000","last_peered":"2024-05-09T09:56:36.521710+0000","last_clean":"2024-05-09T09:56:36.521710+0000","last_became_active":"2024-05-09T09:55:10.516407+0000","last_became_peered":"2024-05-09T09:55:10.516407+0000","last_unstale":"2024-05-09T09:56:36.521710+0000","last_undegraded":"2024-05-09T09:56:36.521710+0000","last_fullsized":"2024-05-09T09:56:36.521710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'42","last_scrub_stamp":"2024-05-09T09:56:36.521516+0000","last_deep_scrub":"75'42","last_deep_scrub_stamp":"2024-05-09T09:56:36.521516+0000","last_clean_scrub_stamp":"2024-05-09T09:56:36.521516+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:14.903812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"95'12","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.275988+0000","last_change":"2024-05-09T09:56:18.276167+0000","last_active":"2024-05-09T09:56:18.275988+0000","last_peered":"2024-05-09T09:56:18.275988+0000","last_clean":"2024-05-09T09:56:18.275988+0000","last_became_active":"2024-05-09T09:55:10.516633+0000","last_became_peered":"2024-05-09T09:55:10.516633+0000","last_unstale":"2024-05-09T09:56:18.275988+0000","last_undegraded":"2024-05-09T09:56:18.275988+0000","last_fullsized":"2024-05-09T09:56:18.275988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:18.275749+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:18.275749+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.275749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:44:43.006139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12294,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:41.073282+0000","last_change":"2024-05-09T09:56:41.073334+0000","last_active":"2024-05-09T09:56:41.073282+0000","last_peered":"2024-05-09T09:56:41.073282+0000","last_clean":"2024-05-09T09:56:41.073282+0000","last_became_active":"2024-05-09T09:55:41.479634+0000","last_became_peered":"2024-05-09T09:55:41.479634+0000","last_unstale":"2024-05-09T09:56:41.073282+0000","last_undegraded":"2024-05-09T09:56:41.073282+0000","last_fullsized":"2024-05-09T09:56:41.073282+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:41.073094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:41.073094+0000","last_clean_scrub_stamp":"2024-05-09T09:56:41.073094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:35.762802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'35","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.900203+0000","last_change":"2024-05-09T09:56:19.900280+0000","last_active":"2024-05-09T09:56:19.900203+0000","last_peered":"2024-05-09T09:56:19.900203+0000","last_clean":"2024-05-09T09:56:19.900203+0000","last_became_active":"2024-05-09T09:53:13.135594+0000","last_became_peered":"2024-05-09T09:53:13.135594+0000","last_unstale":"2024-05-09T09:56:19.900203+0000","last_undegraded":"2024-05-09T09:56:19.900203+0000","last_fullsized":"2024-05-09T09:56:19.900203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'35","last_scrub_stamp":"2024-05-09T09:56:19.900027+0000","last_deep_scrub":"95'35","last_deep_scrub_stamp":"2024-05-09T09:56:19.900027+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.900027+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:09.053803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":48,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:32.909199+0000","last_change":"2024-05-09T09:56:32.909258+0000","last_active":"2024-05-09T09:56:32.909199+0000","last_peered":"2024-05-09T09:56:32.909199+0000","last_clean":"2024-05-09T09:56:32.909199+0000","last_became_active":"2024-05-09T09:55:10.501658+0000","last_became_peered":"2024-05-09T09:55:10.501658+0000","last_unstale":"2024-05-09T09:56:32.909199+0000","last_undegraded":"2024-05-09T09:56:32.909199+0000","last_fullsized":"2024-05-09T09:56:32.909199+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:32.909010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:32.909010+0000","last_clean_scrub_stamp":"2024-05-09T09:56:32.909010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:09:38.536173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.400422+0000","last_change":"2024-05-09T09:56:20.400479+0000","last_active":"2024-05-09T09:56:20.400422+0000","last_peered":"2024-05-09T09:56:20.400422+0000","last_clean":"2024-05-09T09:56:20.400422+0000","last_became_active":"2024-05-09T09:53:17.182144+0000","last_became_peered":"2024-05-09T09:53:17.182144+0000","last_unstale":"2024-05-09T09:56:20.400422+0000","last_undegraded":"2024-05-09T09:56:20.400422+0000","last_fullsized":"2024-05-09T09:56:20.400422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:20.400224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:20.400224+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.400224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:35.762346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:35.856520+0000","last_change":"2024-05-09T09:56:35.856576+0000","last_active":"2024-05-09T09:56:35.856520+0000","last_peered":"2024-05-09T09:56:35.856520+0000","last_clean":"2024-05-09T09:56:35.856520+0000","last_became_active":"2024-05-09T09:55:41.513454+0000","last_became_peered":"2024-05-09T09:55:41.513454+0000","last_unstale":"2024-05-09T09:56:35.856520+0000","last_undegraded":"2024-05-09T09:56:35.856520+0000","last_fullsized":"2024-05-09T09:56:35.856520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:35.856311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:35.856311+0000","last_clean_scrub_stamp":"2024-05-09T09:56:35.856311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:42:29.997246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"95'119","reported_seq":329,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:33.949790+0000","last_change":"2024-05-09T09:56:33.949868+0000","last_active":"2024-05-09T09:56:33.949790+0000","last_peered":"2024-05-09T09:56:33.949790+0000","last_clean":"2024-05-09T09:56:33.949790+0000","last_became_active":"2024-05-09T09:53:01.049874+0000","last_became_peered":"2024-05-09T09:53:01.049874+0000","last_unstale":"2024-05-09T09:56:33.949790+0000","last_undegraded":"2024-05-09T09:56:33.949790+0000","last_fullsized":"2024-05-09T09:56:33.949790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'119","last_scrub_stamp":"2024-05-09T09:56:33.949596+0000","last_deep_scrub":"95'119","last_deep_scrub_stamp":"2024-05-09T09:56:33.949596+0000","last_clean_scrub_stamp":"2024-05-09T09:56:33.949596+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:54:07.910354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:36.929078+0000","last_change":"2024-05-09T09:56:36.929134+0000","last_active":"2024-05-09T09:56:36.929078+0000","last_peered":"2024-05-09T09:56:36.929078+0000","last_clean":"2024-05-09T09:56:36.929078+0000","last_became_active":"2024-05-09T09:53:01.051878+0000","last_became_peered":"2024-05-09T09:53:01.051878+0000","last_unstale":"2024-05-09T09:56:36.929078+0000","last_undegraded":"2024-05-09T09:56:36.929078+0000","last_fullsized":"2024-05-09T09:56:36.929078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:36.928856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:36.928856+0000","last_clean_scrub_stamp":"2024-05-09T09:56:36.928856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:25:05.939316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'16","reported_seq":82,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:33.381895+0000","last_change":"2024-05-09T09:56:33.381957+0000","last_active":"2024-05-09T09:56:33.381895+0000","last_peered":"2024-05-09T09:56:33.381895+0000","last_clean":"2024-05-09T09:56:33.381895+0000","last_became_active":"2024-05-09T09:55:10.505428+0000","last_became_peered":"2024-05-09T09:55:10.505428+0000","last_unstale":"2024-05-09T09:56:33.381895+0000","last_undegraded":"2024-05-09T09:56:33.381895+0000","last_fullsized":"2024-05-09T09:56:33.381895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:33.381702+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:33.381702+0000","last_clean_scrub_stamp":"2024-05-09T09:56:33.381702+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:02:06.067584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16396,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.946698+0000","last_change":"2024-05-09T09:56:28.946752+0000","last_active":"2024-05-09T09:56:28.946698+0000","last_peered":"2024-05-09T09:56:28.946698+0000","last_clean":"2024-05-09T09:56:28.946698+0000","last_became_active":"2024-05-09T09:53:11.118065+0000","last_became_peered":"2024-05-09T09:53:11.118065+0000","last_unstale":"2024-05-09T09:56:28.946698+0000","last_undegraded":"2024-05-09T09:56:28.946698+0000","last_fullsized":"2024-05-09T09:56:28.946698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.946479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.946479+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.946479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:58.795744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'53","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:46.023293+0000","last_change":"2024-05-09T09:56:46.023373+0000","last_active":"2024-05-09T09:56:46.023293+0000","last_peered":"2024-05-09T09:56:46.023293+0000","last_clean":"2024-05-09T09:56:46.023293+0000","last_became_active":"2024-05-09T09:55:10.522989+0000","last_became_peered":"2024-05-09T09:55:10.522989+0000","last_unstale":"2024-05-09T09:56:46.023293+0000","last_undegraded":"2024-05-09T09:56:46.023293+0000","last_fullsized":"2024-05-09T09:56:46.023293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'53","last_scrub_stamp":"2024-05-09T09:56:46.023096+0000","last_deep_scrub":"95'53","last_deep_scrub_stamp":"2024-05-09T09:56:46.023096+0000","last_clean_scrub_stamp":"2024-05-09T09:56:46.023096+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:00.381551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":130,"num_write":50,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":11272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.799174+0000","last_change":"2024-05-09T09:56:22.799228+0000","last_active":"2024-05-09T09:56:22.799174+0000","last_peered":"2024-05-09T09:56:22.799174+0000","last_clean":"2024-05-09T09:56:22.799174+0000","last_became_active":"2024-05-09T09:53:15.167471+0000","last_became_peered":"2024-05-09T09:53:15.167471+0000","last_unstale":"2024-05-09T09:56:22.799174+0000","last_undegraded":"2024-05-09T09:56:22.799174+0000","last_fullsized":"2024-05-09T09:56:22.799174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:22.798974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:22.798974+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.798974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:08.605089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"75'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.763184+0000","last_change":"2024-05-09T09:56:20.763250+0000","last_active":"2024-05-09T09:56:20.763184+0000","last_peered":"2024-05-09T09:56:20.763184+0000","last_clean":"2024-05-09T09:56:20.763184+0000","last_became_active":"2024-05-09T09:53:17.183989+0000","last_became_peered":"2024-05-09T09:53:17.183989+0000","last_unstale":"2024-05-09T09:56:20.763184+0000","last_undegraded":"2024-05-09T09:56:20.763184+0000","last_fullsized":"2024-05-09T09:56:20.763184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-09T09:56:20.762949+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-09T09:56:20.762949+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.762949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:18.852462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.801725+0000","last_change":"2024-05-09T09:56:14.801764+0000","last_active":"2024-05-09T09:56:14.801725+0000","last_peered":"2024-05-09T09:56:14.801725+0000","last_clean":"2024-05-09T09:56:14.801725+0000","last_became_active":"2024-05-09T09:53:54.476557+0000","last_became_peered":"2024-05-09T09:53:54.476557+0000","last_unstale":"2024-05-09T09:56:14.801725+0000","last_undegraded":"2024-05-09T09:56:14.801725+0000","last_fullsized":"2024-05-09T09:56:14.801725+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:14.801605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:14.801605+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.801605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:17.157145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:34.900488+0000","last_change":"2024-05-09T09:56:34.900605+0000","last_active":"2024-05-09T09:56:34.900488+0000","last_peered":"2024-05-09T09:56:34.900488+0000","last_clean":"2024-05-09T09:56:34.900488+0000","last_became_active":"2024-05-09T09:53:01.051949+0000","last_became_peered":"2024-05-09T09:53:01.051949+0000","last_unstale":"2024-05-09T09:56:34.900488+0000","last_undegraded":"2024-05-09T09:56:34.900488+0000","last_fullsized":"2024-05-09T09:56:34.900488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:34.900270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:34.900270+0000","last_clean_scrub_stamp":"2024-05-09T09:56:34.900270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:10:59.562889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'14","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:49.816769+0000","last_change":"2024-05-09T09:56:49.816835+0000","last_active":"2024-05-09T09:56:49.816769+0000","last_peered":"2024-05-09T09:56:49.816769+0000","last_clean":"2024-05-09T09:56:49.816769+0000","last_became_active":"2024-05-09T09:55:41.489210+0000","last_became_peered":"2024-05-09T09:55:41.489210+0000","last_unstale":"2024-05-09T09:56:49.816769+0000","last_undegraded":"2024-05-09T09:56:49.816769+0000","last_fullsized":"2024-05-09T09:56:49.816769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:49.816543+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:49.816543+0000","last_clean_scrub_stamp":"2024-05-09T09:56:49.816543+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:47:36.422653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":14,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.920294+0000","last_change":"2024-05-09T09:56:24.920397+0000","last_active":"2024-05-09T09:56:24.920294+0000","last_peered":"2024-05-09T09:56:24.920294+0000","last_clean":"2024-05-09T09:56:24.920294+0000","last_became_active":"2024-05-09T09:53:11.124632+0000","last_became_peered":"2024-05-09T09:53:11.124632+0000","last_unstale":"2024-05-09T09:56:24.920294+0000","last_undegraded":"2024-05-09T09:56:24.920294+0000","last_fullsized":"2024-05-09T09:56:24.920294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.920011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.920011+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.920011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:50:02.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'80","reported_seq":308,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.388236+0000","last_change":"2024-05-09T09:56:13.388275+0000","last_active":"2024-05-09T09:56:13.388236+0000","last_peered":"2024-05-09T09:56:13.388236+0000","last_clean":"2024-05-09T09:56:13.388236+0000","last_became_active":"2024-05-09T09:53:13.142020+0000","last_became_peered":"2024-05-09T09:53:13.142020+0000","last_unstale":"2024-05-09T09:56:13.388236+0000","last_undegraded":"2024-05-09T09:56:13.388236+0000","last_fullsized":"2024-05-09T09:56:13.388236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'80","last_scrub_stamp":"2024-05-09T09:56:13.388167+0000","last_deep_scrub":"95'80","last_deep_scrub_stamp":"2024-05-09T09:56:13.388167+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.388167+0000","objects_scrubbed":10,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:09:08.070579+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":182,"num_write":70,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.856635+0000","last_change":"2024-05-09T09:56:21.856688+0000","last_active":"2024-05-09T09:56:21.856635+0000","last_peered":"2024-05-09T09:56:21.856635+0000","last_clean":"2024-05-09T09:56:21.856635+0000","last_became_active":"2024-05-09T09:53:15.165942+0000","last_became_peered":"2024-05-09T09:53:15.165942+0000","last_unstale":"2024-05-09T09:56:21.856635+0000","last_undegraded":"2024-05-09T09:56:21.856635+0000","last_fullsized":"2024-05-09T09:56:21.856635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.856436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.856436+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.856436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:43:14.049981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.418150+0000","last_change":"2024-05-09T09:56:22.418210+0000","last_active":"2024-05-09T09:56:22.418150+0000","last_peered":"2024-05-09T09:56:22.418150+0000","last_clean":"2024-05-09T09:56:22.418150+0000","last_became_active":"2024-05-09T09:53:17.264893+0000","last_became_peered":"2024-05-09T09:53:17.264893+0000","last_unstale":"2024-05-09T09:56:22.418150+0000","last_undegraded":"2024-05-09T09:56:22.418150+0000","last_fullsized":"2024-05-09T09:56:22.418150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:22.417926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:22.417926+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.417926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:49:33.782084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"75'46","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:30.548115+0000","last_change":"2024-05-09T09:56:30.548191+0000","last_active":"2024-05-09T09:56:30.548115+0000","last_peered":"2024-05-09T09:56:30.548115+0000","last_clean":"2024-05-09T09:56:30.548115+0000","last_became_active":"2024-05-09T09:53:09.114290+0000","last_became_peered":"2024-05-09T09:53:09.114290+0000","last_unstale":"2024-05-09T09:56:30.548115+0000","last_undegraded":"2024-05-09T09:56:30.548115+0000","last_fullsized":"2024-05-09T09:56:30.548115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-05-09T09:56:30.547880+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-05-09T09:56:30.547880+0000","last_clean_scrub_stamp":"2024-05-09T09:56:30.547880+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:52.582692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.577352+0000","last_change":"2024-05-09T09:56:14.577435+0000","last_active":"2024-05-09T09:56:14.577352+0000","last_peered":"2024-05-09T09:56:14.577352+0000","last_clean":"2024-05-09T09:56:14.577352+0000","last_became_active":"2024-05-09T09:55:10.500197+0000","last_became_peered":"2024-05-09T09:55:10.500197+0000","last_unstale":"2024-05-09T09:56:14.577352+0000","last_undegraded":"2024-05-09T09:56:14.577352+0000","last_fullsized":"2024-05-09T09:56:14.577352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:14.577154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:14.577154+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.577154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:22.117427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'22","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.551968+0000","last_change":"2024-05-09T09:56:27.552028+0000","last_active":"2024-05-09T09:56:27.551968+0000","last_peered":"2024-05-09T09:56:27.551968+0000","last_clean":"2024-05-09T09:56:27.551968+0000","last_became_active":"2024-05-09T09:53:07.105237+0000","last_became_peered":"2024-05-09T09:53:07.105237+0000","last_unstale":"2024-05-09T09:56:27.551968+0000","last_undegraded":"2024-05-09T09:56:27.551968+0000","last_fullsized":"2024-05-09T09:56:27.551968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-05-09T09:56:27.551778+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-05-09T09:56:27.551778+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.551778+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:57.597266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"95'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.630903+0000","last_change":"2024-05-09T09:56:22.631081+0000","last_active":"2024-05-09T09:56:22.630903+0000","last_peered":"2024-05-09T09:56:22.630903+0000","last_clean":"2024-05-09T09:56:22.630903+0000","last_became_active":"2024-05-09T09:53:11.125814+0000","last_became_peered":"2024-05-09T09:53:11.125814+0000","last_unstale":"2024-05-09T09:56:22.630903+0000","last_undegraded":"2024-05-09T09:56:22.630903+0000","last_fullsized":"2024-05-09T09:56:22.630903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-05-09T09:56:22.630673+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-05-09T09:56:22.630673+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.630673+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:04.621784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'23","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.899967+0000","last_change":"2024-05-09T09:56:18.900063+0000","last_active":"2024-05-09T09:56:18.899967+0000","last_peered":"2024-05-09T09:56:18.899967+0000","last_clean":"2024-05-09T09:56:18.899967+0000","last_became_active":"2024-05-09T09:53:13.145486+0000","last_became_peered":"2024-05-09T09:53:13.145486+0000","last_unstale":"2024-05-09T09:56:18.899967+0000","last_undegraded":"2024-05-09T09:56:18.899967+0000","last_fullsized":"2024-05-09T09:56:18.899967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'23","last_scrub_stamp":"2024-05-09T09:56:18.899773+0000","last_deep_scrub":"95'23","last_deep_scrub_stamp":"2024-05-09T09:56:18.899773+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.899773+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:01:42.671076+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:47.824926+0000","last_change":"2024-05-09T09:56:47.824984+0000","last_active":"2024-05-09T09:56:47.824926+0000","last_peered":"2024-05-09T09:56:47.824926+0000","last_clean":"2024-05-09T09:56:47.824926+0000","last_became_active":"2024-05-09T09:55:41.486383+0000","last_became_peered":"2024-05-09T09:55:41.486383+0000","last_unstale":"2024-05-09T09:56:47.824926+0000","last_undegraded":"2024-05-09T09:56:47.824926+0000","last_fullsized":"2024-05-09T09:56:47.824926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:47.824694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:47.824694+0000","last_clean_scrub_stamp":"2024-05-09T09:56:47.824694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:09:18.829571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"75'2","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:54.310383+0000","last_change":"2024-05-09T09:56:54.310449+0000","last_active":"2024-05-09T09:56:54.310383+0000","last_peered":"2024-05-09T09:56:54.310383+0000","last_clean":"2024-05-09T09:56:54.310383+0000","last_became_active":"2024-05-09T09:55:41.512553+0000","last_became_peered":"2024-05-09T09:55:41.512553+0000","last_unstale":"2024-05-09T09:56:54.310383+0000","last_undegraded":"2024-05-09T09:56:54.310383+0000","last_fullsized":"2024-05-09T09:56:54.310383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-09T09:56:54.310169+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-09T09:56:54.310169+0000","last_clean_scrub_stamp":"2024-05-09T09:56:54.310169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:36.810588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:33.941108+0000","last_change":"2024-05-09T09:56:33.941160+0000","last_active":"2024-05-09T09:56:33.941108+0000","last_peered":"2024-05-09T09:56:33.941108+0000","last_clean":"2024-05-09T09:56:33.941108+0000","last_became_active":"2024-05-09T09:54:55.401038+0000","last_became_peered":"2024-05-09T09:54:55.401038+0000","last_unstale":"2024-05-09T09:56:33.941108+0000","last_undegraded":"2024-05-09T09:56:33.941108+0000","last_fullsized":"2024-05-09T09:56:33.941108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:33.940902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:33.940902+0000","last_clean_scrub_stamp":"2024-05-09T09:56:33.940902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:52.766501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:35.905518+0000","last_change":"2024-05-09T09:56:35.905569+0000","last_active":"2024-05-09T09:56:35.905518+0000","last_peered":"2024-05-09T09:56:35.905518+0000","last_clean":"2024-05-09T09:56:35.905518+0000","last_became_active":"2024-05-09T09:53:01.052212+0000","last_became_peered":"2024-05-09T09:53:01.052212+0000","last_unstale":"2024-05-09T09:56:35.905518+0000","last_undegraded":"2024-05-09T09:56:35.905518+0000","last_fullsized":"2024-05-09T09:56:35.905518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:35.905330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:35.905330+0000","last_clean_scrub_stamp":"2024-05-09T09:56:35.905330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:20:50.018047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'16","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:31.032864+0000","last_change":"2024-05-09T09:56:31.032987+0000","last_active":"2024-05-09T09:56:31.032864+0000","last_peered":"2024-05-09T09:56:31.032864+0000","last_clean":"2024-05-09T09:56:31.032864+0000","last_became_active":"2024-05-09T09:55:41.469663+0000","last_became_peered":"2024-05-09T09:55:41.469663+0000","last_unstale":"2024-05-09T09:56:31.032864+0000","last_undegraded":"2024-05-09T09:56:31.032864+0000","last_fullsized":"2024-05-09T09:56:31.032864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:31.032559+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:31.032559+0000","last_clean_scrub_stamp":"2024-05-09T09:56:31.032559+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:10:55.695178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.810409+0000","last_change":"2024-05-09T09:56:27.810519+0000","last_active":"2024-05-09T09:56:27.810409+0000","last_peered":"2024-05-09T09:56:27.810409+0000","last_clean":"2024-05-09T09:56:27.810409+0000","last_became_active":"2024-05-09T09:53:11.117861+0000","last_became_peered":"2024-05-09T09:53:11.117861+0000","last_unstale":"2024-05-09T09:56:27.810409+0000","last_undegraded":"2024-05-09T09:56:27.810409+0000","last_fullsized":"2024-05-09T09:56:27.810409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:27.810186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:27.810186+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.810186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:06.192483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"95'18","reported_seq":95,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:51.349165+0000","last_change":"2024-05-09T09:56:51.349263+0000","last_active":"2024-05-09T09:56:51.349165+0000","last_peered":"2024-05-09T09:56:51.349165+0000","last_clean":"2024-05-09T09:56:51.349165+0000","last_became_active":"2024-05-09T09:55:41.504368+0000","last_became_peered":"2024-05-09T09:55:41.504368+0000","last_unstale":"2024-05-09T09:56:51.349165+0000","last_undegraded":"2024-05-09T09:56:51.349165+0000","last_fullsized":"2024-05-09T09:56:51.349165+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:51.348950+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:51.348950+0000","last_clean_scrub_stamp":"2024-05-09T09:56:51.348950+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:42:41.745491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.773532+0000","last_change":"2024-05-09T09:56:15.773651+0000","last_active":"2024-05-09T09:56:15.773532+0000","last_peered":"2024-05-09T09:56:15.773532+0000","last_clean":"2024-05-09T09:56:15.773532+0000","last_became_active":"2024-05-09T09:53:15.172241+0000","last_became_peered":"2024-05-09T09:53:15.172241+0000","last_unstale":"2024-05-09T09:56:15.773532+0000","last_undegraded":"2024-05-09T09:56:15.773532+0000","last_fullsized":"2024-05-09T09:56:15.773532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:15.773302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:15.773302+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.773302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:17.217863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:43.963065+0000","last_change":"2024-05-09T09:56:43.963173+0000","last_active":"2024-05-09T09:56:43.963065+0000","last_peered":"2024-05-09T09:56:43.963065+0000","last_clean":"2024-05-09T09:56:43.963065+0000","last_became_active":"2024-05-09T09:55:10.494741+0000","last_became_peered":"2024-05-09T09:55:10.494741+0000","last_unstale":"2024-05-09T09:56:43.963065+0000","last_undegraded":"2024-05-09T09:56:43.963065+0000","last_fullsized":"2024-05-09T09:56:43.963065+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:43.962837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:43.962837+0000","last_clean_scrub_stamp":"2024-05-09T09:56:43.962837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:47.628644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:31.578015+0000","last_change":"2024-05-09T09:56:31.578073+0000","last_active":"2024-05-09T09:56:31.578015+0000","last_peered":"2024-05-09T09:56:31.578015+0000","last_clean":"2024-05-09T09:56:31.578015+0000","last_became_active":"2024-05-09T09:53:09.114757+0000","last_became_peered":"2024-05-09T09:53:09.114757+0000","last_unstale":"2024-05-09T09:56:31.578015+0000","last_undegraded":"2024-05-09T09:56:31.578015+0000","last_fullsized":"2024-05-09T09:56:31.578015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:31.577810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:31.577810+0000","last_clean_scrub_stamp":"2024-05-09T09:56:31.577810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:17.383925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'20","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.003143+0000","last_change":"2024-05-09T09:56:16.003205+0000","last_active":"2024-05-09T09:56:16.003143+0000","last_peered":"2024-05-09T09:56:16.003143+0000","last_clean":"2024-05-09T09:56:16.003143+0000","last_became_active":"2024-05-09T09:55:10.494626+0000","last_became_peered":"2024-05-09T09:55:10.494626+0000","last_unstale":"2024-05-09T09:56:16.003143+0000","last_undegraded":"2024-05-09T09:56:16.003143+0000","last_fullsized":"2024-05-09T09:56:16.003143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:16.002954+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:16.002954+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.002954+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:16:57.214582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30738,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.479481+0000","last_change":"2024-05-09T09:56:25.479587+0000","last_active":"2024-05-09T09:56:25.479481+0000","last_peered":"2024-05-09T09:56:25.479481+0000","last_clean":"2024-05-09T09:56:25.479481+0000","last_became_active":"2024-05-09T09:53:01.054255+0000","last_became_peered":"2024-05-09T09:53:01.054255+0000","last_unstale":"2024-05-09T09:56:25.479481+0000","last_undegraded":"2024-05-09T09:56:25.479481+0000","last_fullsized":"2024-05-09T09:56:25.479481+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:25.479189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:25.479189+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.479189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:09:31.106352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.807358+0000","last_change":"2024-05-09T09:56:25.807414+0000","last_active":"2024-05-09T09:56:25.807358+0000","last_peered":"2024-05-09T09:56:25.807358+0000","last_clean":"2024-05-09T09:56:25.807358+0000","last_became_active":"2024-05-09T09:53:11.120427+0000","last_became_peered":"2024-05-09T09:53:11.120427+0000","last_unstale":"2024-05-09T09:56:25.807358+0000","last_undegraded":"2024-05-09T09:56:25.807358+0000","last_fullsized":"2024-05-09T09:56:25.807358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:25.807143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:25.807143+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.807143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:10:50.469762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'48","reported_seq":276,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:44.844109+0000","last_change":"2024-05-09T09:56:44.844199+0000","last_active":"2024-05-09T09:56:44.844109+0000","last_peered":"2024-05-09T09:56:44.844109+0000","last_clean":"2024-05-09T09:56:44.844109+0000","last_became_active":"2024-05-09T09:55:10.495540+0000","last_became_peered":"2024-05-09T09:55:10.495540+0000","last_unstale":"2024-05-09T09:56:44.844109+0000","last_undegraded":"2024-05-09T09:56:44.844109+0000","last_fullsized":"2024-05-09T09:56:44.844109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'48","last_scrub_stamp":"2024-05-09T09:56:44.843859+0000","last_deep_scrub":"95'48","last_deep_scrub_stamp":"2024-05-09T09:56:44.843859+0000","last_clean_scrub_stamp":"2024-05-09T09:56:44.843859+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:07.217978+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":75,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":3221,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.066543+0000","last_change":"2024-05-09T09:56:28.066599+0000","last_active":"2024-05-09T09:56:28.066543+0000","last_peered":"2024-05-09T09:56:28.066543+0000","last_clean":"2024-05-09T09:56:28.066543+0000","last_became_active":"2024-05-09T09:55:41.496466+0000","last_became_peered":"2024-05-09T09:55:41.496466+0000","last_unstale":"2024-05-09T09:56:28.066543+0000","last_undegraded":"2024-05-09T09:56:28.066543+0000","last_fullsized":"2024-05-09T09:56:28.066543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.066350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.066350+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.066350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:58.403897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.775627+0000","last_change":"2024-05-09T09:56:15.775686+0000","last_active":"2024-05-09T09:56:15.775627+0000","last_peered":"2024-05-09T09:56:15.775627+0000","last_clean":"2024-05-09T09:56:15.775627+0000","last_became_active":"2024-05-09T09:53:17.264870+0000","last_became_peered":"2024-05-09T09:53:17.264870+0000","last_unstale":"2024-05-09T09:56:15.775627+0000","last_undegraded":"2024-05-09T09:56:15.775627+0000","last_fullsized":"2024-05-09T09:56:15.775627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:15.775435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:15.775435+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.775435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:00.122066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:33.852204+0000","last_change":"2024-05-09T09:56:33.852266+0000","last_active":"2024-05-09T09:56:33.852204+0000","last_peered":"2024-05-09T09:56:33.852204+0000","last_clean":"2024-05-09T09:56:33.852204+0000","last_became_active":"2024-05-09T09:53:09.124408+0000","last_became_peered":"2024-05-09T09:53:09.124408+0000","last_unstale":"2024-05-09T09:56:33.852204+0000","last_undegraded":"2024-05-09T09:56:33.852204+0000","last_fullsized":"2024-05-09T09:56:33.852204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:33.851958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:33.851958+0000","last_clean_scrub_stamp":"2024-05-09T09:56:33.851958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:06.014447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'12","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.554372+0000","last_change":"2024-05-09T09:56:28.554431+0000","last_active":"2024-05-09T09:56:28.554372+0000","last_peered":"2024-05-09T09:56:28.554372+0000","last_clean":"2024-05-09T09:56:28.554372+0000","last_became_active":"2024-05-09T09:53:07.108386+0000","last_became_peered":"2024-05-09T09:53:07.108386+0000","last_unstale":"2024-05-09T09:56:28.554372+0000","last_undegraded":"2024-05-09T09:56:28.554372+0000","last_fullsized":"2024-05-09T09:56:28.554372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:28.554187+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:28.554187+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.554187+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:58.403451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22546,"num_write":42,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:35.876070+0000","last_change":"2024-05-09T09:56:35.876123+0000","last_active":"2024-05-09T09:56:35.876070+0000","last_peered":"2024-05-09T09:56:35.876070+0000","last_clean":"2024-05-09T09:56:35.876070+0000","last_became_active":"2024-05-09T09:53:01.055677+0000","last_became_peered":"2024-05-09T09:53:01.055677+0000","last_unstale":"2024-05-09T09:56:35.876070+0000","last_undegraded":"2024-05-09T09:56:35.876070+0000","last_fullsized":"2024-05-09T09:56:35.876070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:35.875879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:35.875879+0000","last_clean_scrub_stamp":"2024-05-09T09:56:35.875879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:16.902444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.714673+0000","last_change":"2024-05-09T09:56:19.714727+0000","last_active":"2024-05-09T09:56:19.714673+0000","last_peered":"2024-05-09T09:56:19.714673+0000","last_clean":"2024-05-09T09:56:19.714673+0000","last_became_active":"2024-05-09T09:53:11.120719+0000","last_became_peered":"2024-05-09T09:53:11.120719+0000","last_unstale":"2024-05-09T09:56:19.714673+0000","last_undegraded":"2024-05-09T09:56:19.714673+0000","last_fullsized":"2024-05-09T09:56:19.714673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:19.714478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:19.714478+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.714478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:07.323842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"95'21","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:12.381471+0000","last_change":"2024-05-09T09:56:12.381533+0000","last_active":"2024-05-09T09:56:12.381471+0000","last_peered":"2024-05-09T09:56:12.381471+0000","last_clean":"2024-05-09T09:56:12.381471+0000","last_became_active":"2024-05-09T09:53:13.144660+0000","last_became_peered":"2024-05-09T09:53:13.144660+0000","last_unstale":"2024-05-09T09:56:12.381471+0000","last_undegraded":"2024-05-09T09:56:12.381471+0000","last_fullsized":"2024-05-09T09:56:12.381471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-05-09T09:56:12.381382+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-05-09T09:56:12.381382+0000","last_clean_scrub_stamp":"2024-05-09T09:56:12.381382+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:02.941712+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'18","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.879620+0000","last_change":"2024-05-09T09:56:23.879684+0000","last_active":"2024-05-09T09:56:23.879620+0000","last_peered":"2024-05-09T09:56:23.879620+0000","last_clean":"2024-05-09T09:56:23.879620+0000","last_became_active":"2024-05-09T09:53:15.172033+0000","last_became_peered":"2024-05-09T09:53:15.172033+0000","last_unstale":"2024-05-09T09:56:23.879620+0000","last_undegraded":"2024-05-09T09:56:23.879620+0000","last_fullsized":"2024-05-09T09:56:23.879620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:23.879433+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:23.879433+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.879433+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:03.546682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:30.363289+0000","last_change":"2024-05-09T09:56:30.363351+0000","last_active":"2024-05-09T09:56:30.363289+0000","last_peered":"2024-05-09T09:56:30.363289+0000","last_clean":"2024-05-09T09:56:30.363289+0000","last_became_active":"2024-05-09T09:55:10.515588+0000","last_became_peered":"2024-05-09T09:55:10.515588+0000","last_unstale":"2024-05-09T09:56:30.363289+0000","last_undegraded":"2024-05-09T09:56:30.363289+0000","last_fullsized":"2024-05-09T09:56:30.363289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:30.363087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:30.363087+0000","last_clean_scrub_stamp":"2024-05-09T09:56:30.363087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:41.463732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"75'44","reported_seq":65,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.335282+0000","last_change":"2024-05-09T09:56:14.335305+0000","last_active":"2024-05-09T09:56:14.335282+0000","last_peered":"2024-05-09T09:56:14.335282+0000","last_clean":"2024-05-09T09:56:14.335282+0000","last_became_active":"2024-05-09T09:55:10.518766+0000","last_became_peered":"2024-05-09T09:55:10.518766+0000","last_unstale":"2024-05-09T09:56:14.335282+0000","last_undegraded":"2024-05-09T09:56:14.335282+0000","last_fullsized":"2024-05-09T09:56:14.335282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'44","last_scrub_stamp":"2024-05-09T09:56:14.335184+0000","last_deep_scrub":"75'44","last_deep_scrub_stamp":"2024-05-09T09:56:14.335184+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.335184+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:50:52.481059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":112,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"95'20","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:47.481946+0000","last_change":"2024-05-09T09:56:47.482010+0000","last_active":"2024-05-09T09:56:47.481946+0000","last_peered":"2024-05-09T09:56:47.481946+0000","last_clean":"2024-05-09T09:56:47.481946+0000","last_became_active":"2024-05-09T09:55:10.509265+0000","last_became_peered":"2024-05-09T09:55:10.509265+0000","last_unstale":"2024-05-09T09:56:47.481946+0000","last_undegraded":"2024-05-09T09:56:47.481946+0000","last_fullsized":"2024-05-09T09:56:47.481946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:47.481741+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:47.481741+0000","last_clean_scrub_stamp":"2024-05-09T09:56:47.481741+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:25.223167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16398,"num_write":50,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.435409+0000","last_change":"2024-05-09T09:56:24.435465+0000","last_active":"2024-05-09T09:56:24.435409+0000","last_peered":"2024-05-09T09:56:24.435409+0000","last_clean":"2024-05-09T09:56:24.435409+0000","last_became_active":"2024-05-09T09:53:01.051610+0000","last_became_peered":"2024-05-09T09:53:01.051610+0000","last_unstale":"2024-05-09T09:56:24.435409+0000","last_undegraded":"2024-05-09T09:56:24.435409+0000","last_fullsized":"2024-05-09T09:56:24.435409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.435217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.435217+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.435217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:15.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.988325+0000","last_change":"2024-05-09T09:56:23.988379+0000","last_active":"2024-05-09T09:56:23.988325+0000","last_peered":"2024-05-09T09:56:23.988325+0000","last_clean":"2024-05-09T09:56:23.988325+0000","last_became_active":"2024-05-09T09:55:41.498766+0000","last_became_peered":"2024-05-09T09:55:41.498766+0000","last_unstale":"2024-05-09T09:56:23.988325+0000","last_undegraded":"2024-05-09T09:56:23.988325+0000","last_fullsized":"2024-05-09T09:56:23.988325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.988135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.988135+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.988135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:54.033623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"95'15","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:45.054732+0000","last_change":"2024-05-09T09:56:45.054807+0000","last_active":"2024-05-09T09:56:45.054732+0000","last_peered":"2024-05-09T09:56:45.054732+0000","last_clean":"2024-05-09T09:56:45.054732+0000","last_became_active":"2024-05-09T09:55:41.513003+0000","last_became_peered":"2024-05-09T09:55:41.513003+0000","last_unstale":"2024-05-09T09:56:45.054732+0000","last_undegraded":"2024-05-09T09:56:45.054732+0000","last_fullsized":"2024-05-09T09:56:45.054732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-05-09T09:56:45.054535+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-05-09T09:56:45.054535+0000","last_clean_scrub_stamp":"2024-05-09T09:56:45.054535+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:53.153636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'21","reported_seq":79,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:31.397566+0000","last_change":"2024-05-09T09:56:31.397629+0000","last_active":"2024-05-09T09:56:31.397566+0000","last_peered":"2024-05-09T09:56:31.397566+0000","last_clean":"2024-05-09T09:56:31.397566+0000","last_became_active":"2024-05-09T09:55:10.505477+0000","last_became_peered":"2024-05-09T09:55:10.505477+0000","last_unstale":"2024-05-09T09:56:31.397566+0000","last_undegraded":"2024-05-09T09:56:31.397566+0000","last_fullsized":"2024-05-09T09:56:31.397566+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-05-09T09:56:31.397375+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-05-09T09:56:31.397375+0000","last_clean_scrub_stamp":"2024-05-09T09:56:31.397375+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:16:15.793721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:11.784247+0000","last_change":"2024-05-09T09:56:11.784311+0000","last_active":"2024-05-09T09:56:11.784247+0000","last_peered":"2024-05-09T09:56:11.784247+0000","last_clean":"2024-05-09T09:56:11.784247+0000","last_became_active":"2024-05-09T09:55:10.494445+0000","last_became_peered":"2024-05-09T09:55:10.494445+0000","last_unstale":"2024-05-09T09:56:11.784247+0000","last_undegraded":"2024-05-09T09:56:11.784247+0000","last_fullsized":"2024-05-09T09:56:11.784247+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:11.784030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:11.784030+0000","last_clean_scrub_stamp":"2024-05-09T09:56:11.784030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:33.505969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"63'10","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.850428+0000","last_change":"2024-05-09T09:56:14.850489+0000","last_active":"2024-05-09T09:56:14.850428+0000","last_peered":"2024-05-09T09:56:14.850428+0000","last_clean":"2024-05-09T09:56:14.850428+0000","last_became_active":"2024-05-09T09:55:41.480316+0000","last_became_peered":"2024-05-09T09:55:41.480316+0000","last_unstale":"2024-05-09T09:56:14.850428+0000","last_undegraded":"2024-05-09T09:56:14.850428+0000","last_fullsized":"2024-05-09T09:56:14.850428+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'10","last_scrub_stamp":"2024-05-09T09:56:14.850233+0000","last_deep_scrub":"63'10","last_deep_scrub_stamp":"2024-05-09T09:56:14.850233+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.850233+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:58.502827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'22","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:36.842377+0000","last_change":"2024-05-09T09:56:36.842456+0000","last_active":"2024-05-09T09:56:36.842377+0000","last_peered":"2024-05-09T09:56:36.842377+0000","last_clean":"2024-05-09T09:56:36.842377+0000","last_became_active":"2024-05-09T09:53:07.098274+0000","last_became_peered":"2024-05-09T09:53:07.098274+0000","last_unstale":"2024-05-09T09:56:36.842377+0000","last_undegraded":"2024-05-09T09:56:36.842377+0000","last_fullsized":"2024-05-09T09:56:36.842377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-05-09T09:56:36.842162+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-05-09T09:56:36.842162+0000","last_clean_scrub_stamp":"2024-05-09T09:56:36.842162+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:23:51.775585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.824260+0000","last_change":"2024-05-09T09:56:24.824411+0000","last_active":"2024-05-09T09:56:24.824260+0000","last_peered":"2024-05-09T09:56:24.824260+0000","last_clean":"2024-05-09T09:56:24.824260+0000","last_became_active":"2024-05-09T09:53:01.051644+0000","last_became_peered":"2024-05-09T09:53:01.051644+0000","last_unstale":"2024-05-09T09:56:24.824260+0000","last_undegraded":"2024-05-09T09:56:24.824260+0000","last_fullsized":"2024-05-09T09:56:24.824260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.823957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.823957+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.823957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:21:57.635076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.368612+0000","last_change":"2024-05-09T09:56:28.368731+0000","last_active":"2024-05-09T09:56:28.368612+0000","last_peered":"2024-05-09T09:56:28.368612+0000","last_clean":"2024-05-09T09:56:28.368612+0000","last_became_active":"2024-05-09T09:55:10.505544+0000","last_became_peered":"2024-05-09T09:55:10.505544+0000","last_unstale":"2024-05-09T09:56:28.368612+0000","last_undegraded":"2024-05-09T09:56:28.368612+0000","last_fullsized":"2024-05-09T09:56:28.368612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.368363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.368363+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.368363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:28:14.775391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'55","reported_seq":243,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.936305+0000","last_change":"2024-05-09T09:56:17.936405+0000","last_active":"2024-05-09T09:56:17.936305+0000","last_peered":"2024-05-09T09:56:17.936305+0000","last_clean":"2024-05-09T09:56:17.936305+0000","last_became_active":"2024-05-09T09:53:13.145673+0000","last_became_peered":"2024-05-09T09:53:13.145673+0000","last_unstale":"2024-05-09T09:56:17.936305+0000","last_undegraded":"2024-05-09T09:56:17.936305+0000","last_fullsized":"2024-05-09T09:56:17.936305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'55","last_scrub_stamp":"2024-05-09T09:56:17.936080+0000","last_deep_scrub":"95'55","last_deep_scrub_stamp":"2024-05-09T09:56:17.936080+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.936080+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:21:50.747199+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":80,"num_read_kb":110,"num_write":48,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:39.438601+0000","last_change":"2024-05-09T09:56:39.438662+0000","last_active":"2024-05-09T09:56:39.438601+0000","last_peered":"2024-05-09T09:56:39.438601+0000","last_clean":"2024-05-09T09:56:39.438601+0000","last_became_active":"2024-05-09T09:55:10.498080+0000","last_became_peered":"2024-05-09T09:55:10.498080+0000","last_unstale":"2024-05-09T09:56:39.438601+0000","last_undegraded":"2024-05-09T09:56:39.438601+0000","last_fullsized":"2024-05-09T09:56:39.438601+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:39.438278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:39.438278+0000","last_clean_scrub_stamp":"2024-05-09T09:56:39.438278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:23.181293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'2","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.969769+0000","last_change":"2024-05-09T09:56:25.969841+0000","last_active":"2024-05-09T09:56:25.969769+0000","last_peered":"2024-05-09T09:56:25.969769+0000","last_clean":"2024-05-09T09:56:25.969769+0000","last_became_active":"2024-05-09T09:53:17.189624+0000","last_became_peered":"2024-05-09T09:53:17.189624+0000","last_unstale":"2024-05-09T09:56:25.969769+0000","last_undegraded":"2024-05-09T09:56:25.969769+0000","last_fullsized":"2024-05-09T09:56:25.969769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-05-09T09:56:25.969575+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-05-09T09:56:25.969575+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.969575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:29:10.177967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.776336+0000","last_change":"2024-05-09T09:56:17.776396+0000","last_active":"2024-05-09T09:56:17.776336+0000","last_peered":"2024-05-09T09:56:17.776336+0000","last_clean":"2024-05-09T09:56:17.776336+0000","last_became_active":"2024-05-09T09:53:17.183788+0000","last_became_peered":"2024-05-09T09:53:17.183788+0000","last_unstale":"2024-05-09T09:56:17.776336+0000","last_undegraded":"2024-05-09T09:56:17.776336+0000","last_fullsized":"2024-05-09T09:56:17.776336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:17.776127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:17.776127+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.776127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:18.085682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'2","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:46.099186+0000","last_change":"2024-05-09T09:56:46.099249+0000","last_active":"2024-05-09T09:56:46.099186+0000","last_peered":"2024-05-09T09:56:46.099186+0000","last_clean":"2024-05-09T09:56:46.099186+0000","last_became_active":"2024-05-09T09:55:41.516290+0000","last_became_peered":"2024-05-09T09:55:41.516290+0000","last_unstale":"2024-05-09T09:56:46.099186+0000","last_undegraded":"2024-05-09T09:56:46.099186+0000","last_fullsized":"2024-05-09T09:56:46.099186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-05-09T09:56:46.098964+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-05-09T09:56:46.098964+0000","last_clean_scrub_stamp":"2024-05-09T09:56:46.098964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:30.224821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'16","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.916572+0000","last_change":"2024-05-09T09:56:16.916715+0000","last_active":"2024-05-09T09:56:16.916572+0000","last_peered":"2024-05-09T09:56:16.916572+0000","last_clean":"2024-05-09T09:56:16.916572+0000","last_became_active":"2024-05-09T09:55:41.489973+0000","last_became_peered":"2024-05-09T09:55:41.489973+0000","last_unstale":"2024-05-09T09:56:16.916572+0000","last_undegraded":"2024-05-09T09:56:16.916572+0000","last_fullsized":"2024-05-09T09:56:16.916572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:16.916318+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:16.916318+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.916318+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:32.278440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":30736,"num_write":46,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.403175+0000","last_change":"2024-05-09T09:56:17.403235+0000","last_active":"2024-05-09T09:56:17.403175+0000","last_peered":"2024-05-09T09:56:17.403175+0000","last_clean":"2024-05-09T09:56:17.403175+0000","last_became_active":"2024-05-09T09:53:11.127357+0000","last_became_peered":"2024-05-09T09:53:11.127357+0000","last_unstale":"2024-05-09T09:56:17.403175+0000","last_undegraded":"2024-05-09T09:56:17.403175+0000","last_fullsized":"2024-05-09T09:56:17.403175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:17.402949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:17.402949+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.402949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:21:50.214069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'27","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:35.421248+0000","last_change":"2024-05-09T09:56:35.421283+0000","last_active":"2024-05-09T09:56:35.421248+0000","last_peered":"2024-05-09T09:56:35.421248+0000","last_clean":"2024-05-09T09:56:35.421248+0000","last_became_active":"2024-05-09T09:55:10.507307+0000","last_became_peered":"2024-05-09T09:55:10.507307+0000","last_unstale":"2024-05-09T09:56:35.421248+0000","last_undegraded":"2024-05-09T09:56:35.421248+0000","last_fullsized":"2024-05-09T09:56:35.421248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'27","last_scrub_stamp":"2024-05-09T09:56:35.421161+0000","last_deep_scrub":"95'27","last_deep_scrub_stamp":"2024-05-09T09:56:35.421161+0000","last_clean_scrub_stamp":"2024-05-09T09:56:35.421161+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:43.292533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":48,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.414085+0000","last_change":"2024-05-09T09:56:26.414146+0000","last_active":"2024-05-09T09:56:26.414085+0000","last_peered":"2024-05-09T09:56:26.414085+0000","last_clean":"2024-05-09T09:56:26.414085+0000","last_became_active":"2024-05-09T09:55:10.518305+0000","last_became_peered":"2024-05-09T09:55:10.518305+0000","last_unstale":"2024-05-09T09:56:26.414085+0000","last_undegraded":"2024-05-09T09:56:26.414085+0000","last_fullsized":"2024-05-09T09:56:26.414085+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.413869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.413869+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.413869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:10.539726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:44.491387+0000","last_change":"2024-05-09T09:56:44.491441+0000","last_active":"2024-05-09T09:56:44.491387+0000","last_peered":"2024-05-09T09:56:44.491387+0000","last_clean":"2024-05-09T09:56:44.491387+0000","last_became_active":"2024-05-09T09:55:10.504822+0000","last_became_peered":"2024-05-09T09:55:10.504822+0000","last_unstale":"2024-05-09T09:56:44.491387+0000","last_undegraded":"2024-05-09T09:56:44.491387+0000","last_fullsized":"2024-05-09T09:56:44.491387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:44.491198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:44.491198+0000","last_clean_scrub_stamp":"2024-05-09T09:56:44.491198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:22.820352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.953410+0000","last_change":"2024-05-09T09:56:16.953469+0000","last_active":"2024-05-09T09:56:16.953410+0000","last_peered":"2024-05-09T09:56:16.953410+0000","last_clean":"2024-05-09T09:56:16.953410+0000","last_became_active":"2024-05-09T09:54:55.398970+0000","last_became_peered":"2024-05-09T09:54:55.398970+0000","last_unstale":"2024-05-09T09:56:16.953410+0000","last_undegraded":"2024-05-09T09:56:16.953410+0000","last_fullsized":"2024-05-09T09:56:16.953410+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.953217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.953217+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.953217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:24.297227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"95'14","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:14.915500+0000","last_change":"2024-05-09T09:56:14.915700+0000","last_active":"2024-05-09T09:56:14.915500+0000","last_peered":"2024-05-09T09:56:14.915500+0000","last_clean":"2024-05-09T09:56:14.915500+0000","last_became_active":"2024-05-09T09:55:10.499847+0000","last_became_peered":"2024-05-09T09:55:10.499847+0000","last_unstale":"2024-05-09T09:56:14.915500+0000","last_undegraded":"2024-05-09T09:56:14.915500+0000","last_fullsized":"2024-05-09T09:56:14.915500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:14.915275+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:14.915275+0000","last_clean_scrub_stamp":"2024-05-09T09:56:14.915275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:13.004789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28690,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:46.498705+0000","last_change":"2024-05-09T09:56:46.498804+0000","last_active":"2024-05-09T09:56:46.498705+0000","last_peered":"2024-05-09T09:56:46.498705+0000","last_clean":"2024-05-09T09:56:46.498705+0000","last_became_active":"2024-05-09T09:55:10.506831+0000","last_became_peered":"2024-05-09T09:55:10.506831+0000","last_unstale":"2024-05-09T09:56:46.498705+0000","last_undegraded":"2024-05-09T09:56:46.498705+0000","last_fullsized":"2024-05-09T09:56:46.498705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:46.498426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:46.498426+0000","last_clean_scrub_stamp":"2024-05-09T09:56:46.498426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:52.567166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"95'8","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.776530+0000","last_change":"2024-05-09T09:56:18.776603+0000","last_active":"2024-05-09T09:56:18.776530+0000","last_peered":"2024-05-09T09:56:18.776530+0000","last_clean":"2024-05-09T09:56:18.776530+0000","last_became_active":"2024-05-09T09:53:13.129518+0000","last_became_peered":"2024-05-09T09:53:13.129518+0000","last_unstale":"2024-05-09T09:56:18.776530+0000","last_undegraded":"2024-05-09T09:56:18.776530+0000","last_fullsized":"2024-05-09T09:56:18.776530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-05-09T09:56:18.776333+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-05-09T09:56:18.776333+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.776333+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:48.821821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.956126+0000","last_change":"2024-05-09T09:56:27.956181+0000","last_active":"2024-05-09T09:56:27.956126+0000","last_peered":"2024-05-09T09:56:27.956126+0000","last_clean":"2024-05-09T09:56:27.956126+0000","last_became_active":"2024-05-09T09:53:15.179651+0000","last_became_peered":"2024-05-09T09:53:15.179651+0000","last_unstale":"2024-05-09T09:56:27.956126+0000","last_undegraded":"2024-05-09T09:56:27.956126+0000","last_fullsized":"2024-05-09T09:56:27.956126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:27.955920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:27.955920+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.955920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:58.001408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:32.834146+0000","last_change":"2024-05-09T09:56:32.834205+0000","last_active":"2024-05-09T09:56:32.834146+0000","last_peered":"2024-05-09T09:56:32.834146+0000","last_clean":"2024-05-09T09:56:32.834146+0000","last_became_active":"2024-05-09T09:53:17.175447+0000","last_became_peered":"2024-05-09T09:53:17.175447+0000","last_unstale":"2024-05-09T09:56:32.834146+0000","last_undegraded":"2024-05-09T09:56:32.834146+0000","last_fullsized":"2024-05-09T09:56:32.834146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:32.833941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:32.833941+0000","last_clean_scrub_stamp":"2024-05-09T09:56:32.833941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:38.248370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:32.389803+0000","last_change":"2024-05-09T09:56:32.389865+0000","last_active":"2024-05-09T09:56:32.389803+0000","last_peered":"2024-05-09T09:56:32.389803+0000","last_clean":"2024-05-09T09:56:32.389803+0000","last_became_active":"2024-05-09T09:55:10.513915+0000","last_became_peered":"2024-05-09T09:55:10.513915+0000","last_unstale":"2024-05-09T09:56:32.389803+0000","last_undegraded":"2024-05-09T09:56:32.389803+0000","last_fullsized":"2024-05-09T09:56:32.389803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:32.389581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:32.389581+0000","last_clean_scrub_stamp":"2024-05-09T09:56:32.389581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:24:32.420588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'18","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:38.940966+0000","last_change":"2024-05-09T09:56:38.941025+0000","last_active":"2024-05-09T09:56:38.940966+0000","last_peered":"2024-05-09T09:56:38.940966+0000","last_clean":"2024-05-09T09:56:38.940966+0000","last_became_active":"2024-05-09T09:53:07.123756+0000","last_became_peered":"2024-05-09T09:53:07.123756+0000","last_unstale":"2024-05-09T09:56:38.940966+0000","last_undegraded":"2024-05-09T09:56:38.940966+0000","last_fullsized":"2024-05-09T09:56:38.940966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:38.940765+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:38.940765+0000","last_clean_scrub_stamp":"2024-05-09T09:56:38.940765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:52:46.463938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"95'2","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:43.914322+0000","last_change":"2024-05-09T09:56:43.914399+0000","last_active":"2024-05-09T09:56:43.914322+0000","last_peered":"2024-05-09T09:56:43.914322+0000","last_clean":"2024-05-09T09:56:43.914322+0000","last_became_active":"2024-05-09T09:55:41.506927+0000","last_became_peered":"2024-05-09T09:55:41.506927+0000","last_unstale":"2024-05-09T09:56:43.914322+0000","last_undegraded":"2024-05-09T09:56:43.914322+0000","last_fullsized":"2024-05-09T09:56:43.914322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-05-09T09:56:43.914075+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-05-09T09:56:43.914075+0000","last_clean_scrub_stamp":"2024-05-09T09:56:43.914075+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:38.603782+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'29","reported_seq":81,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.316721+0000","last_change":"2024-05-09T09:56:19.316813+0000","last_active":"2024-05-09T09:56:19.316721+0000","last_peered":"2024-05-09T09:56:19.316721+0000","last_clean":"2024-05-09T09:56:19.316721+0000","last_became_active":"2024-05-09T09:55:10.507511+0000","last_became_peered":"2024-05-09T09:55:10.507511+0000","last_unstale":"2024-05-09T09:56:19.316721+0000","last_undegraded":"2024-05-09T09:56:19.316721+0000","last_fullsized":"2024-05-09T09:56:19.316721+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-05-09T09:56:19.316528+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-05-09T09:56:19.316528+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.316528+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:13.896163+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":70,"num_write":28,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.737486+0000","last_change":"2024-05-09T09:56:16.737542+0000","last_active":"2024-05-09T09:56:16.737486+0000","last_peered":"2024-05-09T09:56:16.737486+0000","last_clean":"2024-05-09T09:56:16.737486+0000","last_became_active":"2024-05-09T09:53:15.174024+0000","last_became_peered":"2024-05-09T09:53:15.174024+0000","last_unstale":"2024-05-09T09:56:16.737486+0000","last_undegraded":"2024-05-09T09:56:16.737486+0000","last_fullsized":"2024-05-09T09:56:16.737486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.737271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.737271+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.737271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:06.379489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.963854+0000","last_change":"2024-05-09T09:56:27.964022+0000","last_active":"2024-05-09T09:56:27.963854+0000","last_peered":"2024-05-09T09:56:27.963854+0000","last_clean":"2024-05-09T09:56:27.963854+0000","last_became_active":"2024-05-09T09:53:17.189505+0000","last_became_peered":"2024-05-09T09:53:17.189505+0000","last_unstale":"2024-05-09T09:56:27.963854+0000","last_undegraded":"2024-05-09T09:56:27.963854+0000","last_fullsized":"2024-05-09T09:56:27.963854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-05-09T09:56:27.963622+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-05-09T09:56:27.963622+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.963622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:33:41.711059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'38","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.267817+0000","last_change":"2024-05-09T09:56:17.267884+0000","last_active":"2024-05-09T09:56:17.267817+0000","last_peered":"2024-05-09T09:56:17.267817+0000","last_clean":"2024-05-09T09:56:17.267817+0000","last_became_active":"2024-05-09T09:55:10.520941+0000","last_became_peered":"2024-05-09T09:55:10.520941+0000","last_unstale":"2024-05-09T09:56:17.267817+0000","last_undegraded":"2024-05-09T09:56:17.267817+0000","last_fullsized":"2024-05-09T09:56:17.267817+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-05-09T09:56:17.267613+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-05-09T09:56:17.267613+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.267613+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:50:34.317978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'16","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:37.816359+0000","last_change":"2024-05-09T09:56:37.816537+0000","last_active":"2024-05-09T09:56:37.816359+0000","last_peered":"2024-05-09T09:56:37.816359+0000","last_clean":"2024-05-09T09:56:37.816359+0000","last_became_active":"2024-05-09T09:53:07.117440+0000","last_became_peered":"2024-05-09T09:53:07.117440+0000","last_unstale":"2024-05-09T09:56:37.816359+0000","last_undegraded":"2024-05-09T09:56:37.816359+0000","last_fullsized":"2024-05-09T09:56:37.816359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:37.816063+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:37.816063+0000","last_clean_scrub_stamp":"2024-05-09T09:56:37.816063+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:21:26.710245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:36.900443+0000","last_change":"2024-05-09T09:56:36.900610+0000","last_active":"2024-05-09T09:56:36.900443+0000","last_peered":"2024-05-09T09:56:36.900443+0000","last_clean":"2024-05-09T09:56:36.900443+0000","last_became_active":"2024-05-09T09:55:41.514849+0000","last_became_peered":"2024-05-09T09:55:41.514849+0000","last_unstale":"2024-05-09T09:56:36.900443+0000","last_undegraded":"2024-05-09T09:56:36.900443+0000","last_fullsized":"2024-05-09T09:56:36.900443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:36.900249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:36.900249+0000","last_clean_scrub_stamp":"2024-05-09T09:56:36.900249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:03.648309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'22","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.891914+0000","last_change":"2024-05-09T09:56:22.892098+0000","last_active":"2024-05-09T09:56:22.891914+0000","last_peered":"2024-05-09T09:56:22.891914+0000","last_clean":"2024-05-09T09:56:22.891914+0000","last_became_active":"2024-05-09T09:53:13.136538+0000","last_became_peered":"2024-05-09T09:53:13.136538+0000","last_unstale":"2024-05-09T09:56:22.891914+0000","last_undegraded":"2024-05-09T09:56:22.891914+0000","last_fullsized":"2024-05-09T09:56:22.891914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-05-09T09:56:22.891669+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-05-09T09:56:22.891669+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.891669+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:49:34.255827+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.795823+0000","last_change":"2024-05-09T09:56:20.795879+0000","last_active":"2024-05-09T09:56:20.795823+0000","last_peered":"2024-05-09T09:56:20.795823+0000","last_clean":"2024-05-09T09:56:20.795823+0000","last_became_active":"2024-05-09T09:53:15.167100+0000","last_became_peered":"2024-05-09T09:53:15.167100+0000","last_unstale":"2024-05-09T09:56:20.795823+0000","last_undegraded":"2024-05-09T09:56:20.795823+0000","last_fullsized":"2024-05-09T09:56:20.795823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:20.795584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:20.795584+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.795584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:47.543645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:31.917279+0000","last_change":"2024-05-09T09:56:31.917332+0000","last_active":"2024-05-09T09:56:31.917279+0000","last_peered":"2024-05-09T09:56:31.917279+0000","last_clean":"2024-05-09T09:56:31.917279+0000","last_became_active":"2024-05-09T09:53:09.113952+0000","last_became_peered":"2024-05-09T09:53:09.113952+0000","last_unstale":"2024-05-09T09:56:31.917279+0000","last_undegraded":"2024-05-09T09:56:31.917279+0000","last_fullsized":"2024-05-09T09:56:31.917279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:31.917052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:31.917052+0000","last_clean_scrub_stamp":"2024-05-09T09:56:31.917052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:23.274404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'20","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:31.495149+0000","last_change":"2024-05-09T09:56:31.495298+0000","last_active":"2024-05-09T09:56:31.495149+0000","last_peered":"2024-05-09T09:56:31.495149+0000","last_clean":"2024-05-09T09:56:31.495149+0000","last_became_active":"2024-05-09T09:55:55.677234+0000","last_became_peered":"2024-05-09T09:55:55.677234+0000","last_unstale":"2024-05-09T09:56:31.495149+0000","last_undegraded":"2024-05-09T09:56:31.495149+0000","last_fullsized":"2024-05-09T09:56:31.495149+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:31.494919+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:31.494919+0000","last_clean_scrub_stamp":"2024-05-09T09:56:31.494919+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:37:22.243924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8196,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.796088+0000","last_change":"2024-05-09T09:56:29.796153+0000","last_active":"2024-05-09T09:56:29.796088+0000","last_peered":"2024-05-09T09:56:29.796088+0000","last_clean":"2024-05-09T09:56:29.796088+0000","last_became_active":"2024-05-09T09:53:11.113081+0000","last_became_peered":"2024-05-09T09:53:11.113081+0000","last_unstale":"2024-05-09T09:56:29.796088+0000","last_undegraded":"2024-05-09T09:56:29.796088+0000","last_fullsized":"2024-05-09T09:56:29.796088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:29.795870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:29.795870+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.795870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:28.635761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'37","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.442851+0000","last_change":"2024-05-09T09:56:15.442943+0000","last_active":"2024-05-09T09:56:15.442851+0000","last_peered":"2024-05-09T09:56:15.442851+0000","last_clean":"2024-05-09T09:56:15.442851+0000","last_became_active":"2024-05-09T09:53:13.141903+0000","last_became_peered":"2024-05-09T09:53:13.141903+0000","last_unstale":"2024-05-09T09:56:15.442851+0000","last_undegraded":"2024-05-09T09:56:15.442851+0000","last_fullsized":"2024-05-09T09:56:15.442851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'37","last_scrub_stamp":"2024-05-09T09:56:15.442651+0000","last_deep_scrub":"95'37","last_deep_scrub_stamp":"2024-05-09T09:56:15.442651+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.442651+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:15.977669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":104,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.886059+0000","last_change":"2024-05-09T09:56:18.886133+0000","last_active":"2024-05-09T09:56:18.886059+0000","last_peered":"2024-05-09T09:56:18.886059+0000","last_clean":"2024-05-09T09:56:18.886059+0000","last_became_active":"2024-05-09T09:55:10.494186+0000","last_became_peered":"2024-05-09T09:55:10.494186+0000","last_unstale":"2024-05-09T09:56:18.886059+0000","last_undegraded":"2024-05-09T09:56:18.886059+0000","last_fullsized":"2024-05-09T09:56:18.886059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:18.885838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:18.885838+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.885838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:11:01.093395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:43.462202+0000","last_change":"2024-05-09T09:56:43.462258+0000","last_active":"2024-05-09T09:56:43.462202+0000","last_peered":"2024-05-09T09:56:43.462202+0000","last_clean":"2024-05-09T09:56:43.462202+0000","last_became_active":"2024-05-09T09:55:10.504907+0000","last_became_peered":"2024-05-09T09:55:10.504907+0000","last_unstale":"2024-05-09T09:56:43.462202+0000","last_undegraded":"2024-05-09T09:56:43.462202+0000","last_fullsized":"2024-05-09T09:56:43.462202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:43.461990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:43.461990+0000","last_clean_scrub_stamp":"2024-05-09T09:56:43.461990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:42:14.661998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:31.828930+0000","last_change":"2024-05-09T09:56:31.828988+0000","last_active":"2024-05-09T09:56:31.828930+0000","last_peered":"2024-05-09T09:56:31.828930+0000","last_clean":"2024-05-09T09:56:31.828930+0000","last_became_active":"2024-05-09T09:53:09.125179+0000","last_became_peered":"2024-05-09T09:53:09.125179+0000","last_unstale":"2024-05-09T09:56:31.828930+0000","last_undegraded":"2024-05-09T09:56:31.828930+0000","last_fullsized":"2024-05-09T09:56:31.828930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:31.828728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:31.828728+0000","last_clean_scrub_stamp":"2024-05-09T09:56:31.828728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:44:56.559118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'6","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:34.529742+0000","last_change":"2024-05-09T09:56:34.529872+0000","last_active":"2024-05-09T09:56:34.529742+0000","last_peered":"2024-05-09T09:56:34.529742+0000","last_clean":"2024-05-09T09:56:34.529742+0000","last_became_active":"2024-05-09T09:55:10.497596+0000","last_became_peered":"2024-05-09T09:55:10.497596+0000","last_unstale":"2024-05-09T09:56:34.529742+0000","last_undegraded":"2024-05-09T09:56:34.529742+0000","last_fullsized":"2024-05-09T09:56:34.529742+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'6","last_scrub_stamp":"2024-05-09T09:56:34.529440+0000","last_deep_scrub":"95'6","last_deep_scrub_stamp":"2024-05-09T09:56:34.529440+0000","last_clean_scrub_stamp":"2024-05-09T09:56:34.529440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:10:59.192059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:34.862532+0000","last_change":"2024-05-09T09:56:34.862590+0000","last_active":"2024-05-09T09:56:34.862532+0000","last_peered":"2024-05-09T09:56:34.862532+0000","last_clean":"2024-05-09T09:56:34.862532+0000","last_became_active":"2024-05-09T09:55:41.513248+0000","last_became_peered":"2024-05-09T09:55:41.513248+0000","last_unstale":"2024-05-09T09:56:34.862532+0000","last_undegraded":"2024-05-09T09:56:34.862532+0000","last_fullsized":"2024-05-09T09:56:34.862532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:34.862331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:34.862331+0000","last_clean_scrub_stamp":"2024-05-09T09:56:34.862331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:16:04.907819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'37","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.927734+0000","last_change":"2024-05-09T09:56:24.927816+0000","last_active":"2024-05-09T09:56:24.927734+0000","last_peered":"2024-05-09T09:56:24.927734+0000","last_clean":"2024-05-09T09:56:24.927734+0000","last_became_active":"2024-05-09T09:53:13.136501+0000","last_became_peered":"2024-05-09T09:53:13.136501+0000","last_unstale":"2024-05-09T09:56:24.927734+0000","last_undegraded":"2024-05-09T09:56:24.927734+0000","last_fullsized":"2024-05-09T09:56:24.927734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'37","last_scrub_stamp":"2024-05-09T09:56:24.927532+0000","last_deep_scrub":"95'37","last_deep_scrub_stamp":"2024-05-09T09:56:24.927532+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.927532+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:16.284884+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":51,"num_read_kb":77,"num_write":36,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.399693+0000","last_change":"2024-05-09T09:56:16.399811+0000","last_active":"2024-05-09T09:56:16.399693+0000","last_peered":"2024-05-09T09:56:16.399693+0000","last_clean":"2024-05-09T09:56:16.399693+0000","last_became_active":"2024-05-09T09:53:15.178872+0000","last_became_peered":"2024-05-09T09:53:15.178872+0000","last_unstale":"2024-05-09T09:56:16.399693+0000","last_undegraded":"2024-05-09T09:56:16.399693+0000","last_fullsized":"2024-05-09T09:56:16.399693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.399437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.399437+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.399437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:23.743447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"63'4","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.676916+0000","last_change":"2024-05-09T09:56:18.676981+0000","last_active":"2024-05-09T09:56:18.676916+0000","last_peered":"2024-05-09T09:56:18.676916+0000","last_clean":"2024-05-09T09:56:18.676916+0000","last_became_active":"2024-05-09T09:53:17.179099+0000","last_became_peered":"2024-05-09T09:53:17.179099+0000","last_unstale":"2024-05-09T09:56:18.676916+0000","last_undegraded":"2024-05-09T09:56:18.676916+0000","last_fullsized":"2024-05-09T09:56:18.676916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'4","last_scrub_stamp":"2024-05-09T09:56:18.676693+0000","last_deep_scrub":"63'4","last_deep_scrub_stamp":"2024-05-09T09:56:18.676693+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.676693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:00.667805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:41.441863+0000","last_change":"2024-05-09T09:56:41.441918+0000","last_active":"2024-05-09T09:56:41.441863+0000","last_peered":"2024-05-09T09:56:41.441863+0000","last_clean":"2024-05-09T09:56:41.441863+0000","last_became_active":"2024-05-09T09:55:10.499690+0000","last_became_peered":"2024-05-09T09:55:10.499690+0000","last_unstale":"2024-05-09T09:56:41.441863+0000","last_undegraded":"2024-05-09T09:56:41.441863+0000","last_fullsized":"2024-05-09T09:56:41.441863+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:41.441665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:41.441665+0000","last_clean_scrub_stamp":"2024-05-09T09:56:41.441665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:46.296036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'24","reported_seq":84,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.960167+0000","last_change":"2024-05-09T09:56:17.960230+0000","last_active":"2024-05-09T09:56:17.960167+0000","last_peered":"2024-05-09T09:56:17.960167+0000","last_clean":"2024-05-09T09:56:17.960167+0000","last_became_active":"2024-05-09T09:55:41.481073+0000","last_became_peered":"2024-05-09T09:55:41.481073+0000","last_unstale":"2024-05-09T09:56:17.960167+0000","last_undegraded":"2024-05-09T09:56:17.960167+0000","last_fullsized":"2024-05-09T09:56:17.960167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:17.959941+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:17.959941+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.959941+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:38:40.455966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":45062,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.028207+0000","last_change":"2024-05-09T09:56:21.028267+0000","last_active":"2024-05-09T09:56:21.028207+0000","last_peered":"2024-05-09T09:56:21.028207+0000","last_clean":"2024-05-09T09:56:21.028207+0000","last_became_active":"2024-05-09T09:55:41.512431+0000","last_became_peered":"2024-05-09T09:55:41.512431+0000","last_unstale":"2024-05-09T09:56:21.028207+0000","last_undegraded":"2024-05-09T09:56:21.028207+0000","last_fullsized":"2024-05-09T09:56:21.028207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.027981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.027981+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.027981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:12.385334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'28","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.313376+0000","last_change":"2024-05-09T09:56:13.313416+0000","last_active":"2024-05-09T09:56:13.313376+0000","last_peered":"2024-05-09T09:56:13.313376+0000","last_clean":"2024-05-09T09:56:13.313376+0000","last_became_active":"2024-05-09T09:55:10.517760+0000","last_became_peered":"2024-05-09T09:55:10.517760+0000","last_unstale":"2024-05-09T09:56:13.313376+0000","last_undegraded":"2024-05-09T09:56:13.313376+0000","last_fullsized":"2024-05-09T09:56:13.313376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-05-09T09:56:13.313267+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-05-09T09:56:13.313267+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.313267+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:54.339833+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":63,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":8048,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:32.579148+0000","last_change":"2024-05-09T09:56:32.579201+0000","last_active":"2024-05-09T09:56:32.579148+0000","last_peered":"2024-05-09T09:56:32.579148+0000","last_clean":"2024-05-09T09:56:32.579148+0000","last_became_active":"2024-05-09T09:55:10.485167+0000","last_became_peered":"2024-05-09T09:55:10.485167+0000","last_unstale":"2024-05-09T09:56:32.579148+0000","last_undegraded":"2024-05-09T09:56:32.579148+0000","last_fullsized":"2024-05-09T09:56:32.579148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:32.578947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:32.578947+0000","last_clean_scrub_stamp":"2024-05-09T09:56:32.578947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:28:35.747386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.965414+0000","last_change":"2024-05-09T09:56:29.965469+0000","last_active":"2024-05-09T09:56:29.965414+0000","last_peered":"2024-05-09T09:56:29.965414+0000","last_clean":"2024-05-09T09:56:29.965414+0000","last_became_active":"2024-05-09T09:53:17.193169+0000","last_became_peered":"2024-05-09T09:53:17.193169+0000","last_unstale":"2024-05-09T09:56:29.965414+0000","last_undegraded":"2024-05-09T09:56:29.965414+0000","last_fullsized":"2024-05-09T09:56:29.965414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:29.965226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:29.965226+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.965226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:40:04.924751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.653218+0000","last_change":"2024-05-09T09:56:17.653274+0000","last_active":"2024-05-09T09:56:17.653218+0000","last_peered":"2024-05-09T09:56:17.653218+0000","last_clean":"2024-05-09T09:56:17.653218+0000","last_became_active":"2024-05-09T09:53:09.102236+0000","last_became_peered":"2024-05-09T09:53:09.102236+0000","last_unstale":"2024-05-09T09:56:17.653218+0000","last_undegraded":"2024-05-09T09:56:17.653218+0000","last_fullsized":"2024-05-09T09:56:17.653218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:17.652977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:17.652977+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.652977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:11.016259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'16","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:48.858022+0000","last_change":"2024-05-09T09:56:48.858089+0000","last_active":"2024-05-09T09:56:48.858022+0000","last_peered":"2024-05-09T09:56:48.858022+0000","last_clean":"2024-05-09T09:56:48.858022+0000","last_became_active":"2024-05-09T09:55:41.470350+0000","last_became_peered":"2024-05-09T09:55:41.470350+0000","last_unstale":"2024-05-09T09:56:48.858022+0000","last_undegraded":"2024-05-09T09:56:48.858022+0000","last_fullsized":"2024-05-09T09:56:48.858022+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:48.857816+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:48.857816+0000","last_clean_scrub_stamp":"2024-05-09T09:56:48.857816+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:22:21.973150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":26636,"num_write":36,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":18874368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:37.504686+0000","last_change":"2024-05-09T09:56:37.504797+0000","last_active":"2024-05-09T09:56:37.504686+0000","last_peered":"2024-05-09T09:56:37.504686+0000","last_clean":"2024-05-09T09:56:37.504686+0000","last_became_active":"2024-05-09T09:55:41.504290+0000","last_became_peered":"2024-05-09T09:55:41.504290+0000","last_unstale":"2024-05-09T09:56:37.504686+0000","last_undegraded":"2024-05-09T09:56:37.504686+0000","last_fullsized":"2024-05-09T09:56:37.504686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:37.504461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:37.504461+0000","last_clean_scrub_stamp":"2024-05-09T09:56:37.504461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:27.790297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"95'15","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:49.155345+0000","last_change":"2024-05-09T09:56:49.155428+0000","last_active":"2024-05-09T09:56:49.155345+0000","last_peered":"2024-05-09T09:56:49.155345+0000","last_clean":"2024-05-09T09:56:49.155345+0000","last_became_active":"2024-05-09T09:55:41.517072+0000","last_became_peered":"2024-05-09T09:55:41.517072+0000","last_unstale":"2024-05-09T09:56:49.155345+0000","last_undegraded":"2024-05-09T09:56:49.155345+0000","last_fullsized":"2024-05-09T09:56:49.155345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-05-09T09:56:49.155123+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-05-09T09:56:49.155123+0000","last_clean_scrub_stamp":"2024-05-09T09:56:49.155123+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:34.392184+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'24","reported_seq":256,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:39.825861+0000","last_change":"2024-05-09T09:56:39.825928+0000","last_active":"2024-05-09T09:56:39.825861+0000","last_peered":"2024-05-09T09:56:39.825861+0000","last_clean":"2024-05-09T09:56:39.825861+0000","last_became_active":"2024-05-09T09:55:41.514399+0000","last_became_peered":"2024-05-09T09:55:41.514399+0000","last_unstale":"2024-05-09T09:56:39.825861+0000","last_undegraded":"2024-05-09T09:56:39.825861+0000","last_fullsized":"2024-05-09T09:56:39.825861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:39.825667+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:39.825667+0000","last_clean_scrub_stamp":"2024-05-09T09:56:39.825667+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:42.766346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"63'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:41.949406+0000","last_change":"2024-05-09T09:56:41.949464+0000","last_active":"2024-05-09T09:56:41.949406+0000","last_peered":"2024-05-09T09:56:41.949406+0000","last_clean":"2024-05-09T09:56:41.949406+0000","last_became_active":"2024-05-09T09:53:17.188390+0000","last_became_peered":"2024-05-09T09:53:17.188390+0000","last_unstale":"2024-05-09T09:56:41.949406+0000","last_undegraded":"2024-05-09T09:56:41.949406+0000","last_fullsized":"2024-05-09T09:56:41.949406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-05-09T09:56:41.949201+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-05-09T09:56:41.949201+0000","last_clean_scrub_stamp":"2024-05-09T09:56:41.949201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:36.528836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.027033+0000","last_change":"2024-05-09T09:56:25.027160+0000","last_active":"2024-05-09T09:56:25.027033+0000","last_peered":"2024-05-09T09:56:25.027033+0000","last_clean":"2024-05-09T09:56:25.027033+0000","last_became_active":"2024-05-09T09:55:41.513724+0000","last_became_peered":"2024-05-09T09:55:41.513724+0000","last_unstale":"2024-05-09T09:56:25.027033+0000","last_undegraded":"2024-05-09T09:56:25.027033+0000","last_fullsized":"2024-05-09T09:56:25.027033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:25.026789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:25.026789+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.026789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:42:19.167725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'14","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.476507+0000","last_change":"2024-05-09T09:56:29.476647+0000","last_active":"2024-05-09T09:56:29.476507+0000","last_peered":"2024-05-09T09:56:29.476507+0000","last_clean":"2024-05-09T09:56:29.476507+0000","last_became_active":"2024-05-09T09:55:41.495012+0000","last_became_peered":"2024-05-09T09:55:41.495012+0000","last_unstale":"2024-05-09T09:56:29.476507+0000","last_undegraded":"2024-05-09T09:56:29.476507+0000","last_fullsized":"2024-05-09T09:56:29.476507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:29.476184+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:29.476184+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.476184+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:01:53.247487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:42.941621+0000","last_change":"2024-05-09T09:56:42.941682+0000","last_active":"2024-05-09T09:56:42.941621+0000","last_peered":"2024-05-09T09:56:42.941621+0000","last_clean":"2024-05-09T09:56:42.941621+0000","last_became_active":"2024-05-09T09:55:41.506905+0000","last_became_peered":"2024-05-09T09:55:41.506905+0000","last_unstale":"2024-05-09T09:56:42.941621+0000","last_undegraded":"2024-05-09T09:56:42.941621+0000","last_fullsized":"2024-05-09T09:56:42.941621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:42.941413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:42.941413+0000","last_clean_scrub_stamp":"2024-05-09T09:56:42.941413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:15.103902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'34","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.874977+0000","last_change":"2024-05-09T09:56:20.875159+0000","last_active":"2024-05-09T09:56:20.874977+0000","last_peered":"2024-05-09T09:56:20.874977+0000","last_clean":"2024-05-09T09:56:20.874977+0000","last_became_active":"2024-05-09T09:53:13.135627+0000","last_became_peered":"2024-05-09T09:53:13.135627+0000","last_unstale":"2024-05-09T09:56:20.874977+0000","last_undegraded":"2024-05-09T09:56:20.874977+0000","last_fullsized":"2024-05-09T09:56:20.874977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-05-09T09:56:20.874733+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-05-09T09:56:20.874733+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.874733+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:55.350949+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":68,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.770707+0000","last_change":"2024-05-09T09:56:26.770773+0000","last_active":"2024-05-09T09:56:26.770707+0000","last_peered":"2024-05-09T09:56:26.770707+0000","last_clean":"2024-05-09T09:56:26.770707+0000","last_became_active":"2024-05-09T09:53:15.174076+0000","last_became_peered":"2024-05-09T09:53:15.174076+0000","last_unstale":"2024-05-09T09:56:26.770707+0000","last_undegraded":"2024-05-09T09:56:26.770707+0000","last_fullsized":"2024-05-09T09:56:26.770707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.770508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.770508+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.770508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:02.797264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:31.982073+0000","last_change":"2024-05-09T09:56:31.982186+0000","last_active":"2024-05-09T09:56:31.982073+0000","last_peered":"2024-05-09T09:56:31.982073+0000","last_clean":"2024-05-09T09:56:31.982073+0000","last_became_active":"2024-05-09T09:53:17.186783+0000","last_became_peered":"2024-05-09T09:53:17.186783+0000","last_unstale":"2024-05-09T09:56:31.982073+0000","last_undegraded":"2024-05-09T09:56:31.982073+0000","last_fullsized":"2024-05-09T09:56:31.982073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:31.981848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:31.981848+0000","last_clean_scrub_stamp":"2024-05-09T09:56:31.981848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:17.787963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.000319+0000","last_change":"2024-05-09T09:56:23.000372+0000","last_active":"2024-05-09T09:56:23.000319+0000","last_peered":"2024-05-09T09:56:23.000319+0000","last_clean":"2024-05-09T09:56:23.000319+0000","last_became_active":"2024-05-09T09:55:41.512176+0000","last_became_peered":"2024-05-09T09:55:41.512176+0000","last_unstale":"2024-05-09T09:56:23.000319+0000","last_undegraded":"2024-05-09T09:56:23.000319+0000","last_fullsized":"2024-05-09T09:56:23.000319+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.000115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.000115+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.000115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:23.309671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'16","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:50.989240+0000","last_change":"2024-05-09T09:56:50.989402+0000","last_active":"2024-05-09T09:56:50.989240+0000","last_peered":"2024-05-09T09:56:50.989240+0000","last_clean":"2024-05-09T09:56:50.989240+0000","last_became_active":"2024-05-09T09:55:41.495260+0000","last_became_peered":"2024-05-09T09:55:41.495260+0000","last_unstale":"2024-05-09T09:56:50.989240+0000","last_undegraded":"2024-05-09T09:56:50.989240+0000","last_fullsized":"2024-05-09T09:56:50.989240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:50.988981+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:50.988981+0000","last_clean_scrub_stamp":"2024-05-09T09:56:50.988981+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:48.626148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.868424+0000","last_change":"2024-05-09T09:56:22.868479+0000","last_active":"2024-05-09T09:56:22.868424+0000","last_peered":"2024-05-09T09:56:22.868424+0000","last_clean":"2024-05-09T09:56:22.868424+0000","last_became_active":"2024-05-09T09:53:11.125894+0000","last_became_peered":"2024-05-09T09:53:11.125894+0000","last_unstale":"2024-05-09T09:56:22.868424+0000","last_undegraded":"2024-05-09T09:56:22.868424+0000","last_fullsized":"2024-05-09T09:56:22.868424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:22.868234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:22.868234+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.868234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:16:40.546112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'19","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.807504+0000","last_change":"2024-05-09T09:56:19.807595+0000","last_active":"2024-05-09T09:56:19.807504+0000","last_peered":"2024-05-09T09:56:19.807504+0000","last_clean":"2024-05-09T09:56:19.807504+0000","last_became_active":"2024-05-09T09:53:13.126831+0000","last_became_peered":"2024-05-09T09:53:13.126831+0000","last_unstale":"2024-05-09T09:56:19.807504+0000","last_undegraded":"2024-05-09T09:56:19.807504+0000","last_fullsized":"2024-05-09T09:56:19.807504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-05-09T09:56:19.807281+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-05-09T09:56:19.807281+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.807281+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:42:13.948216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.714465+0000","last_change":"2024-05-09T09:56:17.714517+0000","last_active":"2024-05-09T09:56:17.714465+0000","last_peered":"2024-05-09T09:56:17.714465+0000","last_clean":"2024-05-09T09:56:17.714465+0000","last_became_active":"2024-05-09T09:53:15.171586+0000","last_became_peered":"2024-05-09T09:53:15.171586+0000","last_unstale":"2024-05-09T09:56:17.714465+0000","last_undegraded":"2024-05-09T09:56:17.714465+0000","last_fullsized":"2024-05-09T09:56:17.714465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:17.714266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:17.714266+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.714266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:52:08.705649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:42.412327+0000","last_change":"2024-05-09T09:56:42.412387+0000","last_active":"2024-05-09T09:56:42.412327+0000","last_peered":"2024-05-09T09:56:42.412327+0000","last_clean":"2024-05-09T09:56:42.412327+0000","last_became_active":"2024-05-09T09:55:10.502015+0000","last_became_peered":"2024-05-09T09:55:10.502015+0000","last_unstale":"2024-05-09T09:56:42.412327+0000","last_undegraded":"2024-05-09T09:56:42.412327+0000","last_fullsized":"2024-05-09T09:56:42.412327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:42.412122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:42.412122+0000","last_clean_scrub_stamp":"2024-05-09T09:56:42.412122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:57.809063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"75'46","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.383656+0000","last_change":"2024-05-09T09:56:29.383721+0000","last_active":"2024-05-09T09:56:29.383656+0000","last_peered":"2024-05-09T09:56:29.383656+0000","last_clean":"2024-05-09T09:56:29.383656+0000","last_became_active":"2024-05-09T09:55:10.503704+0000","last_became_peered":"2024-05-09T09:55:10.503704+0000","last_unstale":"2024-05-09T09:56:29.383656+0000","last_undegraded":"2024-05-09T09:56:29.383656+0000","last_fullsized":"2024-05-09T09:56:29.383656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-05-09T09:56:29.383421+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-05-09T09:56:29.383421+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.383421+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:14.620481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'6","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:22.349548+0000","last_change":"2024-05-09T09:56:22.349609+0000","last_active":"2024-05-09T09:56:22.349548+0000","last_peered":"2024-05-09T09:56:22.349548+0000","last_clean":"2024-05-09T09:56:22.349548+0000","last_became_active":"2024-05-09T09:55:10.511777+0000","last_became_peered":"2024-05-09T09:55:10.511777+0000","last_unstale":"2024-05-09T09:56:22.349548+0000","last_undegraded":"2024-05-09T09:56:22.349548+0000","last_fullsized":"2024-05-09T09:56:22.349548+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'6","last_scrub_stamp":"2024-05-09T09:56:22.349349+0000","last_deep_scrub":"95'6","last_deep_scrub_stamp":"2024-05-09T09:56:22.349349+0000","last_clean_scrub_stamp":"2024-05-09T09:56:22.349349+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:24.459805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8196,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.002951+0000","last_change":"2024-05-09T09:56:19.003007+0000","last_active":"2024-05-09T09:56:19.002951+0000","last_peered":"2024-05-09T09:56:19.002951+0000","last_clean":"2024-05-09T09:56:19.002951+0000","last_became_active":"2024-05-09T09:55:41.503996+0000","last_became_peered":"2024-05-09T09:55:41.503996+0000","last_unstale":"2024-05-09T09:56:19.002951+0000","last_undegraded":"2024-05-09T09:56:19.002951+0000","last_fullsized":"2024-05-09T09:56:19.002951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:19.002759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:19.002759+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.002759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:30.994350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'18","reported_seq":72,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:49.398349+0000","last_change":"2024-05-09T09:56:49.398417+0000","last_active":"2024-05-09T09:56:49.398349+0000","last_peered":"2024-05-09T09:56:49.398349+0000","last_clean":"2024-05-09T09:56:49.398349+0000","last_became_active":"2024-05-09T09:55:10.525384+0000","last_became_peered":"2024-05-09T09:55:10.525384+0000","last_unstale":"2024-05-09T09:56:49.398349+0000","last_undegraded":"2024-05-09T09:56:49.398349+0000","last_fullsized":"2024-05-09T09:56:49.398349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:49.398125+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:49.398125+0000","last_clean_scrub_stamp":"2024-05-09T09:56:49.398125+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:18:06.996853+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":35,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.987270+0000","last_change":"2024-05-09T09:56:21.987325+0000","last_active":"2024-05-09T09:56:21.987270+0000","last_peered":"2024-05-09T09:56:21.987270+0000","last_clean":"2024-05-09T09:56:21.987270+0000","last_became_active":"2024-05-09T09:55:41.502389+0000","last_became_peered":"2024-05-09T09:55:41.502389+0000","last_unstale":"2024-05-09T09:56:21.987270+0000","last_undegraded":"2024-05-09T09:56:21.987270+0000","last_fullsized":"2024-05-09T09:56:21.987270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.987073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.987073+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.987073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:48.751581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.910200+0000","last_change":"2024-05-09T09:56:29.910252+0000","last_active":"2024-05-09T09:56:29.910200+0000","last_peered":"2024-05-09T09:56:29.910200+0000","last_clean":"2024-05-09T09:56:29.910200+0000","last_became_active":"2024-05-09T09:53:17.183518+0000","last_became_peered":"2024-05-09T09:53:17.183518+0000","last_unstale":"2024-05-09T09:56:29.910200+0000","last_undegraded":"2024-05-09T09:56:29.910200+0000","last_fullsized":"2024-05-09T09:56:29.910200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:29.910005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:29.910005+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.910005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:56.658065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:20.017310+0000","last_change":"2024-05-09T09:56:20.017364+0000","last_active":"2024-05-09T09:56:20.017310+0000","last_peered":"2024-05-09T09:56:20.017310+0000","last_clean":"2024-05-09T09:56:20.017310+0000","last_became_active":"2024-05-09T09:55:41.503132+0000","last_became_peered":"2024-05-09T09:55:41.503132+0000","last_unstale":"2024-05-09T09:56:20.017310+0000","last_undegraded":"2024-05-09T09:56:20.017310+0000","last_fullsized":"2024-05-09T09:56:20.017310+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:20.017113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:20.017113+0000","last_clean_scrub_stamp":"2024-05-09T09:56:20.017113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:22.372653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'18","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:38.854500+0000","last_change":"2024-05-09T09:56:38.854645+0000","last_active":"2024-05-09T09:56:38.854500+0000","last_peered":"2024-05-09T09:56:38.854500+0000","last_clean":"2024-05-09T09:56:38.854500+0000","last_became_active":"2024-05-09T09:53:07.117433+0000","last_became_peered":"2024-05-09T09:53:07.117433+0000","last_unstale":"2024-05-09T09:56:38.854500+0000","last_undegraded":"2024-05-09T09:56:38.854500+0000","last_fullsized":"2024-05-09T09:56:38.854500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:38.854257+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:38.854257+0000","last_clean_scrub_stamp":"2024-05-09T09:56:38.854257+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:46.953358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":36882,"num_write":48,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"95'2","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:19.426680+0000","last_change":"2024-05-09T09:56:19.426757+0000","last_active":"2024-05-09T09:56:19.426680+0000","last_peered":"2024-05-09T09:56:19.426680+0000","last_clean":"2024-05-09T09:56:19.426680+0000","last_became_active":"2024-05-09T09:53:11.127444+0000","last_became_peered":"2024-05-09T09:53:11.127444+0000","last_unstale":"2024-05-09T09:56:19.426680+0000","last_undegraded":"2024-05-09T09:56:19.426680+0000","last_fullsized":"2024-05-09T09:56:19.426680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-05-09T09:56:19.426485+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-05-09T09:56:19.426485+0000","last_clean_scrub_stamp":"2024-05-09T09:56:19.426485+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:52.257376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'22","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:27.108468+0000","last_change":"2024-05-09T09:56:27.108623+0000","last_active":"2024-05-09T09:56:27.108468+0000","last_peered":"2024-05-09T09:56:27.108468+0000","last_clean":"2024-05-09T09:56:27.108468+0000","last_became_active":"2024-05-09T09:55:41.453982+0000","last_became_peered":"2024-05-09T09:55:41.453982+0000","last_unstale":"2024-05-09T09:56:27.108468+0000","last_undegraded":"2024-05-09T09:56:27.108468+0000","last_fullsized":"2024-05-09T09:56:27.108468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-05-09T09:56:27.108233+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-05-09T09:56:27.108233+0000","last_clean_scrub_stamp":"2024-05-09T09:56:27.108233+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:26:49.143045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":34,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1334,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.799352+0000","last_change":"2024-05-09T09:56:28.799408+0000","last_active":"2024-05-09T09:56:28.799352+0000","last_peered":"2024-05-09T09:56:28.799352+0000","last_clean":"2024-05-09T09:56:28.799352+0000","last_became_active":"2024-05-09T09:53:15.178640+0000","last_became_peered":"2024-05-09T09:53:15.178640+0000","last_unstale":"2024-05-09T09:56:28.799352+0000","last_undegraded":"2024-05-09T09:56:28.799352+0000","last_fullsized":"2024-05-09T09:56:28.799352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.799143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.799143+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.799143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:27:19.084979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:42.061320+0000","last_change":"2024-05-09T09:56:42.061377+0000","last_active":"2024-05-09T09:56:42.061320+0000","last_peered":"2024-05-09T09:56:42.061320+0000","last_clean":"2024-05-09T09:56:42.061320+0000","last_became_active":"2024-05-09T09:55:41.478429+0000","last_became_peered":"2024-05-09T09:55:41.478429+0000","last_unstale":"2024-05-09T09:56:42.061320+0000","last_undegraded":"2024-05-09T09:56:42.061320+0000","last_fullsized":"2024-05-09T09:56:42.061320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:42.061083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:42.061083+0000","last_clean_scrub_stamp":"2024-05-09T09:56:42.061083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:09:44.171539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"75'30","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.435770+0000","last_change":"2024-05-09T09:56:23.435942+0000","last_active":"2024-05-09T09:56:23.435770+0000","last_peered":"2024-05-09T09:56:23.435770+0000","last_clean":"2024-05-09T09:56:23.435770+0000","last_became_active":"2024-05-09T09:53:09.115441+0000","last_became_peered":"2024-05-09T09:53:09.115441+0000","last_unstale":"2024-05-09T09:56:23.435770+0000","last_undegraded":"2024-05-09T09:56:23.435770+0000","last_fullsized":"2024-05-09T09:56:23.435770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'30","last_scrub_stamp":"2024-05-09T09:56:23.435533+0000","last_deep_scrub":"75'30","last_deep_scrub_stamp":"2024-05-09T09:56:23.435533+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.435533+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:25.791073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":76,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'14","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.924596+0000","last_change":"2024-05-09T09:56:29.924740+0000","last_active":"2024-05-09T09:56:29.924596+0000","last_peered":"2024-05-09T09:56:29.924596+0000","last_clean":"2024-05-09T09:56:29.924596+0000","last_became_active":"2024-05-09T09:53:07.113693+0000","last_became_peered":"2024-05-09T09:53:07.113693+0000","last_unstale":"2024-05-09T09:56:29.924596+0000","last_undegraded":"2024-05-09T09:56:29.924596+0000","last_fullsized":"2024-05-09T09:56:29.924596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:29.924340+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:29.924340+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.924340+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:49:41.288497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:29.564814+0000","last_change":"2024-05-09T09:56:29.564866+0000","last_active":"2024-05-09T09:56:29.564814+0000","last_peered":"2024-05-09T09:56:29.564814+0000","last_clean":"2024-05-09T09:56:29.564814+0000","last_became_active":"2024-05-09T09:53:09.105780+0000","last_became_peered":"2024-05-09T09:53:09.105780+0000","last_unstale":"2024-05-09T09:56:29.564814+0000","last_undegraded":"2024-05-09T09:56:29.564814+0000","last_fullsized":"2024-05-09T09:56:29.564814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:29.564622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:29.564622+0000","last_clean_scrub_stamp":"2024-05-09T09:56:29.564622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:56.312682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'24","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.590344+0000","last_change":"2024-05-09T09:56:13.590403+0000","last_active":"2024-05-09T09:56:13.590344+0000","last_peered":"2024-05-09T09:56:13.590344+0000","last_clean":"2024-05-09T09:56:13.590344+0000","last_became_active":"2024-05-09T09:53:54.474288+0000","last_became_peered":"2024-05-09T09:53:54.474288+0000","last_unstale":"2024-05-09T09:56:13.590344+0000","last_undegraded":"2024-05-09T09:56:13.590344+0000","last_fullsized":"2024-05-09T09:56:13.590344+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:13.590153+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:13.590153+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.590153+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:57.949511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":38936,"num_write":64,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:30.925563+0000","last_change":"2024-05-09T09:56:30.925664+0000","last_active":"2024-05-09T09:56:30.925563+0000","last_peered":"2024-05-09T09:56:30.925563+0000","last_clean":"2024-05-09T09:56:30.925563+0000","last_became_active":"2024-05-09T09:53:09.126783+0000","last_became_peered":"2024-05-09T09:53:09.126783+0000","last_unstale":"2024-05-09T09:56:30.925563+0000","last_undegraded":"2024-05-09T09:56:30.925563+0000","last_fullsized":"2024-05-09T09:56:30.925563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:30.925257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:30.925257+0000","last_clean_scrub_stamp":"2024-05-09T09:56:30.925257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:18:23.654513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'18","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:17.922747+0000","last_change":"2024-05-09T09:56:17.922808+0000","last_active":"2024-05-09T09:56:17.922747+0000","last_peered":"2024-05-09T09:56:17.922747+0000","last_clean":"2024-05-09T09:56:17.922747+0000","last_became_active":"2024-05-09T09:55:10.518812+0000","last_became_peered":"2024-05-09T09:55:10.518812+0000","last_unstale":"2024-05-09T09:56:17.922747+0000","last_undegraded":"2024-05-09T09:56:17.922747+0000","last_fullsized":"2024-05-09T09:56:17.922747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-05-09T09:56:17.922556+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-05-09T09:56:17.922556+0000","last_clean_scrub_stamp":"2024-05-09T09:56:17.922556+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:56.203186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":30726,"num_write":28,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:21.370386+0000","last_change":"2024-05-09T09:56:21.370437+0000","last_active":"2024-05-09T09:56:21.370386+0000","last_peered":"2024-05-09T09:56:21.370386+0000","last_clean":"2024-05-09T09:56:21.370386+0000","last_became_active":"2024-05-09T09:53:09.125328+0000","last_became_peered":"2024-05-09T09:53:09.125328+0000","last_unstale":"2024-05-09T09:56:21.370386+0000","last_undegraded":"2024-05-09T09:56:21.370386+0000","last_fullsized":"2024-05-09T09:56:21.370386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:21.370199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:21.370199+0000","last_clean_scrub_stamp":"2024-05-09T09:56:21.370199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:43:13.563744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'14","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:45.881577+0000","last_change":"2024-05-09T09:56:45.881743+0000","last_active":"2024-05-09T09:56:45.881577+0000","last_peered":"2024-05-09T09:56:45.881577+0000","last_clean":"2024-05-09T09:56:45.881577+0000","last_became_active":"2024-05-09T09:55:10.507500+0000","last_became_peered":"2024-05-09T09:55:10.507500+0000","last_unstale":"2024-05-09T09:56:45.881577+0000","last_undegraded":"2024-05-09T09:56:45.881577+0000","last_fullsized":"2024-05-09T09:56:45.881577+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:45.881338+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:45.881338+0000","last_clean_scrub_stamp":"2024-05-09T09:56:45.881338+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:54:13.669886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24594,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.373545+0000","last_change":"2024-05-09T09:56:23.373608+0000","last_active":"2024-05-09T09:56:23.373545+0000","last_peered":"2024-05-09T09:56:23.373545+0000","last_clean":"2024-05-09T09:56:23.373545+0000","last_became_active":"2024-05-09T09:55:10.523552+0000","last_became_peered":"2024-05-09T09:55:10.523552+0000","last_unstale":"2024-05-09T09:56:23.373545+0000","last_undegraded":"2024-05-09T09:56:23.373545+0000","last_fullsized":"2024-05-09T09:56:23.373545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.373351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.373351+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.373351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:28.652226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'26","reported_seq":130,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:50.386107+0000","last_change":"2024-05-09T09:56:50.386167+0000","last_active":"2024-05-09T09:56:50.386107+0000","last_peered":"2024-05-09T09:56:50.386107+0000","last_clean":"2024-05-09T09:56:50.386107+0000","last_became_active":"2024-05-09T09:55:41.504165+0000","last_became_peered":"2024-05-09T09:55:41.504165+0000","last_unstale":"2024-05-09T09:56:50.386107+0000","last_undegraded":"2024-05-09T09:56:50.386107+0000","last_fullsized":"2024-05-09T09:56:50.386107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-05-09T09:56:50.385918+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-05-09T09:56:50.385918+0000","last_clean_scrub_stamp":"2024-05-09T09:56:50.385918+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:10.188271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12298,"num_write":46,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":113246208,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.074933+0000","last_change":"2024-05-09T09:56:26.074993+0000","last_active":"2024-05-09T09:56:26.074933+0000","last_peered":"2024-05-09T09:56:26.074933+0000","last_clean":"2024-05-09T09:56:26.074933+0000","last_became_active":"2024-05-09T09:55:41.500371+0000","last_became_peered":"2024-05-09T09:55:41.500371+0000","last_unstale":"2024-05-09T09:56:26.074933+0000","last_undegraded":"2024-05-09T09:56:26.074933+0000","last_fullsized":"2024-05-09T09:56:26.074933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:26.074736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:26.074736+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.074736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:43.094970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'30","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:35.499933+0000","last_change":"2024-05-09T09:56:35.500116+0000","last_active":"2024-05-09T09:56:35.499933+0000","last_peered":"2024-05-09T09:56:35.499933+0000","last_clean":"2024-05-09T09:56:35.499933+0000","last_became_active":"2024-05-09T09:55:10.497720+0000","last_became_peered":"2024-05-09T09:55:10.497720+0000","last_unstale":"2024-05-09T09:56:35.499933+0000","last_undegraded":"2024-05-09T09:56:35.499933+0000","last_fullsized":"2024-05-09T09:56:35.499933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-05-09T09:56:35.499707+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-05-09T09:56:35.499707+0000","last_clean_scrub_stamp":"2024-05-09T09:56:35.499707+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:11.526463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":51230,"num_write":80,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:24.412738+0000","last_change":"2024-05-09T09:56:24.412796+0000","last_active":"2024-05-09T09:56:24.412738+0000","last_peered":"2024-05-09T09:56:24.412738+0000","last_clean":"2024-05-09T09:56:24.412738+0000","last_became_active":"2024-05-09T09:55:10.520654+0000","last_became_peered":"2024-05-09T09:55:10.520654+0000","last_unstale":"2024-05-09T09:56:24.412738+0000","last_undegraded":"2024-05-09T09:56:24.412738+0000","last_fullsized":"2024-05-09T09:56:24.412738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:24.412534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:24.412534+0000","last_clean_scrub_stamp":"2024-05-09T09:56:24.412534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:21:13.306716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'16","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:26.840928+0000","last_change":"2024-05-09T09:56:26.841060+0000","last_active":"2024-05-09T09:56:26.840928+0000","last_peered":"2024-05-09T09:56:26.840928+0000","last_clean":"2024-05-09T09:56:26.840928+0000","last_became_active":"2024-05-09T09:53:07.125462+0000","last_became_peered":"2024-05-09T09:53:07.125462+0000","last_unstale":"2024-05-09T09:56:26.840928+0000","last_undegraded":"2024-05-09T09:56:26.840928+0000","last_fullsized":"2024-05-09T09:56:26.840928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:26.840591+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:26.840591+0000","last_clean_scrub_stamp":"2024-05-09T09:56:26.840591+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:43.975175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:23.795585+0000","last_change":"2024-05-09T09:56:23.795643+0000","last_active":"2024-05-09T09:56:23.795585+0000","last_peered":"2024-05-09T09:56:23.795585+0000","last_clean":"2024-05-09T09:56:23.795585+0000","last_became_active":"2024-05-09T09:53:09.122214+0000","last_became_peered":"2024-05-09T09:53:09.122214+0000","last_unstale":"2024-05-09T09:56:23.795585+0000","last_undegraded":"2024-05-09T09:56:23.795585+0000","last_fullsized":"2024-05-09T09:56:23.795585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:23.795386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:23.795386+0000","last_clean_scrub_stamp":"2024-05-09T09:56:23.795386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:26:31.139396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'12","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:52.315676+0000","last_change":"2024-05-09T09:56:52.315741+0000","last_active":"2024-05-09T09:56:52.315676+0000","last_peered":"2024-05-09T09:56:52.315676+0000","last_clean":"2024-05-09T09:56:52.315676+0000","last_became_active":"2024-05-09T09:55:41.504555+0000","last_became_peered":"2024-05-09T09:55:41.504555+0000","last_unstale":"2024-05-09T09:56:52.315676+0000","last_undegraded":"2024-05-09T09:56:52.315676+0000","last_fullsized":"2024-05-09T09:56:52.315676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:52.315479+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:52.315479+0000","last_clean_scrub_stamp":"2024-05-09T09:56:52.315479+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:34.320198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6148,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"75'34","reported_seq":219,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:46.854173+0000","last_change":"2024-05-09T09:56:46.854358+0000","last_active":"2024-05-09T09:56:46.854173+0000","last_peered":"2024-05-09T09:56:46.854173+0000","last_clean":"2024-05-09T09:56:46.854173+0000","last_became_active":"2024-05-09T09:55:10.515872+0000","last_became_peered":"2024-05-09T09:55:10.515872+0000","last_unstale":"2024-05-09T09:56:46.854173+0000","last_undegraded":"2024-05-09T09:56:46.854173+0000","last_fullsized":"2024-05-09T09:56:46.854173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-05-09T09:56:46.853929+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-05-09T09:56:46.853929+0000","last_clean_scrub_stamp":"2024-05-09T09:56:46.853929+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:02:19.539812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'14","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:13.947150+0000","last_change":"2024-05-09T09:56:13.947207+0000","last_active":"2024-05-09T09:56:13.947150+0000","last_peered":"2024-05-09T09:56:13.947150+0000","last_clean":"2024-05-09T09:56:13.947150+0000","last_became_active":"2024-05-09T09:55:10.506370+0000","last_became_peered":"2024-05-09T09:55:10.506370+0000","last_unstale":"2024-05-09T09:56:13.947150+0000","last_undegraded":"2024-05-09T09:56:13.947150+0000","last_fullsized":"2024-05-09T09:56:13.947150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:13.946960+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:13.946960+0000","last_clean_scrub_stamp":"2024-05-09T09:56:13.946960+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:14:46.921583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16388,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:30.060098+0000","last_change":"2024-05-09T09:56:30.060155+0000","last_active":"2024-05-09T09:56:30.060098+0000","last_peered":"2024-05-09T09:56:30.060098+0000","last_clean":"2024-05-09T09:56:30.060098+0000","last_became_active":"2024-05-09T09:55:41.492423+0000","last_became_peered":"2024-05-09T09:55:41.492423+0000","last_unstale":"2024-05-09T09:56:30.060098+0000","last_undegraded":"2024-05-09T09:56:30.060098+0000","last_fullsized":"2024-05-09T09:56:30.060098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:30.059895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:30.059895+0000","last_clean_scrub_stamp":"2024-05-09T09:56:30.059895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:54:04.020653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'16","reported_seq":104,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:53.357133+0000","last_change":"2024-05-09T09:56:53.357217+0000","last_active":"2024-05-09T09:56:53.357133+0000","last_peered":"2024-05-09T09:56:53.357133+0000","last_clean":"2024-05-09T09:56:53.357133+0000","last_became_active":"2024-05-09T09:55:41.505078+0000","last_became_peered":"2024-05-09T09:55:41.505078+0000","last_unstale":"2024-05-09T09:56:53.357133+0000","last_undegraded":"2024-05-09T09:56:53.357133+0000","last_fullsized":"2024-05-09T09:56:53.357133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-05-09T09:56:53.356932+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-05-09T09:56:53.356932+0000","last_clean_scrub_stamp":"2024-05-09T09:56:53.356932+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:31.002961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":18438,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:18.635887+0000","last_change":"2024-05-09T09:56:18.635943+0000","last_active":"2024-05-09T09:56:18.635887+0000","last_peered":"2024-05-09T09:56:18.635887+0000","last_clean":"2024-05-09T09:56:18.635887+0000","last_became_active":"2024-05-09T09:53:09.119190+0000","last_became_peered":"2024-05-09T09:53:09.119190+0000","last_unstale":"2024-05-09T09:56:18.635887+0000","last_undegraded":"2024-05-09T09:56:18.635887+0000","last_fullsized":"2024-05-09T09:56:18.635887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:18.635674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:18.635674+0000","last_clean_scrub_stamp":"2024-05-09T09:56:18.635674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:23.223030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'34","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:40.995270+0000","last_change":"2024-05-09T09:56:40.995334+0000","last_active":"2024-05-09T09:56:40.995270+0000","last_peered":"2024-05-09T09:56:40.995270+0000","last_clean":"2024-05-09T09:56:40.995270+0000","last_became_active":"2024-05-09T09:53:07.130844+0000","last_became_peered":"2024-05-09T09:53:07.130844+0000","last_unstale":"2024-05-09T09:56:40.995270+0000","last_undegraded":"2024-05-09T09:56:40.995270+0000","last_fullsized":"2024-05-09T09:56:40.995270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-05-09T09:56:40.995088+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-05-09T09:56:40.995088+0000","last_clean_scrub_stamp":"2024-05-09T09:56:40.995088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:19:16.560665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":63494,"num_write":44,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'34","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:47.138584+0000","last_change":"2024-05-09T09:56:47.138643+0000","last_active":"2024-05-09T09:56:47.138584+0000","last_peered":"2024-05-09T09:56:47.138584+0000","last_clean":"2024-05-09T09:56:47.138584+0000","last_became_active":"2024-05-09T09:55:41.516340+0000","last_became_peered":"2024-05-09T09:55:41.516340+0000","last_unstale":"2024-05-09T09:56:47.138584+0000","last_undegraded":"2024-05-09T09:56:47.138584+0000","last_fullsized":"2024-05-09T09:56:47.138584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-05-09T09:56:47.138383+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-05-09T09:56:47.138383+0000","last_clean_scrub_stamp":"2024-05-09T09:56:47.138383+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:50.902847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'20","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:12.590155+0000","last_change":"2024-05-09T09:56:12.590224+0000","last_active":"2024-05-09T09:56:12.590155+0000","last_peered":"2024-05-09T09:56:12.590155+0000","last_clean":"2024-05-09T09:56:12.590155+0000","last_became_active":"2024-05-09T09:53:54.474812+0000","last_became_peered":"2024-05-09T09:53:54.474812+0000","last_unstale":"2024-05-09T09:56:12.590155+0000","last_undegraded":"2024-05-09T09:56:12.590155+0000","last_fullsized":"2024-05-09T09:56:12.590155+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-05-09T09:56:12.589976+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-05-09T09:56:12.589976+0000","last_clean_scrub_stamp":"2024-05-09T09:56:12.589976+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:34.083244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":40972,"num_write":40,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"63'10","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:48.957260+0000","last_change":"2024-05-09T09:56:48.957402+0000","last_active":"2024-05-09T09:56:48.957260+0000","last_peered":"2024-05-09T09:56:48.957260+0000","last_clean":"2024-05-09T09:56:48.957260+0000","last_became_active":"2024-05-09T09:55:55.721121+0000","last_became_peered":"2024-05-09T09:55:55.721121+0000","last_unstale":"2024-05-09T09:56:48.957260+0000","last_undegraded":"2024-05-09T09:56:48.957260+0000","last_fullsized":"2024-05-09T09:56:48.957260+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'10","last_scrub_stamp":"2024-05-09T09:56:48.957031+0000","last_deep_scrub":"63'10","last_deep_scrub_stamp":"2024-05-09T09:56:48.957031+0000","last_clean_scrub_stamp":"2024-05-09T09:56:48.957031+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:33.082888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'24","reported_seq":245,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:38.846980+0000","last_change":"2024-05-09T09:56:38.847098+0000","last_active":"2024-05-09T09:56:38.846980+0000","last_peered":"2024-05-09T09:56:38.846980+0000","last_clean":"2024-05-09T09:56:38.846980+0000","last_became_active":"2024-05-09T09:55:41.513564+0000","last_became_peered":"2024-05-09T09:55:41.513564+0000","last_unstale":"2024-05-09T09:56:38.846980+0000","last_undegraded":"2024-05-09T09:56:38.846980+0000","last_fullsized":"2024-05-09T09:56:38.846980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-05-09T09:56:38.846688+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-05-09T09:56:38.846688+0000","last_clean_scrub_stamp":"2024-05-09T09:56:38.846688+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:13:22.058462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45068,"num_write":44,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"63'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:41.917895+0000","last_change":"2024-05-09T09:56:41.917958+0000","last_active":"2024-05-09T09:56:41.917895+0000","last_peered":"2024-05-09T09:56:41.917895+0000","last_clean":"2024-05-09T09:56:41.917895+0000","last_became_active":"2024-05-09T09:53:09.112256+0000","last_became_peered":"2024-05-09T09:53:09.112256+0000","last_unstale":"2024-05-09T09:56:41.917895+0000","last_undegraded":"2024-05-09T09:56:41.917895+0000","last_fullsized":"2024-05-09T09:56:41.917895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'12","last_scrub_stamp":"2024-05-09T09:56:41.917683+0000","last_deep_scrub":"63'12","last_deep_scrub_stamp":"2024-05-09T09:56:41.917683+0000","last_clean_scrub_stamp":"2024-05-09T09:56:41.917683+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:28:28.324711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'14","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:37.927233+0000","last_change":"2024-05-09T09:56:37.927353+0000","last_active":"2024-05-09T09:56:37.927233+0000","last_peered":"2024-05-09T09:56:37.927233+0000","last_clean":"2024-05-09T09:56:37.927233+0000","last_became_active":"2024-05-09T09:53:07.132478+0000","last_became_peered":"2024-05-09T09:53:07.132478+0000","last_unstale":"2024-05-09T09:56:37.927233+0000","last_undegraded":"2024-05-09T09:56:37.927233+0000","last_fullsized":"2024-05-09T09:56:37.927233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:37.926935+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:37.926935+0000","last_clean_scrub_stamp":"2024-05-09T09:56:37.926935+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:31.139643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"63'6","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:25.458691+0000","last_change":"2024-05-09T09:56:25.458750+0000","last_active":"2024-05-09T09:56:25.458691+0000","last_peered":"2024-05-09T09:56:25.458691+0000","last_clean":"2024-05-09T09:56:25.458691+0000","last_became_active":"2024-05-09T09:55:10.495708+0000","last_became_peered":"2024-05-09T09:55:10.495708+0000","last_unstale":"2024-05-09T09:56:25.458691+0000","last_undegraded":"2024-05-09T09:56:25.458691+0000","last_fullsized":"2024-05-09T09:56:25.458691+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-05-09T09:56:25.458483+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-05-09T09:56:25.458483+0000","last_clean_scrub_stamp":"2024-05-09T09:56:25.458483+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:32:33.557584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'28","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.619417+0000","last_change":"2024-05-09T09:56:16.619488+0000","last_active":"2024-05-09T09:56:16.619417+0000","last_peered":"2024-05-09T09:56:16.619417+0000","last_clean":"2024-05-09T09:56:16.619417+0000","last_became_active":"2024-05-09T09:53:07.131169+0000","last_became_peered":"2024-05-09T09:53:07.131169+0000","last_unstale":"2024-05-09T09:56:16.619417+0000","last_undegraded":"2024-05-09T09:56:16.619417+0000","last_fullsized":"2024-05-09T09:56:16.619417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-05-09T09:56:16.619210+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-05-09T09:56:16.619210+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.619210+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:27.460685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":53278,"num_write":78,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'6","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:15.917448+0000","last_change":"2024-05-09T09:56:15.917511+0000","last_active":"2024-05-09T09:56:15.917448+0000","last_peered":"2024-05-09T09:56:15.917448+0000","last_clean":"2024-05-09T09:56:15.917448+0000","last_became_active":"2024-05-09T09:55:10.500255+0000","last_became_peered":"2024-05-09T09:55:10.500255+0000","last_unstale":"2024-05-09T09:56:15.917448+0000","last_undegraded":"2024-05-09T09:56:15.917448+0000","last_fullsized":"2024-05-09T09:56:15.917448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-05-09T09:56:15.917249+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-05-09T09:56:15.917249+0000","last_clean_scrub_stamp":"2024-05-09T09:56:15.917249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:16.452267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:39.974789+0000","last_change":"2024-05-09T09:56:39.974919+0000","last_active":"2024-05-09T09:56:39.974789+0000","last_peered":"2024-05-09T09:56:39.974789+0000","last_clean":"2024-05-09T09:56:39.974789+0000","last_became_active":"2024-05-09T09:53:07.130027+0000","last_became_peered":"2024-05-09T09:53:07.130027+0000","last_unstale":"2024-05-09T09:56:39.974789+0000","last_undegraded":"2024-05-09T09:56:39.974789+0000","last_fullsized":"2024-05-09T09:56:39.974789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:39.974520+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:39.974520+0000","last_clean_scrub_stamp":"2024-05-09T09:56:39.974520+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:49:02.894519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:37.900825+0000","last_change":"2024-05-09T09:56:37.900896+0000","last_active":"2024-05-09T09:56:37.900825+0000","last_peered":"2024-05-09T09:56:37.900825+0000","last_clean":"2024-05-09T09:56:37.900825+0000","last_became_active":"2024-05-09T09:53:07.117875+0000","last_became_peered":"2024-05-09T09:53:07.117875+0000","last_unstale":"2024-05-09T09:56:37.900825+0000","last_undegraded":"2024-05-09T09:56:37.900825+0000","last_fullsized":"2024-05-09T09:56:37.900825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-05-09T09:56:37.900577+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-05-09T09:56:37.900577+0000","last_clean_scrub_stamp":"2024-05-09T09:56:37.900577+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:12.074787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":16384,"num_write":12,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:16.813392+0000","last_change":"2024-05-09T09:56:16.813446+0000","last_active":"2024-05-09T09:56:16.813392+0000","last_peered":"2024-05-09T09:56:16.813392+0000","last_clean":"2024-05-09T09:56:16.813392+0000","last_became_active":"2024-05-09T09:55:10.506690+0000","last_became_peered":"2024-05-09T09:55:10.506690+0000","last_unstale":"2024-05-09T09:56:16.813392+0000","last_undegraded":"2024-05-09T09:56:16.813392+0000","last_fullsized":"2024-05-09T09:56:16.813392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:16.813202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:16.813202+0000","last_clean_scrub_stamp":"2024-05-09T09:56:16.813202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:43.577711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'14","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:39.488965+0000","last_change":"2024-05-09T09:56:39.489031+0000","last_active":"2024-05-09T09:56:39.488965+0000","last_peered":"2024-05-09T09:56:39.488965+0000","last_clean":"2024-05-09T09:56:39.488965+0000","last_became_active":"2024-05-09T09:55:41.504558+0000","last_became_peered":"2024-05-09T09:55:41.504558+0000","last_unstale":"2024-05-09T09:56:39.488965+0000","last_undegraded":"2024-05-09T09:56:39.488965+0000","last_fullsized":"2024-05-09T09:56:39.488965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-05-09T09:56:39.488770+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-05-09T09:56:39.488770+0000","last_clean_scrub_stamp":"2024-05-09T09:56:39.488770+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:25:34.173672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26642,"num_write":44,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-05-09T09:56:28.929170+0000","last_change":"2024-05-09T09:56:28.929302+0000","last_active":"2024-05-09T09:56:28.929170+0000","last_peered":"2024-05-09T09:56:28.929170+0000","last_clean":"2024-05-09T09:56:28.929170+0000","last_became_active":"2024-05-09T09:53:09.128303+0000","last_became_peered":"2024-05-09T09:53:09.128303+0000","last_unstale":"2024-05-09T09:56:28.929170+0000","last_undegraded":"2024-05-09T09:56:28.929170+0000","last_fullsized":"2024-05-09T09:56:28.929170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:56:28.928902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:56:28.928902+0000","last_clean_scrub_stamp":"2024-05-09T09:56:28.928902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:54:23.887947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":634,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":123282,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1201,"num_read_kb":1574,"num_write":775,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":46305,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2002,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":924,"ondisk_log_size":924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1642,"num_read_kb":1223,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1462,"num_read_kb":1804930,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":1302331392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1773568,"data_stored":1259473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1150976,"data_stored":667452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1200128,"data_stored":668716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1146880,"data_stored":668379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40636,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331204,"statfs":{"total":96636764160,"available":96595152896,"internally_reserved":0,"allocated":1167360,"data_stored":667848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335392,"statfs":{"total":96636764160,"available":96599441408,"internally_reserved":0,"allocated":1138688,"data_stored":667014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36476,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335364,"statfs":{"total":96636764160,"available":96599412736,"internally_reserved":0,"allocated":1167360,"data_stored":667702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1748992,"data_stored":1257886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:56:55.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T09:56:56.197 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T09:56:56.197 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T09:56:56.197 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T09:56:56.197 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:56:56.287 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T09:56:56.287 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T09:56:56.287 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:56:56.361 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T09:56:56.362 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T09:56:56.362 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:56:56.451 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T09:56:56.451 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T09:56:56.451 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:56:56.549 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T09:56:56.550 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-09T09:56:56.550 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:56:56.632 INFO:tasks.ceph.osd.4:Stopped 2024-05-09T09:56:56.632 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-09T09:56:56.632 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:56:56.719 INFO:tasks.ceph.osd.5:Stopped 2024-05-09T09:56:56.720 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-09T09:56:56.720 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:56:59.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-09T09:57:02.822 INFO:tasks.ceph.osd.6:Stopped 2024-05-09T09:57:02.822 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-09T09:57:02.822 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:57:02.876 INFO:tasks.ceph.osd.7:Stopped 2024-05-09T09:57:02.876 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T09:57:02.876 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-09T09:57:02.877 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:57:02.907 INFO:tasks.ceph.mgr.y:Stopped 2024-05-09T09:57:02.907 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T09:57:02.907 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:57:02.936 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T09:57:02.936 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T09:57:02.936 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T09:57:02.936 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:57:02.961 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T09:57:02.961 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-09T09:57:02.962 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:57:03.028 INFO:tasks.ceph.mon.c:Stopped 2024-05-09T09:57:03.029 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-09T09:57:03.029 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:57:03.053 INFO:tasks.ceph.mon.b:Stopped 2024-05-09T09:57:03.053 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T09:57:03.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-09T09:57:03.090 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:57:03.090 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T09:57:03.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:57:03.347 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T09:57:03.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:57:03.549 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T09:57:03.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:57:03.716 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T09:57:03.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:57:03.858 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-09T09:57:04.185 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:57:04.185 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-09T09:57:04.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-09T09:57:04.390 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:57:04.390 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-09T09:57:04.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:57:04.573 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-09T09:57:04.749 INFO:tasks.ceph:Archiving mon data... 2024-05-09T09:57:04.751 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/data/mon.a.tgz 2024-05-09T09:57:04.751 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-05-09T09:57:04.757 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.Q4tpEvrdjb 2024-05-09T09:57:04.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Q4tpEvrdjb 2024-05-09T09:57:04.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.Q4tpEvrdjb 2024-05-09T09:57:04.989 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.Q4tpEvrdjb is 504KB 2024-05-09T09:57:05.051 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.Q4tpEvrdjb 2024-05-09T09:57:05.056 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/data/mon.c.tgz 2024-05-09T09:57:05.057 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-05-09T09:57:05.106 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.iTzS525jYT 2024-05-09T09:57:05.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iTzS525jYT 2024-05-09T09:57:05.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.iTzS525jYT 2024-05-09T09:57:05.373 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.iTzS525jYT is 652KB 2024-05-09T09:57:05.435 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.iTzS525jYT 2024-05-09T09:57:05.441 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/data/mon.b.tgz 2024-05-09T09:57:05.441 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-09T09:57:05.447 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.nFJS8rK8ee 2024-05-09T09:57:05.448 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nFJS8rK8ee 2024-05-09T09:57:05.637 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.nFJS8rK8ee 2024-05-09T09:57:05.702 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.nFJS8rK8ee is 651KB 2024-05-09T09:57:05.764 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.nFJS8rK8ee 2024-05-09T09:57:05.769 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T09:57:05.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T09:57:05.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T09:57:05.833 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T09:57:05.874 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T09:57:05.874 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T09:57:05.876 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/remote/smithi032/crash 2024-05-09T09:57:05.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T09:57:05.891 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/remote/smithi080/crash 2024-05-09T09:57:05.891 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T09:57:05.929 INFO:tasks.ceph:Compressing logs... 2024-05-09T09:57:05.929 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T09:57:05.938 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T09:57:05.954 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33304.log 2024-05-09T09:57:05.955 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40803.log 2024-05-09T09:57:05.956 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-05-09T09:57:05.956 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33304.log.gz 2024-05-09T09:57:05.956 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40803.log.gz 2024-05-09T09:57:05.956 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-09T09:57:05.957 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39803.log 2024-05-09T09:57:05.957 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-05-09T09:57:05.957 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39220.log 2024-05-09T09:57:05.957 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39803.log.gz 2024-05-09T09:57:05.957 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35631.log 2024-05-09T09:57:05.957 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38035.log 2024-05-09T09:57:05.957 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39220.log.gz 2024-05-09T09:57:05.976 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35631.log.gz 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31715.log 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38799.log 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38035.log.gz 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31715.log: 91.0% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31715.log.gz 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32973.log 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38799.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38799.log.gz 2024-05-09T09:57:05.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32973.log.gz 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40986.log 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30431.log 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31663.log 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40986.log.gz 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30027.log 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30431.log.gz 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40052.log 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31663.log.gz 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41246.log 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30027.log.gz 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30232.log 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40052.log.gz 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40934.log 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41246.log.gz 2024-05-09T09:57:05.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39609.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30232.log.gz 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39246.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40934.log.gz 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30646.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39609.log.gz 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39246.log.gz 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34206.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30646.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30646.log.gz 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34206.log.gz 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39584.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32194.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39584.log.gz 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30645.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40725.log 2024-05-09T09:57:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32194.log.gz 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30645.log.gz 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30956.log 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39116.log 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40725.log.gz 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30956.log.gz 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39168.log 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41270.log 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39116.log.gz 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39168.log.gz 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38770.log 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33262.log 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41270.log.gz 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38770.log.gz 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36945.log 2024-05-09T09:57:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30632.log 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33262.log.gz 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36945.log.gz 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30082.log 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31813.log 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30632.log.gz 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30082.log.gz 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34296.log 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33758.log 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31813.log.gz 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34296.log.gz 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32322.log 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32137.log 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33758.log.gz 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32322.log.gz 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35516.log 2024-05-09T09:57:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:gzip/var/log/ceph/ceph-client.admin.32137.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38960.log 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32137.log.gz 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35516.log.gz 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30652.log 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41064.log 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38960.log.gz 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30652.log.gz 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40080.log 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30982.log 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41064.log.gz 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.40080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40080.log.gz 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35738.log 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30982.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30982.log.gz 2024-05-09T09:57:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35738.log.gz 2024-05-09T09:57:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38986.log 2024-05-09T09:57:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39142.log 2024-05-09T09:57:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37694.log 2024-05-09T09:57:05.983 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38986.log.gz 2024-05-09T09:57:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39142.log.gz 2024-05-09T09:57:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40751.log 2024-05-09T09:57:06.012 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-09T09:57:06.012 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-09T09:57:06.012 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25190.log 2024-05-09T09:57:06.012 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-09T09:57:06.012 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25118.log 2024-05-09T09:57:06.012 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25190.log.gz 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25094.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25118.log.gz 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25054.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25094.log: /var/log/ceph/ceph-client.admin.25054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25094.log.gz 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25054.log.gz 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25214.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25166.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25142.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25214.log.gz 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25166.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25166.log.gz 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25142.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-09T09:57:06.013 INFO:teuthology.orchestra.run.smithi080.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25142.log.gz 2024-05-09T09:57:06.014 INFO:teuthology.orchestra.run.smithi080.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T09:57:06.014 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25238.log 2024-05-09T09:57:06.014 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-09T09:57:06.014 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.25238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25238.log.gz 2024-05-09T09:57:06.014 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.4.log: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T09:57:06.016 INFO:teuthology.orchestra.run.smithi080.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T09:57:06.022 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39804.log 2024-05-09T09:57:06.022 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37694.log.gz 2024-05-09T09:57:06.022 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39038.log 2024-05-09T09:57:06.022 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40751.log.gz 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39804.log.gz 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38851.log 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34247.log 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39038.log.gz 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35374.log 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38851.log.gz 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34247.log.gz 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33627.log 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35374.log.gz 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30932.log 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33627.log.gz 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39594.log 2024-05-09T09:57:06.023 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.30932.log: /var/log/ceph/ceph-client.admin.32738.log 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30932.log.gz 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37077.log 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39594.log.gz 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32738.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32738.log.gz -5 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33497.log 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35760.log 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37077.log.gz 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39404.log 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33497.log.gz 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40882.log 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35760.log.gz 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35556.log 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39404.log.gz 2024-05-09T09:57:06.024 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39012.log 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40882.log.gz 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37560.log 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35556.log.gz 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33657.log 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39012.log.gz 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37560.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41168.log 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37560.log.gz 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37269.log 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33657.log.gz 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39802.log 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41168.log.gz 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33868.log 0.0% 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37269.log.gz 2024-05-09T09:57:06.025 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32038.log 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39802.log.gz 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30856.log 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33868.log.gz 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39596.log 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32038.log.gz 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32532.log 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30856.log.gz 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35481.log 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39596.log.gz 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31808.log 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32532.log.gz 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35481.log.gz 2024-05-09T09:57:06.026 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30414.log 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31808.log.gz 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37923.log 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40026.log 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30414.log.gz 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34049.log 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37923.log.gz 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40026.log.gz 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41012.log 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41038.log 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34049.log.gz 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30830.log 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41012.log.gz 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41038.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.41038.log.gz 2024-05-09T09:57:06.027 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.41116.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38705.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30830.log.gz 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32998.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41116.log.gz 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31689.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38705.log.gz 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32631.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32998.log.gz 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31689.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31689.log.gz 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32631.log.gz 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30142.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39383.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38934.log 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30142.log.gz 2024-05-09T09:57:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39383.log.gz 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39593.log 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39324.log 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38934.log.gz 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39593.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.39593.log.gz -- 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.32791.log 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32924.log 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39324.log.gz/var/log/ceph/ceph-client.admin.32791.log: 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30430.log 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32791.log.gz 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32924.log.gz 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33110.log 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32569.log 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30430.log.gz 2024-05-09T09:57:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38908.log 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33110.log.gz 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32569.log.gz 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37545.log 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38908.log.gz 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33909.log 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30622.log 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37545.log.gz 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33909.log.gz 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39792.log 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37653.log 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30622.log.gz 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39792.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37812.log 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39792.log.gz 2024-05-09T09:57:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37653.log.gz 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39298.log 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37812.log.gz 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35399.log 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35126.log 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39298.log.gz 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35399.log.gz 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39398.log 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35126.log.gz 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39398.log.gz 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33233.log 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41194.log 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33233.log.gz 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35597.log 2024-05-09T09:57:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38642.log 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41194.log.gz 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35597.log.gz 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41142.log 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31741.log 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38642.log.gz 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41142.log.gz 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39064.log 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33055.log 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31741.log.gz 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39064.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39400.log 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33055.log.gz 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30216.log 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39403.log 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39400.log.gz 2024-05-09T09:57:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30216.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.30216.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.33162.log 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39403.log.gz 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33791.log 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39396.log 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33162.log.gz 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33791.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33597.log 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39396.log.gz 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39818.log 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33597.log.gz 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33543.log 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39818.log.gz 2024-05-09T09:57:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30434.log 2024-05-09T09:57:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37047.log 2024-05-09T09:57:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33543.log.gz 2024-05-09T09:57:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30434.log.gz 2024-05-09T09:57:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T09:57:06.048 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37047.log.gz 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40908.log 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39819.log 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.40908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40908.log.gz 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35212.log 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32229.log 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39819.log.gz 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39272.log 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35212.log.gz 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25230.log 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32229.log: /var/log/ceph/ceph-client.admin.39272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32229.log.gz 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39272.log.gz 2024-05-09T09:57:06.049 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40699.log 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.25230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24972.log 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25230.log.gz 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33661.log 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40699.log.gz 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30882.log 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.24972.log: /var/log/ceph/ceph-client.admin.33661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24972.log.gz 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38037.log 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33661.log.gz 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41220.log 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30882.log: /var/log/ceph/ceph-client.admin.38037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39090.log 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30882.log.gz 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38037.log.gz 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41220.log.gz 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40000.log 2024-05-09T09:57:06.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36351.log 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39090.log.gz 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39820.log 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40000.log.gz 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38825.log 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36351.log.gz 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30233.log 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39820.log: /var/log/ceph/ceph-client.admin.38825.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38825.log.gz 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39820.log.gz 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30233.log.gz 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40777.log 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37139.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40777.log.gz 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33728.log 2024-05-09T09:57:06.051 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30231.log 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.33728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37486.log 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33728.log.gz 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30231.log.gz 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35177.log 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39610.log 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37486.log.gz 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35177.log.gz 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41090.log 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33431.log 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39610.log.gz 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41090.log.gz 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30229.log 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38877.log 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33431.log.gz 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30229.log.gz 2024-05-09T09:57:06.052 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37432.log 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38877.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38877.log.gz 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20196.log 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37432.log.gz 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39399.log 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.tmp-client.admin.20196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35267.log 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20196.log.gz 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39399.log.gz 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33822.log 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33301.log 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35267.log.gz 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33822.log.gz 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30634.log 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33301.log.gz 2024-05-09T09:57:06.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-09T09:57:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30633.log 2024-05-09T09:57:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30634.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T09:57:06.054 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30634.log.gz 2024-05-09T09:57:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30633.log.gz 2024-05-09T09:57:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34103.log 2024-05-09T09:57:06.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-05-09T09:57:06.063 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34103.log.gz 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30429.log 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33106.log 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30429.log.gz 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34164.log 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33106.log.gz 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34164.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31815.log 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34164.log.gz 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33493.log 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31815.log.gz 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33571.log 2024-05-09T09:57:06.064 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32817.log 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33493.log.gz 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33571.log.gz 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37315.log 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35693.log 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32817.log.gz 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37315.log.gz 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31771.log 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30421.log 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35693.log.gz 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31771.log.gz 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39350.log 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31996.log 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30421.log.gz 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39350.log.gz 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34024.log 2024-05-09T09:57:06.065 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25136.log 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31996.log.gz 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34024.log.gz 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40673.log 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.25136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33937.log 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25136.log.gz 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40673.log.gz 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30055.log 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30441.log 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33937.log.gz 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30055.log.gz 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30224.log 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31955.log 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30441.log.gz 2024-05-09T09:57:06.066 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30224.log.gz 2024-05-09T09:57:06.067 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32448.log 2024-05-09T09:57:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30174.log 2024-05-09T09:57:06.073 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31955.log.gz 2024-05-09T09:57:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32448.log.gz 2024-05-09T09:57:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34517.log 2024-05-09T09:57:06.073 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32388.log 2024-05-09T09:57:06.073 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30174.log.gz 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34517.log.gz 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39816.log 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37838.log 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32388.log.gz 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39816.log.gz 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37736.log 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37894.log 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37838.log.gz 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37736.log.gz 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32878.log 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40856.log 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37894.log.gz 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32878.log.gz 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33207.log 2024-05-09T09:57:06.074 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39194.log 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40856.log.gz 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33207.log.gz 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30222.log 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30644.log 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39194.log.gz 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30222.log.gz 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30234.log 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30002.log 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30644.log.gz 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30234.log.gz 2024-05-09T09:57:06.075 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35315.log 2024-05-09T09:57:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33422.log 2024-05-09T09:57:06.080 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30002.log.gz 2024-05-09T09:57:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35315.log.gz 2024-05-09T09:57:06.080 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32635.log 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39612.log 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33422.log.gz 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32635.log.gz 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30906.log 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32111.log 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39612.log.gz 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30906.log.gz 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40960.log 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32475.log 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32111.log.gz 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40960.log.gz 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37353.log 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34403.log 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32475.log.gz 2024-05-09T09:57:06.081 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37353.log.gz 2024-05-09T09:57:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30442.log 2024-05-09T09:57:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39401.log 2024-05-09T09:57:06.082 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34403.log.gz 2024-05-09T09:57:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30442.log.gz 2024-05-09T09:57:06.082 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40830.log 2024-05-09T09:57:06.083 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39401.log.gz 2024-05-09T09:57:06.083 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40830.log.gz 2024-05-09T09:57:06.154 INFO:teuthology.orchestra.run.smithi080.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-09T09:57:06.203 INFO:teuthology.orchestra.run.smithi032.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-09T09:57:06.293 INFO:teuthology.orchestra.run.smithi032.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T09:57:06.439 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-09T09:57:06.565 INFO:teuthology.orchestra.run.smithi080.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-09T09:57:06.621 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T09:57:06.678 INFO:teuthology.orchestra.run.smithi080.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-09T09:57:06.726 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T09:57:06.732 INFO:teuthology.orchestra.run.smithi080.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-09T09:57:06.734 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-09T09:57:06.734 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m0.754s 2024-05-09T09:57:06.734 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m2.475s 2024-05-09T09:57:06.734 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.117s 2024-05-09T09:57:06.743 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T09:57:06.843 INFO:teuthology.orchestra.run.smithi032.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T09:57:06.845 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-05-09T09:57:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m0.905s 2024-05-09T09:57:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:user 0m3.610s 2024-05-09T09:57:06.845 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m0.187s 2024-05-09T09:57:06.845 INFO:tasks.ceph:Archiving logs... 2024-05-09T09:57:06.846 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/remote/smithi032/log 2024-05-09T09:57:06.846 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T09:57:07.448 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/remote/smithi080/log 2024-05-09T09:57:07.449 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T09:57:07.785 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T09:57:07.795 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T09:57:07.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T09:57:07.798 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T09:57:07.879 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T09:57:07.889 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T09:57:07.889 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T09:57:07.892 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T09:57:07.902 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T09:57:07.902 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-05-09T09:57:07.902 INFO:teuthology.orchestra.run.smithi032.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.086 -0.716 0.908 2024-05-09T09:57:07.902 INFO:teuthology.orchestra.run.smithi032.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 377 0.116 +0.634 0.765 2024-05-09T09:57:07.902 INFO:teuthology.orchestra.run.smithi032.stdout:*hv03.front.sepi 74.6.168.72 3 u 31 64 377 0.078 -0.640 0.885 2024-05-09T09:57:07.902 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:57:07.904 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T09:57:07.904 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-05-09T09:57:07.904 INFO:teuthology.orchestra.run.smithi080.stdout:+hv01.front.sepi 67.205.162.81 3 u 26 64 377 0.089 -1.108 0.838 2024-05-09T09:57:07.904 INFO:teuthology.orchestra.run.smithi080.stdout:+hv02.front.sepi 63.231.80.2 3 u 26 64 377 0.080 -0.471 0.968 2024-05-09T09:57:07.904 INFO:teuthology.orchestra.run.smithi080.stdout:*hv03.front.sepi 74.6.168.72 3 u 26 64 377 0.078 -1.767 0.976 2024-05-09T09:57:07.904 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:57:07.905 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T09:57:07.915 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T09:57:07.915 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T09:57:07.924 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T09:57:07.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T09:57:07.942 INFO:teuthology.task.internal:Duration was 925.855378 seconds 2024-05-09T09:57:07.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T09:57:07.953 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T09:57:07.953 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T09:57:07.955 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T09:57:07.992 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T09:57:07.993 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-05-09T09:57:07.993 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T09:57:08.050 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-05-09T09:57:08.051 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T09:57:08.061 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T09:57:08.062 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T09:57:08.098 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T09:57:08.130 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T09:57:08.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T09:57:08.166 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T09:57:08.231 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T09:57:08.242 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T09:57:08.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T09:57:08.255 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T09:57:08.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T09:57:08.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T09:57:08.298 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T09:57:08.307 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-05-09T09:57:08.317 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-05-09T09:57:08.415 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T09:57:08.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:57:08.421 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T09:57:08.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:57:08.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T09:57:08.471 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T09:57:08.471 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/remote/smithi032 2024-05-09T09:57:08.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T09:57:08.494 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699640/remote/smithi080 2024-05-09T09:57:08.494 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T09:57:08.533 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T09:57:08.533 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T09:57:08.537 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T09:57:08.578 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T09:57:08.588 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T09:57:08.588 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T09:57:08.611 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T09:57:08.611 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T09:57:08.613 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T09:57:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: 658635 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 09:57 /home/ubuntu/cephtest 2024-05-09T09:57:08.625 INFO:teuthology.orchestra.run.smithi080.stdout: 658462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 09:57 /home/ubuntu/cephtest 2024-05-09T09:57:08.627 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T09:57:08.637 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T09:57:08.659 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} duration: 925.8553776741028 flavor: default owner: scheduled_kkeithle@teuthology success: true 2024-05-09T09:57:08.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T09:57:08.734 INFO:teuthology.run:pass